2023-08-04T19:20:59.175 INFO:root:teuthology version: 0.0.1.dev181+g7fda959 2023-08-04T19:20:59.176 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-04T19:20:59.319 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f211b8adf70>, signals=[15]) 2023-08-04T19:20:59.321 INFO:teuthology.lock.ops:Start node 'smithi029.front.sepia.ceph.com' reimaging 2023-08-04T19:20:59.321 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: reset os type and version on server 2023-08-04T19:20:59.322 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2023-08-04T19:20:59.343 INFO:teuthology.lock.ops:Start node 'smithi191.front.sepia.ceph.com' reimaging 2023-08-04T19:20:59.343 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: reset os type and version on server 2023-08-04T19:20:59.344 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2023-08-04T19:20:59.347 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /host {"name": "smithi029"} 2023-08-04T19:20:59.368 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /host {"name": "smithi191"} 2023-08-04T19:20:59.443 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-04T19:20:59.447 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-04T19:20:59.481 DEBUG:teuthology.provision.fog.smithi029:Requesting image smithi_centos_9.stream (ID 10) 2023-08-04T19:20:59.481 DEBUG:teuthology.provision.fog.smithi029:FOG request: PUT /host/134 {"imageID": 10} 2023-08-04T19:20:59.485 DEBUG:teuthology.provision.fog.smithi191:Requesting image smithi_centos_9.stream (ID 10) 2023-08-04T19:20:59.485 DEBUG:teuthology.provision.fog.smithi191:FOG request: PUT /host/296 {"imageID": 10} 2023-08-04T19:20:59.538 INFO:teuthology.provision.fog.smithi029:Scheduling deploy of centos 9.stream 2023-08-04T19:20:59.538 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-08-04T19:20:59.541 INFO:teuthology.provision.fog.smithi191:Scheduling deploy of centos 9.stream 2023-08-04T19:20:59.541 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-08-04T19:20:59.584 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /tasktype {"name": "deploy"} 2023-08-04T19:20:59.591 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /tasktype {"name": "deploy"} 2023-08-04T19:20:59.620 DEBUG:teuthology.provision.fog.smithi029:FOG request: POST /host/134/task {"taskTypeID": 1} 2023-08-04T19:20:59.634 DEBUG:teuthology.provision.fog.smithi191:FOG request: POST /host/296/task {"taskTypeID": 1} 2023-08-04T19:20:59.703 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-08-04T19:20:59.714 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-08-04T19:20:59.790 INFO:teuthology.orchestra.console.smithi029:Power off 2023-08-04T19:20:59.791 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-04T19:20:59.808 INFO:teuthology.orchestra.console.smithi191:Power off 2023-08-04T19:20:59.809 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-04T19:20:59.825 DEBUG:teuthology.orchestra.console.smithi029:power off output: Chassis Power Control: Down/Off 2023-08-04T19:20:59.825 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-04T19:20:59.837 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off 2023-08-04T19:20:59.838 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-04T19:20:59.856 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on 2023-08-04T19:20:59.858 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2023-08-04T19:21:03.860 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-04T19:21:03.869 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-04T19:21:03.971 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on 2023-08-04T19:21:03.981 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2023-08-04T19:21:07.976 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-04T19:21:07.984 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-04T19:21:08.086 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off 2023-08-04T19:21:08.094 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2023-08-04T19:21:08.187 INFO:teuthology.orchestra.console.smithi029:Power off completed 2023-08-04T19:21:08.195 INFO:teuthology.orchestra.console.smithi191:Power off completed 2023-08-04T19:21:08.288 INFO:teuthology.orchestra.console.smithi029:Power on 2023-08-04T19:21:08.289 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-04T19:21:08.296 INFO:teuthology.orchestra.console.smithi191:Power on 2023-08-04T19:21:08.297 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-04T19:21:08.311 DEBUG:teuthology.orchestra.console.smithi029:power on output: Chassis Power Control: Up/On 2023-08-04T19:21:08.311 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-04T19:21:08.320 DEBUG:teuthology.orchestra.console.smithi191:power on output: Chassis Power Control: Up/On 2023-08-04T19:21:08.321 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-04T19:21:08.332 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off 2023-08-04T19:21:08.341 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2023-08-04T19:21:12.336 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-04T19:21:12.345 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-04T19:21:12.447 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off 2023-08-04T19:21:12.455 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2023-08-04T19:21:16.452 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-04T19:21:16.460 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-04T19:21:16.562 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on 2023-08-04T19:21:16.570 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2023-08-04T19:21:16.663 INFO:teuthology.orchestra.console.smithi029:Power on completed 2023-08-04T19:21:16.671 INFO:teuthology.orchestra.console.smithi191:Power on completed 2023-08-04T19:21:16.765 INFO:teuthology.provision.fog.smithi029:Waiting for deploy to finish 2023-08-04T19:21:16.765 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-08-04T19:21:16.772 INFO:teuthology.provision.fog.smithi191:Waiting for deploy to finish 2023-08-04T19:21:16.773 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-08-04T19:21:31.848 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-08-04T19:21:31.849 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-08-04T19:21:46.920 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-08-04T19:21:46.922 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-08-04T19:22:01.993 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-08-04T19:22:01.995 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-08-04T19:22:17.068 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-08-04T19:22:17.069 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-08-04T19:22:32.141 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-08-04T19:22:32.142 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-08-04T19:22:47.228 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-08-04T19:22:47.230 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-08-04T19:23:02.300 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-08-04T19:23:02.302 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-08-04T19:23:17.368 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-08-04T19:23:17.370 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-08-04T19:23:32.440 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-08-04T19:23:32.441 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-08-04T19:23:47.508 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-08-04T19:23:47.510 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-08-04T19:23:47.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-04T19:24:02.580 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-08-04T19:24:06.128 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-08-04T19:24:12.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-04T19:24:15.184 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-08-04T19:24:17.647 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-08-04T19:24:17.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-04T19:24:21.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-04T19:24:24.244 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-08-04T19:24:30.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-04T19:24:33.328 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-08-04T19:24:36.080 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2023-08-04T19:24:39.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-04T19:24:42.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-04T19:24:45.136 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2023-08-04T19:24:51.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-04T19:24:54.196 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2023-08-04T19:25:00.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-04T19:25:39.373 WARNING:teuthology.provision.fog.smithi191:timed out 2023-08-04T19:25:45.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-04T19:25:45.671 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-04T19:25:45.672 DEBUG:teuthology.orchestra.run.smithi191:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-04T19:25:46.010 INFO:teuthology.provision.fog.smithi191:Node is ready 2023-08-04T19:25:46.010 DEBUG:teuthology.orchestra.run.smithi191:> hostname 2023-08-04T19:25:46.024 INFO:teuthology.orchestra.run.smithi191.stdout:smithi191.front.sepia.ceph.com 2023-08-04T19:25:46.024 DEBUG:teuthology.orchestra.run.smithi191:> grep smithi191.front.sepia.ceph.com /etc/hosts 2023-08-04T19:25:46.078 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.15.191 smithi191.front.sepia.ceph.com smithi191 2023-08-04T19:25:46.079 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191 2023-08-04T19:25:46.207 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hosts 2023-08-04T19:25:46.235 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/172.21.15.191/172.21.15.191/g' /etc/hosts 2023-08-04T19:25:46.302 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hostname 2023-08-04T19:25:46.368 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191 2023-08-04T19:25:46.433 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2023-08-04T19:25:46.487 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream" 2023-08-04T19:25:46.487 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="9" 2023-08-04T19:25:46.488 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos" 2023-08-04T19:25:46.488 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora" 2023-08-04T19:25:46.488 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="9" 2023-08-04T19:25:46.488 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el9" 2023-08-04T19:25:46.488 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-04T19:25:46.488 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2023-08-04T19:25:46.489 INFO:teuthology.orchestra.run.smithi191.stdout:LOGO="fedora-logo-icon" 2023-08-04T19:25:46.489 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-04T19:25:46.489 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/" 2023-08-04T19:25:46.489 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-04T19:25:46.489 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-04T19:25:46.489 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-04T19:25:46.490 INFO:teuthology.provision.fog.smithi191:Deploy complete! 2023-08-04T19:25:46.491 DEBUG:teuthology.parallel:result is None 2023-08-04T19:26:00.212 WARNING:teuthology.provision.fog.smithi029:timed out 2023-08-04T19:26:06.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-04T19:26:06.422 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-04T19:26:06.422 DEBUG:teuthology.orchestra.run.smithi029:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-04T19:26:06.815 INFO:teuthology.provision.fog.smithi029:Node is ready 2023-08-04T19:26:06.816 DEBUG:teuthology.orchestra.run.smithi029:> hostname 2023-08-04T19:26:06.830 INFO:teuthology.orchestra.run.smithi029.stdout:smithi029.front.sepia.ceph.com 2023-08-04T19:26:06.830 DEBUG:teuthology.orchestra.run.smithi029:> grep smithi029.front.sepia.ceph.com /etc/hosts 2023-08-04T19:26:06.885 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29 smithi029.front.sepia.ceph.com smithi029 2023-08-04T19:26:06.886 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname smithi029 2023-08-04T19:26:06.999 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/smithi029.front.sepia.ceph.com/smithi029/g' /etc/hosts 2023-08-04T19:26:07.029 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/172.21.15.29/172.21.15.29/g' /etc/hosts 2023-08-04T19:26:07.100 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/smithi029.front.sepia.ceph.com/smithi029/g' /etc/hostname 2023-08-04T19:26:07.171 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname smithi029 2023-08-04T19:26:07.240 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2023-08-04T19:26:07.294 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="CentOS Stream" 2023-08-04T19:26:07.295 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="9" 2023-08-04T19:26:07.295 INFO:teuthology.orchestra.run.smithi029.stdout:ID="centos" 2023-08-04T19:26:07.295 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="rhel fedora" 2023-08-04T19:26:07.295 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="9" 2023-08-04T19:26:07.295 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el9" 2023-08-04T19:26:07.296 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-04T19:26:07.296 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31" 2023-08-04T19:26:07.296 INFO:teuthology.orchestra.run.smithi029.stdout:LOGO="fedora-logo-icon" 2023-08-04T19:26:07.296 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-04T19:26:07.296 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://centos.org/" 2023-08-04T19:26:07.296 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-04T19:26:07.296 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-04T19:26:07.297 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-04T19:26:07.297 INFO:teuthology.provision.fog.smithi029:Deploy complete! 2023-08-04T19:26:07.297 DEBUG:teuthology.parallel:result is None 2023-08-04T19:26:07.436 INFO:teuthology.lock.ops:Checking smithi029.front.sepia.ceph.com 2023-08-04T19:26:07.437 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-04T19:26:07.463 INFO:teuthology.lock.ops:Checking smithi191.front.sepia.ceph.com 2023-08-04T19:26:07.463 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-04T19:26:07.480 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: set os type and version on server 2023-08-04T19:26:07.481 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-08-04T19:26:07.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-04T19:26:07.572 DEBUG:teuthology.orchestra.run.smithi029:> true 2023-08-04T19:26:07.638 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-08-04T19:26:07.638 DEBUG:teuthology.orchestra.run.smithi029:> uname -m 2023-08-04T19:26:07.692 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64 2023-08-04T19:26:07.693 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2023-08-04T19:26:07.746 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="CentOS Stream" 2023-08-04T19:26:07.747 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="9" 2023-08-04T19:26:07.747 INFO:teuthology.orchestra.run.smithi029.stdout:ID="centos" 2023-08-04T19:26:07.747 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="rhel fedora" 2023-08-04T19:26:07.747 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="9" 2023-08-04T19:26:07.747 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el9" 2023-08-04T19:26:07.747 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-04T19:26:07.748 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31" 2023-08-04T19:26:07.748 INFO:teuthology.orchestra.run.smithi029.stdout:LOGO="fedora-logo-icon" 2023-08-04T19:26:07.748 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-04T19:26:07.748 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://centos.org/" 2023-08-04T19:26:07.748 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-04T19:26:07.748 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-04T19:26:07.748 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-04T19:26:07.749 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2023-08-04T19:26:07.771 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: set os type and version on server 2023-08-04T19:26:07.772 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-08-04T19:26:07.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-04T19:26:07.855 DEBUG:teuthology.orchestra.run.smithi191:> true 2023-08-04T19:26:08.027 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-08-04T19:26:08.027 DEBUG:teuthology.orchestra.run.smithi191:> uname -m 2023-08-04T19:26:08.081 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64 2023-08-04T19:26:08.081 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2023-08-04T19:26:08.135 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream" 2023-08-04T19:26:08.135 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="9" 2023-08-04T19:26:08.135 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos" 2023-08-04T19:26:08.135 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora" 2023-08-04T19:26:08.136 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="9" 2023-08-04T19:26:08.136 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el9" 2023-08-04T19:26:08.136 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-04T19:26:08.136 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2023-08-04T19:26:08.136 INFO:teuthology.orchestra.run.smithi191.stdout:LOGO="fedora-logo-icon" 2023-08-04T19:26:08.136 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-04T19:26:08.136 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/" 2023-08-04T19:26:08.137 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-04T19:26:08.137 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-04T19:26:08.137 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-04T19:26:08.137 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2023-08-04T19:26:08.154 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-04T19:26:08.239 INFO:teuthology.dispatcher.supervisor:Running job 7361430 2023-08-04T19:26:08.239 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-08-04_19:14:21-fs-wip-batrick-testing-20230803.140718-distro-default-smithi/7361430 --name pdonnell-2023-08-04_19:14:21-fs-wip-batrick-testing-20230803.140718-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/fragment} -- /home/teuthworker/archive/pdonnell-2023-08-04_19:14:21-fs-wip-batrick-testing-20230803.140718-distro-default-smithi/7361430/orig.config.yaml 2023-08-04T19:26:08.243 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-08-04_19:14:21-fs-wip-batrick-testing-20230803.140718-distro-default-smithi/7361430 2023-08-04T19:26:08.244 INFO:teuthology.dispatcher.supervisor:Job PID: 10753 2023-08-04T19:26:08.244 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-04T19:28:08.268 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-04T19:30:08.426 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-04T19:32:08.637 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-04T19:34:08.801 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-04T19:36:08.965 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-04T19:38:09.124 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-04T19:40:09.289 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-04T19:42:09.437 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-04T19:42:09.503 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-04T19:42:09.604 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-04T19:42:09.605 INFO:teuthology.nuke:Checking targets against current locks 2023-08-04T19:42:09.647 DEBUG:teuthology.nuke:shortname: smithi029 2023-08-04T19:42:09.648 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-04T19:42:09.666 DEBUG:teuthology.nuke:shortname: smithi191 2023-08-04T19:42:09.667 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-04T19:42:09.669 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi029.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-08-04_19:14:21-fs-wip-batrick-testing-20230803.140718-distro-default-smithi/7361430', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-04 19:20:58.400962', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNuwMv+xjLCecbd89VM3ODW7hmNi4qu0BXxPwI8tI6TE9E13tEF1SKwdc7tJtcAMQSSv4D2qTTjy1BUS//IuAB4='} 2023-08-04T19:42:09.689 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-08-04_19:14:21-fs-wip-batrick-testing-20230803.140718-distro-default-smithi/7361430', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-04 19:20:58.398948', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDQbhFkbvmFVU+1VsAHxkTr5HzBQ/fIoBgyLOpVSZO8gEhX+MdBPWbz4Bq2cRzrZEDc5HqPbJsDnBRV6dDwexQg='} 2023-08-04T19:42:09.717 INFO:teuthology.orchestra.console.smithi029:Power off 2023-08-04T19:42:09.717 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-04T19:42:09.736 INFO:teuthology.orchestra.console.smithi191:Power off 2023-08-04T19:42:09.736 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-04T19:42:09.745 DEBUG:teuthology.orchestra.console.smithi029:power off output: Chassis Power Control: Down/Off 2023-08-04T19:42:09.745 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-04T19:42:09.756 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off 2023-08-04T19:42:09.756 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-04T19:42:09.768 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off 2023-08-04T19:42:09.776 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2023-08-04T19:42:09.869 INFO:teuthology.orchestra.console.smithi029:Power off completed 2023-08-04T19:42:09.877 INFO:teuthology.orchestra.console.smithi191:Power off completed 2023-08-04T19:42:10.011 INFO:teuthology.lock.ops:unlocked: smithi029.front.sepia.ceph.com 2023-08-04T19:42:10.019 INFO:teuthology.lock.ops:unlocked: smithi191.front.sepia.ceph.com