2023-08-03T14:08:33.958 INFO:root:teuthology version: 0.0.1.dev179+gce5f6d5 2023-08-03T14:08:33.960 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T14:08:34.109 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f52e8c6bee0>, signals=[15]) 2023-08-03T14:08:34.111 INFO:teuthology.lock.ops:Start node 'smithi022.front.sepia.ceph.com' reimaging 2023-08-03T14:08:34.112 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: reset os type and version on server 2023-08-03T14:08:34.112 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2023-08-03T14:08:34.133 INFO:teuthology.lock.ops:Start node 'smithi135.front.sepia.ceph.com' reimaging 2023-08-03T14:08:34.133 INFO:teuthology.lock.ops:Updating [smithi135.front.sepia.ceph.com]: reset os type and version on server 2023-08-03T14:08:34.134 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2023-08-03T14:08:34.136 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /host {"name": "smithi022"} 2023-08-03T14:08:34.158 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /host {"name": "smithi135"} 2023-08-03T14:08:34.210 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-03T14:08:34.235 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-03T14:08:34.249 DEBUG:teuthology.provision.fog.smithi022:Requesting image smithi_centos_8.stream (ID 3) 2023-08-03T14:08:34.250 DEBUG:teuthology.provision.fog.smithi022:FOG request: PUT /host/128 {"imageID": 3} 2023-08-03T14:08:34.284 DEBUG:teuthology.provision.fog.smithi135:Requesting image smithi_centos_8.stream (ID 3) 2023-08-03T14:08:34.284 DEBUG:teuthology.provision.fog.smithi135:FOG request: PUT /host/240 {"imageID": 3} 2023-08-03T14:08:34.303 INFO:teuthology.provision.fog.smithi022:Scheduling deploy of centos 8.stream 2023-08-03T14:08:34.304 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-03T14:08:34.336 INFO:teuthology.provision.fog.smithi135:Scheduling deploy of centos 8.stream 2023-08-03T14:08:34.336 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-08-03T14:08:34.347 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /tasktype {"name": "deploy"} 2023-08-03T14:08:34.378 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /tasktype {"name": "deploy"} 2023-08-03T14:08:34.381 DEBUG:teuthology.provision.fog.smithi022:FOG request: POST /host/128/task {"taskTypeID": 1} 2023-08-03T14:08:34.407 DEBUG:teuthology.provision.fog.smithi135:FOG request: POST /host/240/task {"taskTypeID": 1} 2023-08-03T14:08:34.433 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-03T14:08:34.479 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-08-03T14:08:34.521 INFO:teuthology.orchestra.console.smithi022:Power off 2023-08-03T14:08:34.522 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-03T14:08:34.544 DEBUG:teuthology.orchestra.console.smithi022:power off output: Chassis Power Control: Down/Off 2023-08-03T14:08:34.545 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-03T14:08:34.567 INFO:teuthology.orchestra.console.smithi135:Power off 2023-08-03T14:08:34.567 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-03T14:08:34.577 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2023-08-03T14:08:34.590 DEBUG:teuthology.orchestra.console.smithi135:power off output: Chassis Power Control: Down/Off 2023-08-03T14:08:34.590 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-03T14:08:34.614 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2023-08-03T14:08:38.580 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-03T14:08:38.616 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-03T14:08:38.690 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2023-08-03T14:08:38.726 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2023-08-03T14:08:42.692 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-03T14:08:42.727 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-03T14:08:42.803 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2023-08-03T14:08:42.837 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2023-08-03T14:08:42.905 INFO:teuthology.orchestra.console.smithi022:Power off completed 2023-08-03T14:08:42.938 INFO:teuthology.orchestra.console.smithi135:Power off completed 2023-08-03T14:08:43.006 INFO:teuthology.orchestra.console.smithi022:Power on 2023-08-03T14:08:43.006 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-03T14:08:43.028 DEBUG:teuthology.orchestra.console.smithi022:power on output: Chassis Power Control: Up/On 2023-08-03T14:08:43.028 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-03T14:08:43.040 INFO:teuthology.orchestra.console.smithi135:Power on 2023-08-03T14:08:43.041 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-03T14:08:43.051 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2023-08-03T14:08:43.062 DEBUG:teuthology.orchestra.console.smithi135:power on output: Chassis Power Control: Up/On 2023-08-03T14:08:43.063 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-03T14:08:43.083 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2023-08-03T14:08:47.056 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-03T14:08:47.085 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-03T14:08:47.166 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2023-08-03T14:08:47.195 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2023-08-03T14:08:51.168 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-03T14:08:51.196 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-03T14:08:51.306 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2023-08-03T14:08:51.364 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2023-08-03T14:08:51.407 INFO:teuthology.orchestra.console.smithi135:Power on completed 2023-08-03T14:08:51.465 INFO:teuthology.orchestra.console.smithi022:Power on completed 2023-08-03T14:08:51.508 INFO:teuthology.provision.fog.smithi135:Waiting for deploy to finish 2023-08-03T14:08:51.508 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-08-03T14:08:51.567 INFO:teuthology.provision.fog.smithi022:Waiting for deploy to finish 2023-08-03T14:08:51.567 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-03T14:09:06.571 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-08-03T14:09:06.622 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-03T14:09:21.652 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-08-03T14:09:21.676 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-03T14:09:36.728 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-08-03T14:09:36.738 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-03T14:09:51.808 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-08-03T14:09:51.809 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-03T14:10:06.881 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-08-03T14:10:06.882 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-03T14:10:21.950 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-08-03T14:10:21.953 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-03T14:10:37.028 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-03T14:10:37.030 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-08-03T14:10:52.108 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-03T14:10:52.109 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-08-03T14:11:07.188 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-03T14:11:07.189 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-08-03T14:11:22.257 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-03T14:11:22.258 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-08-03T14:11:22.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-03T14:11:37.336 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-08-03T14:11:37.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-03T14:11:40.788 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-08-03T14:11:46.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-03T14:11:49.872 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-08-03T14:11:55.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-03T14:11:55.888 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-08-03T14:11:58.928 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-08-03T14:12:01.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-03T14:12:04.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-03T14:12:04.944 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-08-03T14:12:07.984 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-08-03T14:12:10.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-03T14:12:13.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-03T14:12:14.000 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-08-03T14:12:17.040 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-08-03T14:12:20.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-03T14:12:23.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-03T14:12:23.056 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-08-03T14:12:26.096 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-08-03T14:12:29.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-03T14:12:32.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-03T14:12:35.152 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-08-03T14:12:41.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-03T14:12:44.208 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-08-03T14:12:50.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-03T14:13:29.100 WARNING:teuthology.provision.fog.smithi135:timed out 2023-08-03T14:13:35.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-03T14:13:35.323 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-03T14:13:35.324 DEBUG:teuthology.orchestra.run.smithi135:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-03T14:13:35.561 INFO:teuthology.provision.fog.smithi135:Node is ready 2023-08-03T14:13:35.562 DEBUG:teuthology.orchestra.run.smithi135:> hostname 2023-08-03T14:13:35.621 INFO:teuthology.orchestra.run.smithi135.stdout:smithi135.front.sepia.ceph.com 2023-08-03T14:13:35.621 DEBUG:teuthology.orchestra.run.smithi135:> grep smithi135.front.sepia.ceph.com /etc/hosts 2023-08-03T14:13:35.681 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135 smithi135.front.sepia.ceph.com smithi135 2023-08-03T14:13:35.682 DEBUG:teuthology.orchestra.run.smithi135:> sudo hostname smithi135 2023-08-03T14:13:35.776 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/smithi135.front.sepia.ceph.com/smithi135/g' /etc/hosts 2023-08-03T14:13:35.806 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/172.21.15.135/172.21.15.135/g' /etc/hosts 2023-08-03T14:13:35.874 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/smithi135.front.sepia.ceph.com/smithi135/g' /etc/hostname 2023-08-03T14:13:35.942 DEBUG:teuthology.orchestra.run.smithi135:> sudo hostname smithi135 2023-08-03T14:13:36.010 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2023-08-03T14:13:36.068 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="CentOS Stream" 2023-08-03T14:13:36.068 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="8" 2023-08-03T14:13:36.068 INFO:teuthology.orchestra.run.smithi135.stdout:ID="centos" 2023-08-03T14:13:36.068 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="rhel fedora" 2023-08-03T14:13:36.068 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="8" 2023-08-03T14:13:36.069 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el8" 2023-08-03T14:13:36.069 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-03T14:13:36.069 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2023-08-03T14:13:36.069 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-03T14:13:36.069 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://centos.org/" 2023-08-03T14:13:36.069 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-03T14:13:36.069 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-03T14:13:36.070 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-03T14:13:36.071 INFO:teuthology.provision.fog.smithi135:Deploy complete! 2023-08-03T14:13:36.073 DEBUG:teuthology.parallel:result is None 2023-08-03T14:13:50.228 WARNING:teuthology.provision.fog.smithi022:timed out 2023-08-03T14:13:56.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-03T14:13:56.439 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-03T14:13:56.440 DEBUG:teuthology.orchestra.run.smithi022:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-03T14:13:56.681 INFO:teuthology.provision.fog.smithi022:Node is ready 2023-08-03T14:13:56.681 DEBUG:teuthology.orchestra.run.smithi022:> hostname 2023-08-03T14:13:56.702 INFO:teuthology.orchestra.run.smithi022.stdout:smithi022.front.sepia.ceph.com 2023-08-03T14:13:56.703 DEBUG:teuthology.orchestra.run.smithi022:> grep smithi022.front.sepia.ceph.com /etc/hosts 2023-08-03T14:13:56.761 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-08-03T14:13:56.761 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname smithi022 2023-08-03T14:13:56.857 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/smithi022.front.sepia.ceph.com/smithi022/g' /etc/hosts 2023-08-03T14:13:56.889 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/172.21.15.22/172.21.15.22/g' /etc/hosts 2023-08-03T14:13:56.957 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/smithi022.front.sepia.ceph.com/smithi022/g' /etc/hostname 2023-08-03T14:13:57.026 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname smithi022 2023-08-03T14:13:57.093 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2023-08-03T14:13:57.152 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="CentOS Stream" 2023-08-03T14:13:57.152 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="8" 2023-08-03T14:13:57.152 INFO:teuthology.orchestra.run.smithi022.stdout:ID="centos" 2023-08-03T14:13:57.152 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="rhel fedora" 2023-08-03T14:13:57.152 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="8" 2023-08-03T14:13:57.153 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el8" 2023-08-03T14:13:57.153 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-03T14:13:57.153 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31" 2023-08-03T14:13:57.153 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-03T14:13:57.153 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://centos.org/" 2023-08-03T14:13:57.153 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-03T14:13:57.153 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-03T14:13:57.154 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-03T14:13:57.154 INFO:teuthology.provision.fog.smithi022:Deploy complete! 2023-08-03T14:13:57.154 DEBUG:teuthology.parallel:result is None 2023-08-03T14:13:57.294 INFO:teuthology.lock.ops:Checking smithi022.front.sepia.ceph.com 2023-08-03T14:13:57.295 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-03T14:13:57.319 INFO:teuthology.lock.ops:Checking smithi135.front.sepia.ceph.com 2023-08-03T14:13:57.320 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-03T14:13:57.337 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: set os type and version on server 2023-08-03T14:13:57.338 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-08-03T14:13:57.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-03T14:13:57.400 DEBUG:teuthology.orchestra.run.smithi022:> true 2023-08-03T14:13:57.472 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-08-03T14:13:57.473 DEBUG:teuthology.orchestra.run.smithi022:> uname -m 2023-08-03T14:13:57.530 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64 2023-08-03T14:13:57.531 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2023-08-03T14:13:57.589 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="CentOS Stream" 2023-08-03T14:13:57.589 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="8" 2023-08-03T14:13:57.589 INFO:teuthology.orchestra.run.smithi022.stdout:ID="centos" 2023-08-03T14:13:57.589 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="rhel fedora" 2023-08-03T14:13:57.589 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="8" 2023-08-03T14:13:57.589 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el8" 2023-08-03T14:13:57.590 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-03T14:13:57.590 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31" 2023-08-03T14:13:57.590 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-03T14:13:57.590 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://centos.org/" 2023-08-03T14:13:57.590 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-03T14:13:57.590 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-03T14:13:57.590 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-03T14:13:57.591 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2023-08-03T14:13:57.611 INFO:teuthology.lock.ops:Updating [smithi135.front.sepia.ceph.com]: set os type and version on server 2023-08-03T14:13:57.612 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-08-03T14:13:57.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-03T14:13:57.678 DEBUG:teuthology.orchestra.run.smithi135:> true 2023-08-03T14:13:57.810 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-08-03T14:13:57.811 DEBUG:teuthology.orchestra.run.smithi135:> uname -m 2023-08-03T14:13:57.869 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64 2023-08-03T14:13:57.870 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2023-08-03T14:13:57.928 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="CentOS Stream" 2023-08-03T14:13:57.929 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="8" 2023-08-03T14:13:57.929 INFO:teuthology.orchestra.run.smithi135.stdout:ID="centos" 2023-08-03T14:13:57.929 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="rhel fedora" 2023-08-03T14:13:57.930 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="8" 2023-08-03T14:13:57.930 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el8" 2023-08-03T14:13:57.930 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-03T14:13:57.930 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2023-08-03T14:13:57.930 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-03T14:13:57.930 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://centos.org/" 2023-08-03T14:13:57.931 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-03T14:13:57.931 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-03T14:13:57.931 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-03T14:13:57.931 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2023-08-03T14:13:57.953 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T14:13:58.042 INFO:teuthology.dispatcher.supervisor:Running job 7359536 2023-08-03T14:13:58.043 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_ce5f6d589a888dfc88977261bfa1ed63441de8fb/virtualenv/bin/teuthology -v --owner scheduled_matan@teuthology --archive /home/teuthworker/archive/matan-2023-08-03_13:28:04-crimson-rados-wip-matanb-crimson-only-add-asan-req-distro-crimson-smithi/7359536 --name matan-2023-08-03_13:28:04-crimson-rados-wip-matanb-crimson-only-add-asan-req-distro-crimson-smithi --description crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_8 crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/pool-snaps-few-objects} -- /home/teuthworker/archive/matan-2023-08-03_13:28:04-crimson-rados-wip-matanb-crimson-only-add-asan-req-distro-crimson-smithi/7359536/orig.config.yaml 2023-08-03T14:13:58.047 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/matan-2023-08-03_13:28:04-crimson-rados-wip-matanb-crimson-only-add-asan-req-distro-crimson-smithi/7359536 2023-08-03T14:13:58.047 INFO:teuthology.dispatcher.supervisor:Job PID: 1003 2023-08-03T14:13:58.048 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-03T14:15:58.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T14:17:58.313 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T14:19:58.472 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T14:21:58.637 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T14:23:58.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T14:25:58.965 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T14:27:59.100 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T14:29:59.265 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T14:31:59.437 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T14:33:59.601 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T14:35:59.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T14:37:59.849 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T14:40:00.014 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T14:42:00.133 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T14:44:00.293 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T14:46:00.449 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T14:48:00.625 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T14:50:00.785 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T14:50:00.848 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-03T14:50:00.998 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-03T14:50:00.998 INFO:teuthology.nuke:Checking targets against current locks 2023-08-03T14:50:01.045 DEBUG:teuthology.nuke:shortname: smithi022 2023-08-03T14:50:01.046 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-03T14:50:01.066 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi022.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-08-03_13:28:04-crimson-rados-wip-matanb-crimson-only-add-asan-req-distro-crimson-smithi/7359536', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-03 14:08:33.164297', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC28Ua6+sMDDL/Ef0neHDU17it6nkYrTA4Sg0+bVHY5MM2WowUiTGIGEYu3qDm1RDmMgNPj6aSu0Geele2XuQfOSaHWRcf8bePjJdD4Iyqh9EomyVjVV+OpoGi7JsnDOsb3tELdk5UQLAJLLntL2sKCt1WiU/wKIncDf2ECd4juSHlNugjdeAzafVjzfrdLrzRw/uppYblhTm3bZtxmWEDPS35NOD+vCeuB/6CPaVZE4Me3Lcg3UuyeVDx5uDiRG06UeKF3tK66iFQP7VtIQLUkuSVW6rflx6dJP4VEbuOwNz0e5Wp+mFsdYTiYwhXXFh6AMboZwky18E9MaLSuStWk7A8lSC4aAM1xybWTc/NMExbxP44hmHS0W21d+FQOEJ/HHjh3yrUO2nY/0dk7sDiAbwj/yQtXNzDOy8y4LQqVN59/J0HYreM41A38urzwo2TsGg8/2TFLaYOL0qY1V5+UCYUMxbMCYLQBknBlTSQjqpyZfGNoM37gE3NcUYFMlNU='} 2023-08-03T14:50:01.069 DEBUG:teuthology.nuke:shortname: smithi135 2023-08-03T14:50:01.070 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-03T14:50:01.089 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi135.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-08-03_13:28:04-crimson-rados-wip-matanb-crimson-only-add-asan-req-distro-crimson-smithi/7359536', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-03 14:08:33.166304', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDG1PBU0ZAaiAadrVlUW7OBVeFwspVNATLmtqk9fAvbG3gqlmGQFxRZjA0ePCMjY6OypeQKOoZgOtjyjXER0U2lbJkltrIucBaKA90jg8JP9IVRmXiUpLEW7jb+V1TMjkB5aLIIP7pUJ4LrN0lQZaJ/NpkwlQN4dhVtCS6uxFm6fgiKBk1q40rphPAScNXlAYe6Jd0PZ6Ud3H615bpGJdfWW/6KUq+4BuOJ+MCsvTmkutuKPimjsCduhgWxxeY3LOfLuS8aFyNM+dAmFkuO0rpcj+/HaWs4XPvfur77iXOOtHTGfotQwtUBwlero5GqOYfdy28WpqvXH5IASFc9QYMTtaOlEc0lUgaezR4AmtsQvWSD/L3J7n0oorJEGTmMuAmKsXFVY5WKCbOhNFafhSAnpZrI9WGrblgX91+JNdQHG9y9B5gzpyxZ7/WUiNAhte6CGytYLGNyOT3wO1a59osaz1GbT7KCZOHvy3tU+FrZYQ+jd5Wcp1Ca/+PyKj0A3YM='} 2023-08-03T14:50:01.111 INFO:teuthology.orchestra.console.smithi022:Power off 2023-08-03T14:50:01.112 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-03T14:50:01.136 DEBUG:teuthology.orchestra.console.smithi022:power off output: Chassis Power Control: Down/Off 2023-08-03T14:50:01.136 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-03T14:50:01.154 INFO:teuthology.orchestra.console.smithi135:Power off 2023-08-03T14:50:01.155 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-03T14:50:01.163 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2023-08-03T14:50:01.178 DEBUG:teuthology.orchestra.console.smithi135:power off output: Chassis Power Control: Down/Off 2023-08-03T14:50:01.178 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-03T14:50:01.199 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2023-08-03T14:50:01.265 INFO:teuthology.orchestra.console.smithi022:Power off completed 2023-08-03T14:50:01.300 INFO:teuthology.orchestra.console.smithi135:Power off completed 2023-08-03T14:50:01.413 INFO:teuthology.lock.ops:unlocked: smithi022.front.sepia.ceph.com 2023-08-03T14:50:01.446 INFO:teuthology.lock.ops:unlocked: smithi135.front.sepia.ceph.com