2023-08-21T08:49:57.856 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-21T08:49:57.858 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T08:49:58.003 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fdb5397af70>, signals=[15]) 2023-08-21T08:49:58.005 INFO:teuthology.lock.ops:Start node 'smithi089.front.sepia.ceph.com' reimaging 2023-08-21T08:49:58.006 INFO:teuthology.lock.ops:Updating [smithi089.front.sepia.ceph.com]: reset os type and version on server 2023-08-21T08:49:58.007 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2023-08-21T08:49:58.031 INFO:teuthology.lock.ops:Start node 'smithi121.front.sepia.ceph.com' reimaging 2023-08-21T08:49:58.032 INFO:teuthology.lock.ops:Updating [smithi121.front.sepia.ceph.com]: reset os type and version on server 2023-08-21T08:49:58.032 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2023-08-21T08:49:58.033 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /host {"name": "smithi089"} 2023-08-21T08:49:58.056 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /host {"name": "smithi121"} 2023-08-21T08:49:58.102 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-21T08:49:58.117 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-21T08:49:58.143 DEBUG:teuthology.provision.fog.smithi089:Requesting image smithi_centos_8.stream (ID 3) 2023-08-21T08:49:58.144 DEBUG:teuthology.provision.fog.smithi089:FOG request: PUT /host/194 {"imageID": 3} 2023-08-21T08:49:58.148 DEBUG:teuthology.provision.fog.smithi121:Requesting image smithi_centos_8.stream (ID 3) 2023-08-21T08:49:58.149 DEBUG:teuthology.provision.fog.smithi121:FOG request: PUT /host/226 {"imageID": 3} 2023-08-21T08:49:58.191 INFO:teuthology.provision.fog.smithi089:Scheduling deploy of centos 8.stream 2023-08-21T08:49:58.192 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-08-21T08:49:58.204 INFO:teuthology.provision.fog.smithi121:Scheduling deploy of centos 8.stream 2023-08-21T08:49:58.204 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-08-21T08:49:58.317 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /tasktype {"name": "deploy"} 2023-08-21T08:49:58.323 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /tasktype {"name": "deploy"} 2023-08-21T08:49:58.358 DEBUG:teuthology.provision.fog.smithi121:FOG request: POST /host/226/task {"taskTypeID": 1} 2023-08-21T08:49:58.365 DEBUG:teuthology.provision.fog.smithi089:FOG request: POST /host/194/task {"taskTypeID": 1} 2023-08-21T08:49:58.424 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-08-21T08:49:58.440 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-08-21T08:49:58.588 INFO:teuthology.orchestra.console.smithi121:Power off 2023-08-21T08:49:58.589 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-21T08:49:58.603 INFO:teuthology.orchestra.console.smithi089:Power off 2023-08-21T08:49:58.604 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-21T08:49:58.613 DEBUG:teuthology.orchestra.console.smithi121:power off output: Chassis Power Control: Down/Off 2023-08-21T08:49:58.613 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T08:49:58.625 DEBUG:teuthology.orchestra.console.smithi089:power off output: Chassis Power Control: Down/Off 2023-08-21T08:49:58.625 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T08:49:58.635 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is off 2023-08-21T08:49:58.652 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2023-08-21T08:49:58.737 INFO:teuthology.orchestra.console.smithi121:Power off completed 2023-08-21T08:49:58.838 INFO:teuthology.orchestra.console.smithi121:Power on 2023-08-21T08:49:58.838 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-21T08:49:58.858 DEBUG:teuthology.orchestra.console.smithi121:power on output: Chassis Power Control: Up/On 2023-08-21T08:49:58.859 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T08:49:58.878 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is off 2023-08-21T08:50:02.657 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T08:50:02.766 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2023-08-21T08:50:02.880 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T08:50:02.990 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is off 2023-08-21T08:50:06.768 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T08:50:06.878 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off 2023-08-21T08:50:06.979 INFO:teuthology.orchestra.console.smithi089:Power off completed 2023-08-21T08:50:06.991 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T08:50:07.080 INFO:teuthology.orchestra.console.smithi089:Power on 2023-08-21T08:50:07.080 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-21T08:50:07.100 DEBUG:teuthology.orchestra.console.smithi089:power on output: Chassis Power Control: Up/On 2023-08-21T08:50:07.101 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T08:50:07.109 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is on 2023-08-21T08:50:07.121 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off 2023-08-21T08:50:07.210 INFO:teuthology.orchestra.console.smithi121:Power on completed 2023-08-21T08:50:07.311 INFO:teuthology.provision.fog.smithi121:Waiting for deploy to finish 2023-08-21T08:50:07.311 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-08-21T08:50:11.124 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T08:50:11.234 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off 2023-08-21T08:50:15.239 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T08:50:15.367 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2023-08-21T08:50:15.468 INFO:teuthology.orchestra.console.smithi089:Power on completed 2023-08-21T08:50:15.568 INFO:teuthology.provision.fog.smithi089:Waiting for deploy to finish 2023-08-21T08:50:15.569 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-08-21T08:50:22.440 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-08-21T08:50:30.703 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-08-21T08:50:37.566 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-08-21T08:50:45.853 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-08-21T08:50:52.688 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-08-21T08:51:00.986 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-08-21T08:51:07.809 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-08-21T08:51:16.123 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-08-21T08:51:22.970 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-08-21T08:51:31.295 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-08-21T08:51:38.122 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-08-21T08:51:46.464 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-08-21T08:51:53.276 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-08-21T08:52:01.668 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-08-21T08:52:08.446 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-08-21T08:52:16.882 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-08-21T08:52:23.629 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-08-21T08:52:32.039 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-08-21T08:52:38.776 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-08-21T08:52:47.212 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-08-21T08:52:53.936 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-08-21T08:52:54.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T08:53:02.365 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-08-21T08:53:12.432 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2023-08-21T08:53:17.521 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-08-21T08:53:18.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T08:53:21.488 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2023-08-21T08:53:27.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T08:53:30.576 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2023-08-21T08:53:32.625 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-08-21T08:53:36.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T08:53:39.632 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2023-08-21T08:53:45.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T08:53:47.752 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-08-21T08:53:48.688 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2023-08-21T08:53:54.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T08:54:02.832 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-08-21T08:54:17.921 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-08-21T08:54:17.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T08:54:21.040 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-08-21T08:54:27.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T08:54:30.128 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-08-21T08:54:36.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T08:54:39.216 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-08-21T08:54:45.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T08:54:48.272 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-08-21T08:54:54.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T08:54:54.694 WARNING:teuthology.provision.fog.smithi121:timed out 2023-08-21T08:54:57.328 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-08-21T08:55:00.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T08:55:00.915 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-21T08:55:00.916 DEBUG:teuthology.orchestra.run.smithi121:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-21T08:55:01.190 INFO:teuthology.provision.fog.smithi121:Node is ready 2023-08-21T08:55:01.191 DEBUG:teuthology.orchestra.run.smithi121:> hostname 2023-08-21T08:55:01.210 INFO:teuthology.orchestra.run.smithi121.stdout:smithi121.front.sepia.ceph.com 2023-08-21T08:55:01.210 DEBUG:teuthology.orchestra.run.smithi121:> grep smithi121.front.sepia.ceph.com /etc/hosts 2023-08-21T08:55:01.270 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121 smithi121.front.sepia.ceph.com smithi121 2023-08-21T08:55:01.270 DEBUG:teuthology.orchestra.run.smithi121:> sudo hostname smithi121 2023-08-21T08:55:01.374 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/smithi121.front.sepia.ceph.com/smithi121/g' /etc/hosts 2023-08-21T08:55:01.403 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/172.21.15.121/172.21.15.121/g' /etc/hosts 2023-08-21T08:55:01.471 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/smithi121.front.sepia.ceph.com/smithi121/g' /etc/hostname 2023-08-21T08:55:01.538 DEBUG:teuthology.orchestra.run.smithi121:> sudo hostname smithi121 2023-08-21T08:55:01.605 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release 2023-08-21T08:55:01.662 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="CentOS Stream" 2023-08-21T08:55:01.662 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="8" 2023-08-21T08:55:01.662 INFO:teuthology.orchestra.run.smithi121.stdout:ID="centos" 2023-08-21T08:55:01.662 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE="rhel fedora" 2023-08-21T08:55:01.662 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="8" 2023-08-21T08:55:01.662 INFO:teuthology.orchestra.run.smithi121.stdout:PLATFORM_ID="platform:el8" 2023-08-21T08:55:01.663 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-21T08:55:01.663 INFO:teuthology.orchestra.run.smithi121.stdout:ANSI_COLOR="0;31" 2023-08-21T08:55:01.663 INFO:teuthology.orchestra.run.smithi121.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-21T08:55:01.663 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://centos.org/" 2023-08-21T08:55:01.663 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-21T08:55:01.663 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-21T08:55:01.663 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-21T08:55:01.664 INFO:teuthology.provision.fog.smithi121:Deploy complete! 2023-08-21T08:55:01.665 DEBUG:teuthology.parallel:result is None 2023-08-21T08:55:03.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T08:55:06.384 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-08-21T08:55:12.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T08:55:30.928 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-08-21T08:55:36.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T08:55:39.984 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-08-21T08:55:45.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T08:55:47.836 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-21T08:55:47.837 DEBUG:teuthology.orchestra.run.smithi089:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-21T08:56:13.152 INFO:teuthology.provision.fog.smithi089:Node is ready 2023-08-21T08:56:13.152 DEBUG:teuthology.orchestra.run.smithi089:> hostname 2023-08-21T08:56:13.216 INFO:teuthology.orchestra.run.smithi089.stdout:smithi089.front.sepia.ceph.com 2023-08-21T08:56:13.216 DEBUG:teuthology.orchestra.run.smithi089:> grep smithi089.front.sepia.ceph.com /etc/hosts 2023-08-21T08:56:13.277 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89 smithi089.front.sepia.ceph.com smithi089 2023-08-21T08:56:13.277 DEBUG:teuthology.orchestra.run.smithi089:> sudo hostname smithi089 2023-08-21T08:56:13.397 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i -e 's/smithi089.front.sepia.ceph.com/smithi089/g' /etc/hosts 2023-08-21T08:56:13.428 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i -e 's/172.21.15.89/172.21.15.89/g' /etc/hosts 2023-08-21T08:56:13.498 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i -e 's/smithi089.front.sepia.ceph.com/smithi089/g' /etc/hostname 2023-08-21T08:56:13.567 DEBUG:teuthology.orchestra.run.smithi089:> sudo hostname smithi089 2023-08-21T08:56:13.635 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2023-08-21T08:56:13.692 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="CentOS Stream" 2023-08-21T08:56:13.692 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="8" 2023-08-21T08:56:13.692 INFO:teuthology.orchestra.run.smithi089.stdout:ID="centos" 2023-08-21T08:56:13.693 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE="rhel fedora" 2023-08-21T08:56:13.693 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="8" 2023-08-21T08:56:13.693 INFO:teuthology.orchestra.run.smithi089.stdout:PLATFORM_ID="platform:el8" 2023-08-21T08:56:13.693 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-21T08:56:13.693 INFO:teuthology.orchestra.run.smithi089.stdout:ANSI_COLOR="0;31" 2023-08-21T08:56:13.693 INFO:teuthology.orchestra.run.smithi089.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-21T08:56:13.693 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://centos.org/" 2023-08-21T08:56:13.694 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-21T08:56:13.694 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-21T08:56:13.694 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-21T08:56:13.694 INFO:teuthology.provision.fog.smithi089:Deploy complete! 2023-08-21T08:56:13.695 DEBUG:teuthology.parallel:result is None 2023-08-21T08:56:13.828 INFO:teuthology.lock.ops:Checking smithi089.front.sepia.ceph.com 2023-08-21T08:56:13.829 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-21T08:56:13.856 INFO:teuthology.lock.ops:Checking smithi121.front.sepia.ceph.com 2023-08-21T08:56:13.856 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-21T08:56:13.873 INFO:teuthology.lock.ops:Updating [smithi089.front.sepia.ceph.com]: set os type and version on server 2023-08-21T08:56:13.874 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-08-21T08:56:13.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T08:56:13.940 DEBUG:teuthology.orchestra.run.smithi089:> true 2023-08-21T08:56:14.005 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-08-21T08:56:14.006 DEBUG:teuthology.orchestra.run.smithi089:> uname -m 2023-08-21T08:56:14.062 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64 2023-08-21T08:56:14.063 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2023-08-21T08:56:14.119 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="CentOS Stream" 2023-08-21T08:56:14.119 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="8" 2023-08-21T08:56:14.119 INFO:teuthology.orchestra.run.smithi089.stdout:ID="centos" 2023-08-21T08:56:14.119 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE="rhel fedora" 2023-08-21T08:56:14.120 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="8" 2023-08-21T08:56:14.120 INFO:teuthology.orchestra.run.smithi089.stdout:PLATFORM_ID="platform:el8" 2023-08-21T08:56:14.120 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-21T08:56:14.120 INFO:teuthology.orchestra.run.smithi089.stdout:ANSI_COLOR="0;31" 2023-08-21T08:56:14.120 INFO:teuthology.orchestra.run.smithi089.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-21T08:56:14.120 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://centos.org/" 2023-08-21T08:56:14.120 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-21T08:56:14.120 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-21T08:56:14.121 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-21T08:56:14.121 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2023-08-21T08:56:14.147 INFO:teuthology.lock.ops:Updating [smithi121.front.sepia.ceph.com]: set os type and version on server 2023-08-21T08:56:14.147 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2023-08-21T08:56:14.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T08:56:14.212 DEBUG:teuthology.orchestra.run.smithi121:> true 2023-08-21T08:56:14.346 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi121.front.sepia.ceph.com' 2023-08-21T08:56:14.346 DEBUG:teuthology.orchestra.run.smithi121:> uname -m 2023-08-21T08:56:14.404 INFO:teuthology.orchestra.run.smithi121.stdout:x86_64 2023-08-21T08:56:14.404 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release 2023-08-21T08:56:14.462 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="CentOS Stream" 2023-08-21T08:56:14.462 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="8" 2023-08-21T08:56:14.463 INFO:teuthology.orchestra.run.smithi121.stdout:ID="centos" 2023-08-21T08:56:14.463 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE="rhel fedora" 2023-08-21T08:56:14.463 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="8" 2023-08-21T08:56:14.463 INFO:teuthology.orchestra.run.smithi121.stdout:PLATFORM_ID="platform:el8" 2023-08-21T08:56:14.463 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-21T08:56:14.463 INFO:teuthology.orchestra.run.smithi121.stdout:ANSI_COLOR="0;31" 2023-08-21T08:56:14.463 INFO:teuthology.orchestra.run.smithi121.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-21T08:56:14.464 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://centos.org/" 2023-08-21T08:56:14.464 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-21T08:56:14.464 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-21T08:56:14.464 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-21T08:56:14.464 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2023-08-21T08:56:14.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T08:56:14.572 INFO:teuthology.dispatcher.supervisor:Running job 7373974 2023-08-21T08:56:14.572 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_matan@teuthology --archive /home/teuthworker/archive/matan-2023-08-21_08:48:56-crimson-rados-main-distro-crimson-smithi/7373974 --name matan-2023-08-21_08:48:56-crimson-rados-main-distro-crimson-smithi --description crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_8 crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/snaps-few-objects} -- /home/teuthworker/archive/matan-2023-08-21_08:48:56-crimson-rados-main-distro-crimson-smithi/7373974/orig.config.yaml 2023-08-21T08:56:14.575 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/matan-2023-08-21_08:48:56-crimson-rados-main-distro-crimson-smithi/7373974 2023-08-21T08:56:14.576 INFO:teuthology.dispatcher.supervisor:Job PID: 9033 2023-08-21T08:56:14.576 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-21T08:58:14.676 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:00:14.848 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:02:15.041 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:04:15.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:06:15.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:08:15.565 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:10:15.705 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:12:15.854 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:14:15.994 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:16:16.117 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:18:16.277 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:20:16.413 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:22:16.578 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:24:16.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:26:16.858 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:28:16.949 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:30:17.108 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:32:17.265 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:34:17.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:34:17.407 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-21T09:34:17.503 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-21T09:34:17.504 INFO:teuthology.nuke:Checking targets against current locks 2023-08-21T09:34:17.547 DEBUG:teuthology.nuke:shortname: smithi089 2023-08-21T09:34:17.547 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-21T09:34:17.566 DEBUG:teuthology.nuke:shortname: smithi121 2023-08-21T09:34:17.567 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-21T09:34:17.569 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-08-21_08:48:56-crimson-rados-main-distro-crimson-smithi/7373974', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-21 08:49:57.047836', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNXGtEf9g/uJmUpZBDcU1nEa87BOTVjeCv10/ExJaB8p99cQ+kMSUPyJ083Y5aOR7Fsj43dyn+j7swMHKeUNZm0='} 2023-08-21T09:34:17.589 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi121.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-08-21_08:48:56-crimson-rados-main-distro-crimson-smithi/7373974', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-21 08:49:57.046061', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDKHlnfgg0X2dWUnw7VIGLMMf6w1I9MIijzIjPEgzVH71Ag7bS8qlWBEZxe07X37W+lp34o4Ra0RDR/jjlMWat2O7aylnRmluySf5wIL5dE1HF/kfbeNCq4nOQei9szSERJ1sioIN/ymAuI8MSHRSpZVvujCxTGqkFGa9DHG5PEFzcC7eJw8PCERzAJKiyLbMPYHuaUm97ahVNdW7jkHZK4+2IE1fbcIC4O3QyaGmoxtTSRELFt0+/DplF91IfQfa3iPVL9mTJ4yeuBum6Vsm0cS76b/5qF02tNNbtNbN0HTW+w+haxw4RPOcZVIbRUet0n3wOYzdeDfFzFwgxz7rR5lUJaYQgp5653fejOXEI2tsgDBf2Wax9nInj0RzVHKwOvSEbG5tnDPzGEUiZojc9P6IFOPHJUO5lX0qr44W6nchKLeKzIP2zCMM5nYe4eAS8MHBPKHJAWOrCaPlCmTNkLmWhCtsSPABgXtd12mRnpCGhMx6yJGAjXwd/vxhf9sjc='} 2023-08-21T09:34:17.614 INFO:teuthology.orchestra.console.smithi089:Power off 2023-08-21T09:34:17.615 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-21T09:34:17.631 INFO:teuthology.orchestra.console.smithi121:Power off 2023-08-21T09:34:17.632 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-21T09:34:17.640 DEBUG:teuthology.orchestra.console.smithi089:power off output: Chassis Power Control: Down/Off 2023-08-21T09:34:17.640 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T09:34:17.650 DEBUG:teuthology.orchestra.console.smithi121:power off output: Chassis Power Control: Down/Off 2023-08-21T09:34:17.650 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T09:34:17.660 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off 2023-08-21T09:34:17.670 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is off 2023-08-21T09:34:17.761 INFO:teuthology.orchestra.console.smithi089:Power off completed 2023-08-21T09:34:17.771 INFO:teuthology.orchestra.console.smithi121:Power off completed 2023-08-21T09:34:17.907 INFO:teuthology.lock.ops:unlocked: smithi089.front.sepia.ceph.com 2023-08-21T09:34:17.914 INFO:teuthology.lock.ops:unlocked: smithi121.front.sepia.ceph.com