2023-10-19T03:49:05.538 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-19T03:49:05.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T03:49:05.678 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f50da122ee0>, signals=[15]) 2023-10-19T03:49:05.680 INFO:teuthology.lock.ops:Start node 'smithi081.front.sepia.ceph.com' reimaging 2023-10-19T03:49:05.681 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: reset os type and version on server 2023-10-19T03:49:05.681 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2023-10-19T03:49:05.707 INFO:teuthology.lock.ops:Start node 'smithi098.front.sepia.ceph.com' reimaging 2023-10-19T03:49:05.708 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: reset os type and version on server 2023-10-19T03:49:05.708 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2023-10-19T03:49:05.709 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /host {"name": "smithi081"} 2023-10-19T03:49:05.732 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /host {"name": "smithi098"} 2023-10-19T03:49:05.790 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-19T03:49:05.806 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-19T03:49:05.829 DEBUG:teuthology.provision.fog.smithi081:Requesting image smithi_centos_8.stream (ID 3) 2023-10-19T03:49:05.829 DEBUG:teuthology.provision.fog.smithi081:FOG request: PUT /host/186 {"imageID": 3} 2023-10-19T03:49:05.847 DEBUG:teuthology.provision.fog.smithi098:Requesting image smithi_centos_8.stream (ID 3) 2023-10-19T03:49:05.847 DEBUG:teuthology.provision.fog.smithi098:FOG request: PUT /host/203 {"imageID": 3} 2023-10-19T03:49:05.875 INFO:teuthology.provision.fog.smithi081:Scheduling deploy of centos 8.stream 2023-10-19T03:49:05.875 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-19T03:49:05.888 INFO:teuthology.provision.fog.smithi098:Scheduling deploy of centos 8.stream 2023-10-19T03:49:05.889 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-19T03:49:05.936 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /tasktype {"name": "deploy"} 2023-10-19T03:49:05.943 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /tasktype {"name": "deploy"} 2023-10-19T03:49:05.982 DEBUG:teuthology.provision.fog.smithi098:FOG request: POST /host/203/task {"taskTypeID": 1} 2023-10-19T03:49:05.986 DEBUG:teuthology.provision.fog.smithi081:FOG request: POST /host/186/task {"taskTypeID": 1} 2023-10-19T03:49:06.046 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-19T03:49:06.064 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-19T03:49:06.137 INFO:teuthology.orchestra.console.smithi098:Power off 2023-10-19T03:49:06.138 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-19T03:49:06.152 INFO:teuthology.orchestra.console.smithi081:Power off 2023-10-19T03:49:06.152 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-19T03:49:06.160 DEBUG:teuthology.orchestra.console.smithi098:power off output: Chassis Power Control: Down/Off 2023-10-19T03:49:06.161 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T03:49:06.173 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off 2023-10-19T03:49:06.174 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T03:49:06.183 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2023-10-19T03:49:06.195 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2023-10-19T03:49:06.285 INFO:teuthology.orchestra.console.smithi098:Power off completed 2023-10-19T03:49:06.296 INFO:teuthology.orchestra.console.smithi081:Power off completed 2023-10-19T03:49:06.386 INFO:teuthology.orchestra.console.smithi098:Power on 2023-10-19T03:49:06.387 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-19T03:49:06.398 INFO:teuthology.orchestra.console.smithi081:Power on 2023-10-19T03:49:06.399 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-19T03:49:06.408 DEBUG:teuthology.orchestra.console.smithi098:power on output: Chassis Power Control: Up/On 2023-10-19T03:49:06.410 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T03:49:06.427 DEBUG:teuthology.orchestra.console.smithi081:power on output: Chassis Power Control: Up/On 2023-10-19T03:49:06.428 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T03:49:06.437 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2023-10-19T03:49:06.449 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2023-10-19T03:49:10.438 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T03:49:10.451 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T03:49:10.548 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2023-10-19T03:49:10.561 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2023-10-19T03:49:10.662 INFO:teuthology.orchestra.console.smithi081:Power on completed 2023-10-19T03:49:10.763 INFO:teuthology.provision.fog.smithi081:Waiting for deploy to finish 2023-10-19T03:49:10.763 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-19T03:49:14.550 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T03:49:14.683 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2023-10-19T03:49:14.784 INFO:teuthology.orchestra.console.smithi098:Power on completed 2023-10-19T03:49:14.885 INFO:teuthology.provision.fog.smithi098:Waiting for deploy to finish 2023-10-19T03:49:14.885 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-19T03:49:25.838 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-19T03:49:29.950 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-19T03:49:40.914 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-19T03:49:45.019 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-19T03:49:55.986 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-19T03:50:00.090 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-19T03:50:11.060 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-19T03:50:15.158 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-19T03:50:26.138 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-19T03:50:30.247 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-19T03:50:41.214 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-19T03:50:45.342 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-19T03:50:56.309 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-19T03:51:00.414 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-19T03:51:11.378 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-19T03:51:15.486 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-19T03:51:26.450 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-19T03:51:30.562 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-19T03:51:41.522 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-19T03:51:45.642 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-19T03:51:56.614 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-19T03:51:56.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T03:52:00.718 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-19T03:52:00.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T03:52:15.226 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-10-19T03:52:19.326 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-10-19T03:52:21.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T03:52:24.282 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-10-19T03:52:25.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T03:52:28.410 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-10-19T03:52:30.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T03:52:33.342 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-10-19T03:52:34.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T03:52:37.470 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-10-19T03:52:39.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T03:52:42.430 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-10-19T03:52:43.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T03:52:46.526 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-10-19T03:52:48.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T03:52:51.514 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-10-19T03:52:52.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T03:52:57.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T03:53:52.582 WARNING:teuthology.provision.fog.smithi098:timed out 2023-10-19T03:53:57.526 WARNING:teuthology.provision.fog.smithi081:timed out 2023-10-19T03:53:58.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T03:53:58.881 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-19T03:53:58.882 DEBUG:teuthology.orchestra.run.smithi098:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-19T03:53:59.111 INFO:teuthology.provision.fog.smithi098:Node is ready 2023-10-19T03:53:59.111 DEBUG:teuthology.orchestra.run.smithi098:> hostname 2023-10-19T03:53:59.171 INFO:teuthology.orchestra.run.smithi098.stdout:smithi098.front.sepia.ceph.com 2023-10-19T03:53:59.171 DEBUG:teuthology.orchestra.run.smithi098:> grep smithi098.front.sepia.ceph.com /etc/hosts 2023-10-19T03:53:59.230 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98 smithi098.front.sepia.ceph.com smithi098 2023-10-19T03:53:59.231 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098 2023-10-19T03:53:59.324 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hosts 2023-10-19T03:53:59.353 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/172.21.15.98/172.21.15.98/g' /etc/hosts 2023-10-19T03:53:59.421 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hostname 2023-10-19T03:53:59.488 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098 2023-10-19T03:53:59.555 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2023-10-19T03:53:59.613 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream" 2023-10-19T03:53:59.613 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="8" 2023-10-19T03:53:59.613 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos" 2023-10-19T03:53:59.614 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora" 2023-10-19T03:53:59.614 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="8" 2023-10-19T03:53:59.614 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el8" 2023-10-19T03:53:59.614 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-19T03:53:59.614 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2023-10-19T03:53:59.615 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-19T03:53:59.615 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/" 2023-10-19T03:53:59.615 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-19T03:53:59.615 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-19T03:53:59.615 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-19T03:53:59.616 INFO:teuthology.provision.fog.smithi098:Deploy complete! 2023-10-19T03:53:59.617 DEBUG:teuthology.parallel:result is None 2023-10-19T03:54:03.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T03:54:03.786 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-19T03:54:03.786 DEBUG:teuthology.orchestra.run.smithi081:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-19T03:54:04.054 INFO:teuthology.provision.fog.smithi081:Node is ready 2023-10-19T03:54:04.054 DEBUG:teuthology.orchestra.run.smithi081:> hostname 2023-10-19T03:54:04.074 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081.front.sepia.ceph.com 2023-10-19T03:54:04.074 DEBUG:teuthology.orchestra.run.smithi081:> grep smithi081.front.sepia.ceph.com /etc/hosts 2023-10-19T03:54:04.134 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81 smithi081.front.sepia.ceph.com smithi081 2023-10-19T03:54:04.134 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081 2023-10-19T03:54:04.239 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081.front.sepia.ceph.com/smithi081/g' /etc/hosts 2023-10-19T03:54:04.269 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/172.21.15.81/172.21.15.81/g' /etc/hosts 2023-10-19T03:54:04.338 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081.front.sepia.ceph.com/smithi081/g' /etc/hostname 2023-10-19T03:54:04.406 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081 2023-10-19T03:54:04.473 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2023-10-19T03:54:04.531 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Stream" 2023-10-19T03:54:04.531 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8" 2023-10-19T03:54:04.532 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos" 2023-10-19T03:54:04.532 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora" 2023-10-19T03:54:04.532 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8" 2023-10-19T03:54:04.532 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8" 2023-10-19T03:54:04.532 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-19T03:54:04.533 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2023-10-19T03:54:04.533 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-19T03:54:04.533 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://centos.org/" 2023-10-19T03:54:04.533 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-19T03:54:04.533 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-19T03:54:04.534 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-19T03:54:04.534 INFO:teuthology.provision.fog.smithi081:Deploy complete! 2023-10-19T03:54:04.535 DEBUG:teuthology.parallel:result is None 2023-10-19T03:54:04.684 INFO:teuthology.lock.ops:Checking smithi081.front.sepia.ceph.com 2023-10-19T03:54:04.685 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-19T03:54:04.707 INFO:teuthology.lock.ops:Checking smithi098.front.sepia.ceph.com 2023-10-19T03:54:04.708 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-19T03:54:04.725 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: set os type and version on server 2023-10-19T03:54:04.726 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-10-19T03:54:04.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T03:54:04.794 DEBUG:teuthology.orchestra.run.smithi081:> true 2023-10-19T03:54:04.860 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-10-19T03:54:04.860 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2023-10-19T03:54:04.918 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2023-10-19T03:54:04.918 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2023-10-19T03:54:04.976 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Stream" 2023-10-19T03:54:04.976 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8" 2023-10-19T03:54:04.977 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos" 2023-10-19T03:54:04.977 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora" 2023-10-19T03:54:04.977 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8" 2023-10-19T03:54:04.977 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8" 2023-10-19T03:54:04.977 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-19T03:54:04.978 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2023-10-19T03:54:04.978 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-19T03:54:04.978 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://centos.org/" 2023-10-19T03:54:04.978 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-19T03:54:04.978 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-19T03:54:04.979 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-19T03:54:04.979 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2023-10-19T03:54:05.000 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: set os type and version on server 2023-10-19T03:54:05.000 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-10-19T03:54:05.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T03:54:05.067 DEBUG:teuthology.orchestra.run.smithi098:> true 2023-10-19T03:54:05.139 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-10-19T03:54:05.140 DEBUG:teuthology.orchestra.run.smithi098:> uname -m 2023-10-19T03:54:05.202 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2023-10-19T03:54:05.203 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2023-10-19T03:54:05.263 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream" 2023-10-19T03:54:05.263 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="8" 2023-10-19T03:54:05.264 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos" 2023-10-19T03:54:05.264 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora" 2023-10-19T03:54:05.264 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="8" 2023-10-19T03:54:05.264 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el8" 2023-10-19T03:54:05.264 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-19T03:54:05.265 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2023-10-19T03:54:05.265 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-19T03:54:05.265 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/" 2023-10-19T03:54:05.265 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-19T03:54:05.265 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-19T03:54:05.266 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-19T03:54:05.266 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2023-10-19T03:54:05.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T03:54:05.389 INFO:teuthology.dispatcher.supervisor:Running job 7432046 2023-10-19T03:54:05.389 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-10-19_02:25:06-upgrade:reef-x-main-distro-default-smithi/7432046 --name teuthology-2023-10-19_02:25:06-upgrade:reef-x-main-distro-default-smithi --description upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} -- /home/teuthworker/archive/teuthology-2023-10-19_02:25:06-upgrade:reef-x-main-distro-default-smithi/7432046/orig.config.yaml 2023-10-19T03:54:05.392 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-10-19_02:25:06-upgrade:reef-x-main-distro-default-smithi/7432046 2023-10-19T03:54:05.394 INFO:teuthology.dispatcher.supervisor:Job PID: 2611060 2023-10-19T03:54:05.395 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-19T03:56:05.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T03:58:05.665 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T04:00:05.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T04:02:06.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T04:04:06.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T04:06:06.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T04:08:06.510 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T04:10:06.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T04:10:06.750 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-19T04:10:06.882 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-19T04:10:06.882 INFO:teuthology.nuke:Checking targets against current locks 2023-10-19T04:10:06.938 DEBUG:teuthology.nuke:shortname: smithi081 2023-10-19T04:10:06.939 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-19T04:10:06.962 DEBUG:teuthology.nuke:shortname: smithi098 2023-10-19T04:10:06.962 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-19T04:10:06.966 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-19_02:25:06-upgrade:reef-x-main-distro-default-smithi/7432046', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-19 03:49:04.703303', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE90LeAk+JeAwxjFNuXGkqpMX+KzTqjjwOmrUZUF/x6VH9lluNnt+M0abtyr8VWUqQrMPVZsGz0P5ujJAoaCias='} 2023-10-19T04:10:06.991 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-19_02:25:06-upgrade:reef-x-main-distro-default-smithi/7432046', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-19 03:49:04.701898', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJRx+mRO5ZK+tYT68I798HRizGNlJxjsGeG2Z27ZTzfwq5RIMaL4m18vRhS+PtWleX8cbqm23I6q7vBisd5IqEA='} 2023-10-19T04:10:07.014 INFO:teuthology.orchestra.console.smithi081:Power off 2023-10-19T04:10:07.015 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-19T04:10:07.036 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off 2023-10-19T04:10:07.037 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T04:10:07.051 INFO:teuthology.orchestra.console.smithi098:Power off 2023-10-19T04:10:07.052 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-19T04:10:07.061 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2023-10-19T04:10:07.075 DEBUG:teuthology.orchestra.console.smithi098:power off output: Chassis Power Control: Down/Off 2023-10-19T04:10:07.075 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T04:10:07.097 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2023-10-19T04:10:07.163 INFO:teuthology.orchestra.console.smithi081:Power off completed 2023-10-19T04:10:07.199 INFO:teuthology.orchestra.console.smithi098:Power off completed 2023-10-19T04:10:07.315 INFO:teuthology.lock.ops:unlocked: smithi081.front.sepia.ceph.com 2023-10-19T04:10:07.358 INFO:teuthology.lock.ops:unlocked: smithi098.front.sepia.ceph.com