2023-10-01T07:45:42.138 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-01T07:45:42.138 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T07:45:42.278 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1c51b07f70>, signals=[15]) 2023-10-01T07:45:42.279 INFO:teuthology.lock.ops:Start node 'smithi154.front.sepia.ceph.com' reimaging 2023-10-01T07:45:42.279 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: reset os type and version on server 2023-10-01T07:45:42.279 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2023-10-01T07:45:42.301 INFO:teuthology.lock.ops:Start node 'smithi191.front.sepia.ceph.com' reimaging 2023-10-01T07:45:42.302 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: reset os type and version on server 2023-10-01T07:45:42.302 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2023-10-01T07:45:42.303 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /host {"name": "smithi154"} 2023-10-01T07:45:42.326 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /host {"name": "smithi191"} 2023-10-01T07:45:42.386 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-01T07:45:42.390 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-01T07:45:42.438 DEBUG:teuthology.provision.fog.smithi154:Requesting image smithi_centos_8.stream (ID 3) 2023-10-01T07:45:42.438 DEBUG:teuthology.provision.fog.smithi154:FOG request: PUT /host/259 {"imageID": 3} 2023-10-01T07:45:42.448 DEBUG:teuthology.provision.fog.smithi191:Requesting image smithi_centos_8.stream (ID 3) 2023-10-01T07:45:42.448 DEBUG:teuthology.provision.fog.smithi191:FOG request: PUT /host/296 {"imageID": 3} 2023-10-01T07:45:42.484 INFO:teuthology.provision.fog.smithi154:Scheduling deploy of centos 8.stream 2023-10-01T07:45:42.484 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-10-01T07:45:42.495 INFO:teuthology.provision.fog.smithi191:Scheduling deploy of centos 8.stream 2023-10-01T07:45:42.496 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-10-01T07:45:42.534 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /tasktype {"name": "deploy"} 2023-10-01T07:45:42.541 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /tasktype {"name": "deploy"} 2023-10-01T07:45:42.579 DEBUG:teuthology.provision.fog.smithi191:FOG request: POST /host/296/task {"taskTypeID": 1} 2023-10-01T07:45:42.582 DEBUG:teuthology.provision.fog.smithi154:FOG request: POST /host/259/task {"taskTypeID": 1} 2023-10-01T07:45:42.634 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-10-01T07:45:42.635 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-10-01T07:45:42.725 INFO:teuthology.orchestra.console.smithi154:Power off 2023-10-01T07:45:42.725 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-01T07:45:42.737 INFO:teuthology.orchestra.console.smithi191:Power off 2023-10-01T07:45:42.738 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-01T07:45:42.747 DEBUG:teuthology.orchestra.console.smithi154:power off output: Chassis Power Control: Down/Off 2023-10-01T07:45:42.747 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T07:45:42.760 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off 2023-10-01T07:45:42.760 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T07:45:42.768 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off 2023-10-01T07:45:42.783 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2023-10-01T07:45:42.869 INFO:teuthology.orchestra.console.smithi154:Power off completed 2023-10-01T07:45:42.884 INFO:teuthology.orchestra.console.smithi191:Power off completed 2023-10-01T07:45:42.970 INFO:teuthology.orchestra.console.smithi154:Power on 2023-10-01T07:45:42.970 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-01T07:45:42.984 INFO:teuthology.orchestra.console.smithi191:Power on 2023-10-01T07:45:42.985 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-01T07:45:42.992 DEBUG:teuthology.orchestra.console.smithi154:power on output: Chassis Power Control: Up/On 2023-10-01T07:45:42.992 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T07:45:43.006 DEBUG:teuthology.orchestra.console.smithi191:power on output: Chassis Power Control: Up/On 2023-10-01T07:45:43.007 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T07:45:43.014 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off 2023-10-01T07:45:43.026 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2023-10-01T07:45:47.019 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T07:45:47.028 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T07:45:47.128 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off 2023-10-01T07:45:47.136 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2023-10-01T07:45:47.236 INFO:teuthology.orchestra.console.smithi191:Power on completed 2023-10-01T07:45:47.337 INFO:teuthology.provision.fog.smithi191:Waiting for deploy to finish 2023-10-01T07:45:47.337 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-10-01T07:45:51.130 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T07:45:51.239 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2023-10-01T07:45:51.339 INFO:teuthology.orchestra.console.smithi154:Power on completed 2023-10-01T07:45:51.440 INFO:teuthology.provision.fog.smithi154:Waiting for deploy to finish 2023-10-01T07:45:51.440 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-10-01T07:46:02.402 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-10-01T07:46:06.501 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-10-01T07:46:17.468 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-10-01T07:46:21.569 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-10-01T07:46:32.534 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-10-01T07:46:36.627 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-10-01T07:46:47.601 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-10-01T07:46:51.682 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-10-01T07:47:02.666 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-10-01T07:47:06.738 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-10-01T07:47:17.726 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-10-01T07:47:21.798 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-10-01T07:47:32.790 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-10-01T07:47:36.855 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-10-01T07:47:47.853 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-10-01T07:47:51.916 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-10-01T07:48:02.914 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-10-01T07:48:06.968 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-10-01T07:48:17.974 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-10-01T07:48:22.022 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-10-01T07:48:33.042 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-10-01T07:48:33.101 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T07:48:36.154 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-10-01T07:48:37.072 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-10-01T07:48:37.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T07:48:40.189 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-10-01T07:48:42.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T07:48:45.210 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-10-01T07:48:46.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T07:48:49.242 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-10-01T07:48:51.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T07:48:54.266 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-10-01T07:48:55.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T07:48:58.299 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-10-01T07:49:00.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T07:49:03.322 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-10-01T07:49:04.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T07:49:07.358 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-10-01T07:49:09.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T07:49:12.378 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-10-01T07:49:13.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T07:49:16.410 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-10-01T07:49:18.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T07:49:21.434 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-10-01T07:49:22.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T07:49:25.466 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-10-01T07:49:27.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T07:49:31.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T07:50:27.496 WARNING:teuthology.provision.fog.smithi191:timed out 2023-10-01T07:50:31.506 WARNING:teuthology.provision.fog.smithi154:timed out 2023-10-01T07:50:33.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T07:50:33.796 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-01T07:50:33.797 DEBUG:teuthology.orchestra.run.smithi191:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-01T07:50:34.072 INFO:teuthology.provision.fog.smithi191:Node is ready 2023-10-01T07:50:34.072 DEBUG:teuthology.orchestra.run.smithi191:> hostname 2023-10-01T07:50:34.092 INFO:teuthology.orchestra.run.smithi191.stdout:smithi191.front.sepia.ceph.com 2023-10-01T07:50:34.092 DEBUG:teuthology.orchestra.run.smithi191:> grep smithi191.front.sepia.ceph.com /etc/hosts 2023-10-01T07:50:34.151 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.15.191 smithi191.front.sepia.ceph.com smithi191 2023-10-01T07:50:34.151 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191 2023-10-01T07:50:34.268 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hosts 2023-10-01T07:50:34.297 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/172.21.15.191/172.21.15.191/g' /etc/hosts 2023-10-01T07:50:34.365 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hostname 2023-10-01T07:50:34.436 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191 2023-10-01T07:50:34.503 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2023-10-01T07:50:34.560 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream" 2023-10-01T07:50:34.560 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="8" 2023-10-01T07:50:34.561 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos" 2023-10-01T07:50:34.561 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora" 2023-10-01T07:50:34.561 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="8" 2023-10-01T07:50:34.561 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el8" 2023-10-01T07:50:34.561 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-01T07:50:34.561 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2023-10-01T07:50:34.561 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-01T07:50:34.561 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/" 2023-10-01T07:50:34.561 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-01T07:50:34.561 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-01T07:50:34.561 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-01T07:50:34.562 INFO:teuthology.provision.fog.smithi191:Deploy complete! 2023-10-01T07:50:34.563 DEBUG:teuthology.parallel:result is None 2023-10-01T07:50:37.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T07:50:37.712 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-01T07:50:37.713 DEBUG:teuthology.orchestra.run.smithi154:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-01T07:50:37.942 INFO:teuthology.provision.fog.smithi154:Node is ready 2023-10-01T07:50:37.943 DEBUG:teuthology.orchestra.run.smithi154:> hostname 2023-10-01T07:50:38.002 INFO:teuthology.orchestra.run.smithi154.stdout:smithi154.front.sepia.ceph.com 2023-10-01T07:50:38.002 DEBUG:teuthology.orchestra.run.smithi154:> grep smithi154.front.sepia.ceph.com /etc/hosts 2023-10-01T07:50:38.061 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154 smithi154.front.sepia.ceph.com smithi154 2023-10-01T07:50:38.061 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname smithi154 2023-10-01T07:50:38.164 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/smithi154.front.sepia.ceph.com/smithi154/g' /etc/hosts 2023-10-01T07:50:38.194 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/172.21.15.154/172.21.15.154/g' /etc/hosts 2023-10-01T07:50:38.263 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/smithi154.front.sepia.ceph.com/smithi154/g' /etc/hostname 2023-10-01T07:50:38.331 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname smithi154 2023-10-01T07:50:38.398 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2023-10-01T07:50:38.456 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream" 2023-10-01T07:50:38.456 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="8" 2023-10-01T07:50:38.456 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos" 2023-10-01T07:50:38.456 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora" 2023-10-01T07:50:38.456 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="8" 2023-10-01T07:50:38.456 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el8" 2023-10-01T07:50:38.456 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-01T07:50:38.457 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2023-10-01T07:50:38.457 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-01T07:50:38.457 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/" 2023-10-01T07:50:38.457 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-01T07:50:38.457 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-01T07:50:38.457 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-01T07:50:38.457 INFO:teuthology.provision.fog.smithi154:Deploy complete! 2023-10-01T07:50:38.458 DEBUG:teuthology.parallel:result is None 2023-10-01T07:50:38.603 INFO:teuthology.lock.ops:Checking smithi154.front.sepia.ceph.com 2023-10-01T07:50:38.603 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-01T07:50:38.625 INFO:teuthology.lock.ops:Checking smithi191.front.sepia.ceph.com 2023-10-01T07:50:38.625 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-01T07:50:38.641 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: set os type and version on server 2023-10-01T07:50:38.641 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-10-01T07:50:38.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T07:50:38.705 DEBUG:teuthology.orchestra.run.smithi154:> true 2023-10-01T07:50:38.771 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-10-01T07:50:38.771 DEBUG:teuthology.orchestra.run.smithi154:> uname -m 2023-10-01T07:50:38.829 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2023-10-01T07:50:38.829 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2023-10-01T07:50:38.887 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream" 2023-10-01T07:50:38.887 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="8" 2023-10-01T07:50:38.887 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos" 2023-10-01T07:50:38.887 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora" 2023-10-01T07:50:38.887 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="8" 2023-10-01T07:50:38.887 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el8" 2023-10-01T07:50:38.887 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-01T07:50:38.888 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2023-10-01T07:50:38.888 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-01T07:50:38.888 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/" 2023-10-01T07:50:38.888 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-01T07:50:38.888 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-01T07:50:38.888 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-01T07:50:38.889 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2023-10-01T07:50:38.923 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: set os type and version on server 2023-10-01T07:50:38.923 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-10-01T07:50:38.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-01T07:50:38.994 DEBUG:teuthology.orchestra.run.smithi191:> true 2023-10-01T07:50:39.071 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-10-01T07:50:39.072 DEBUG:teuthology.orchestra.run.smithi191:> uname -m 2023-10-01T07:50:39.132 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64 2023-10-01T07:50:39.132 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2023-10-01T07:50:39.192 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream" 2023-10-01T07:50:39.192 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="8" 2023-10-01T07:50:39.192 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos" 2023-10-01T07:50:39.192 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora" 2023-10-01T07:50:39.192 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="8" 2023-10-01T07:50:39.192 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el8" 2023-10-01T07:50:39.192 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-01T07:50:39.193 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2023-10-01T07:50:39.193 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-01T07:50:39.193 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/" 2023-10-01T07:50:39.193 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-01T07:50:39.193 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-01T07:50:39.193 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-01T07:50:39.193 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2023-10-01T07:50:39.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T07:50:39.304 INFO:teuthology.dispatcher.supervisor:Running job 7407925 2023-10-01T07:50:39.305 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-09-30_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7407925 --name teuthology-2023-09-30_14:23:11-upgrade:quincy-x-reef-distro-default-smithi --description upgrade:quincy-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} -- /home/teuthworker/archive/teuthology-2023-09-30_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7407925/orig.config.yaml 2023-10-01T07:50:39.307 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-09-30_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7407925 2023-10-01T07:50:39.308 INFO:teuthology.dispatcher.supervisor:Job PID: 745202 2023-10-01T07:50:39.308 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-01T07:52:39.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T07:54:39.570 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T07:56:39.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T07:58:39.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:00:40.061 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:02:40.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:04:40.386 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:06:41.069 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:08:41.236 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:10:41.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:12:41.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:14:41.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:16:41.932 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:18:42.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:20:42.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:22:42.434 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:24:42.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:26:42.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:28:42.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:30:44.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:32:44.427 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:34:44.649 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:36:44.813 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:38:44.998 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:40:45.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:42:45.357 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:44:45.528 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:46:45.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:48:45.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:50:46.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:52:46.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:54:46.399 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:56:46.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T08:58:46.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T09:00:46.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T09:02:46.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T09:02:47.054 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-10-01T09:02:47.269 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-01T09:02:47.270 INFO:teuthology.nuke:Checking targets against current locks 2023-10-01T09:02:47.317 DEBUG:teuthology.nuke:shortname: smithi154 2023-10-01T09:02:47.318 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-01T09:02:47.339 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-09-30_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7407925', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-01 07:45:41.310306', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGYYcimwfId+Kps5zmM1VqMtBQvmhZeM0KB9nPZXs6ynE0wTdakEfllfUgkljomdVfcewnfna8oa2id+XL40XK0='} 2023-10-01T09:02:47.342 DEBUG:teuthology.nuke:shortname: smithi191 2023-10-01T09:02:47.342 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-01T09:02:47.366 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-09-30_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7407925', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-01 07:45:41.308319', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHUHGpXE3uIuDtBEMdtMExDk5MHfEDGsfU+kXRAfyWUuXYzbNOyTLvRy6pfVIm2nIrF8ITAqHHxIOhuvR7Ha8to='} 2023-10-01T09:02:47.397 INFO:teuthology.orchestra.console.smithi154:Power off 2023-10-01T09:02:47.398 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-01T09:02:47.420 DEBUG:teuthology.orchestra.console.smithi154:power off output: Chassis Power Control: Down/Off 2023-10-01T09:02:47.420 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T09:02:47.433 INFO:teuthology.orchestra.console.smithi191:Power off 2023-10-01T09:02:47.433 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-01T09:02:47.442 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off 2023-10-01T09:02:47.453 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off 2023-10-01T09:02:47.453 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T09:02:47.477 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2023-10-01T09:02:47.543 INFO:teuthology.orchestra.console.smithi154:Power off completed 2023-10-01T09:02:47.578 INFO:teuthology.orchestra.console.smithi191:Power off completed 2023-10-01T09:02:47.694 INFO:teuthology.lock.ops:unlocked: smithi154.front.sepia.ceph.com 2023-10-01T09:02:47.729 INFO:teuthology.lock.ops:unlocked: smithi191.front.sepia.ceph.com