2023-10-20T12:44:16.807 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-20T12:44:16.808 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:44:16.941 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f26344e9ee0>, signals=[15]) 2023-10-20T12:44:16.943 INFO:teuthology.lock.ops:Start node 'smithi148.front.sepia.ceph.com' reimaging 2023-10-20T12:44:16.944 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: reset os type and version on server 2023-10-20T12:44:16.944 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2023-10-20T12:44:16.966 INFO:teuthology.lock.ops:Start node 'smithi169.front.sepia.ceph.com' reimaging 2023-10-20T12:44:16.967 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: reset os type and version on server 2023-10-20T12:44:16.967 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2023-10-20T12:44:16.968 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /host {"name": "smithi148"} 2023-10-20T12:44:16.991 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /host {"name": "smithi169"} 2023-10-20T12:44:17.040 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-20T12:44:17.056 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-20T12:44:17.079 DEBUG:teuthology.provision.fog.smithi148:Requesting image smithi_centos_8.stream (ID 3) 2023-10-20T12:44:17.080 DEBUG:teuthology.provision.fog.smithi148:FOG request: PUT /host/253 {"imageID": 3} 2023-10-20T12:44:17.098 DEBUG:teuthology.provision.fog.smithi169:Requesting image smithi_centos_8.stream (ID 3) 2023-10-20T12:44:17.099 DEBUG:teuthology.provision.fog.smithi169:FOG request: PUT /host/274 {"imageID": 3} 2023-10-20T12:44:17.140 INFO:teuthology.provision.fog.smithi148:Scheduling deploy of centos 8.stream 2023-10-20T12:44:17.141 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-20T12:44:17.144 INFO:teuthology.provision.fog.smithi169:Scheduling deploy of centos 8.stream 2023-10-20T12:44:17.145 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-20T12:44:17.197 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /tasktype {"name": "deploy"} 2023-10-20T12:44:17.201 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /tasktype {"name": "deploy"} 2023-10-20T12:44:17.239 DEBUG:teuthology.provision.fog.smithi148:FOG request: POST /host/253/task {"taskTypeID": 1} 2023-10-20T12:44:17.244 DEBUG:teuthology.provision.fog.smithi169:FOG request: POST /host/274/task {"taskTypeID": 1} 2023-10-20T12:44:17.293 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-20T12:44:17.392 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-20T12:44:17.440 INFO:teuthology.orchestra.console.smithi148:Power off 2023-10-20T12:44:17.441 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-20T12:44:17.465 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off 2023-10-20T12:44:17.466 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:44:17.480 INFO:teuthology.orchestra.console.smithi169:Power off 2023-10-20T12:44:17.481 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-20T12:44:17.490 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2023-10-20T12:44:17.503 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off 2023-10-20T12:44:17.504 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:44:17.527 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2023-10-20T12:44:21.494 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:44:21.528 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:44:21.604 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2023-10-20T12:44:21.639 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2023-10-20T12:44:25.608 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:44:25.641 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:44:25.718 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2023-10-20T12:44:25.750 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-10-20T12:44:25.851 INFO:teuthology.orchestra.console.smithi169:Power off completed 2023-10-20T12:44:25.953 INFO:teuthology.orchestra.console.smithi169:Power on 2023-10-20T12:44:25.954 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-20T12:44:25.975 DEBUG:teuthology.orchestra.console.smithi169:power on output: Chassis Power Control: Up/On 2023-10-20T12:44:25.976 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:44:25.998 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-10-20T12:44:29.722 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:44:29.831 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2023-10-20T12:44:29.932 INFO:teuthology.orchestra.console.smithi148:Power off completed 2023-10-20T12:44:29.999 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:44:30.033 INFO:teuthology.orchestra.console.smithi148:Power on 2023-10-20T12:44:30.034 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-20T12:44:30.057 DEBUG:teuthology.orchestra.console.smithi148:power on output: Chassis Power Control: Up/On 2023-10-20T12:44:30.058 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:44:30.081 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2023-10-20T12:44:30.108 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-10-20T12:44:34.086 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:44:34.109 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T12:44:34.195 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2023-10-20T12:44:34.220 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2023-10-20T12:44:34.297 INFO:teuthology.orchestra.console.smithi148:Power on completed 2023-10-20T12:44:34.322 INFO:teuthology.orchestra.console.smithi169:Power on completed 2023-10-20T12:44:34.398 INFO:teuthology.provision.fog.smithi148:Waiting for deploy to finish 2023-10-20T12:44:34.399 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-20T12:44:34.495 INFO:teuthology.provision.fog.smithi169:Waiting for deploy to finish 2023-10-20T12:44:34.495 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-20T12:44:49.479 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-20T12:44:49.554 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-20T12:45:04.558 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-20T12:45:04.617 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-20T12:45:19.640 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-20T12:45:19.685 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-20T12:45:34.730 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-20T12:45:34.743 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-20T12:45:49.822 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-20T12:45:49.824 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-20T12:46:04.902 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-20T12:46:04.904 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-20T12:46:19.986 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-20T12:46:19.988 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-20T12:46:35.066 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-20T12:46:35.068 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-20T12:46:50.154 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-20T12:46:50.156 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-20T12:47:05.254 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-20T12:47:05.256 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-20T12:47:20.326 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-20T12:47:20.328 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-20T12:47:20.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:47:20.393 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:47:38.875 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-10-20T12:47:38.876 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-10-20T12:47:44.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:47:44.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:47:47.966 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-10-20T12:47:47.967 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-10-20T12:47:53.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:47:53.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:47:57.050 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-10-20T12:47:57.051 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-10-20T12:48:03.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:48:03.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:48:06.106 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-10-20T12:48:06.107 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-10-20T12:48:12.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:48:12.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:48:15.162 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-10-20T12:48:15.163 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-10-20T12:48:21.169 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:48:21.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:48:24.250 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-10-20T12:48:24.251 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-10-20T12:48:30.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:48:30.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:48:48.766 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-10-20T12:48:54.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:48:57.850 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-10-20T12:49:03.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:49:05.308 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-20T12:49:05.309 DEBUG:teuthology.orchestra.run.smithi148:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-20T12:49:30.149 INFO:teuthology.provision.fog.smithi148:Node is ready 2023-10-20T12:49:30.150 DEBUG:teuthology.orchestra.run.smithi148:> hostname 2023-10-20T12:49:30.175 INFO:teuthology.orchestra.run.smithi148.stdout:smithi148.front.sepia.ceph.com 2023-10-20T12:49:30.175 DEBUG:teuthology.orchestra.run.smithi148:> grep smithi148.front.sepia.ceph.com /etc/hosts 2023-10-20T12:49:30.235 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148 smithi148.front.sepia.ceph.com smithi148 2023-10-20T12:49:30.236 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148 2023-10-20T12:49:30.258 WARNING:teuthology.provision.fog.smithi169:timed out 2023-10-20T12:49:30.355 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148.front.sepia.ceph.com/smithi148/g' /etc/hosts 2023-10-20T12:49:30.386 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/172.21.15.148/172.21.15.148/g' /etc/hosts 2023-10-20T12:49:30.456 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148.front.sepia.ceph.com/smithi148/g' /etc/hostname 2023-10-20T12:49:30.524 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148 2023-10-20T12:49:30.593 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2023-10-20T12:49:30.651 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="CentOS Stream" 2023-10-20T12:49:30.651 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="8" 2023-10-20T12:49:30.651 INFO:teuthology.orchestra.run.smithi148.stdout:ID="centos" 2023-10-20T12:49:30.651 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="rhel fedora" 2023-10-20T12:49:30.652 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="8" 2023-10-20T12:49:30.652 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el8" 2023-10-20T12:49:30.652 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-20T12:49:30.652 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31" 2023-10-20T12:49:30.653 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-20T12:49:30.653 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://centos.org/" 2023-10-20T12:49:30.653 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-20T12:49:30.654 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-20T12:49:30.654 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-20T12:49:30.655 INFO:teuthology.provision.fog.smithi148:Deploy complete! 2023-10-20T12:49:30.656 DEBUG:teuthology.parallel:result is None 2023-10-20T12:49:36.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:49:36.496 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-20T12:49:36.497 DEBUG:teuthology.orchestra.run.smithi169:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-20T12:49:36.764 INFO:teuthology.provision.fog.smithi169:Node is ready 2023-10-20T12:49:36.764 DEBUG:teuthology.orchestra.run.smithi169:> hostname 2023-10-20T12:49:36.785 INFO:teuthology.orchestra.run.smithi169.stdout:smithi169.front.sepia.ceph.com 2023-10-20T12:49:36.785 DEBUG:teuthology.orchestra.run.smithi169:> grep smithi169.front.sepia.ceph.com /etc/hosts 2023-10-20T12:49:36.844 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.15.169 smithi169.front.sepia.ceph.com smithi169 2023-10-20T12:49:36.845 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2023-10-20T12:49:36.944 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hosts 2023-10-20T12:49:36.974 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/172.21.15.169/172.21.15.169/g' /etc/hosts 2023-10-20T12:49:37.043 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hostname 2023-10-20T12:49:37.112 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2023-10-20T12:49:37.179 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2023-10-20T12:49:37.237 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream" 2023-10-20T12:49:37.238 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="8" 2023-10-20T12:49:37.238 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos" 2023-10-20T12:49:37.238 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora" 2023-10-20T12:49:37.238 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="8" 2023-10-20T12:49:37.238 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el8" 2023-10-20T12:49:37.239 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-20T12:49:37.239 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2023-10-20T12:49:37.239 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-20T12:49:37.239 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/" 2023-10-20T12:49:37.239 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-20T12:49:37.239 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-20T12:49:37.240 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-20T12:49:37.240 INFO:teuthology.provision.fog.smithi169:Deploy complete! 2023-10-20T12:49:37.241 DEBUG:teuthology.parallel:result is None 2023-10-20T12:49:37.417 INFO:teuthology.lock.ops:Checking smithi148.front.sepia.ceph.com 2023-10-20T12:49:37.418 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-20T12:49:37.443 INFO:teuthology.lock.ops:Checking smithi169.front.sepia.ceph.com 2023-10-20T12:49:37.443 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-20T12:49:37.460 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: set os type and version on server 2023-10-20T12:49:37.461 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-10-20T12:49:37.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:49:37.529 DEBUG:teuthology.orchestra.run.smithi148:> true 2023-10-20T12:49:37.599 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-10-20T12:49:37.599 DEBUG:teuthology.orchestra.run.smithi148:> uname -m 2023-10-20T12:49:37.659 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64 2023-10-20T12:49:37.660 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2023-10-20T12:49:37.719 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="CentOS Stream" 2023-10-20T12:49:37.720 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="8" 2023-10-20T12:49:37.720 INFO:teuthology.orchestra.run.smithi148.stdout:ID="centos" 2023-10-20T12:49:37.720 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="rhel fedora" 2023-10-20T12:49:37.720 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="8" 2023-10-20T12:49:37.720 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el8" 2023-10-20T12:49:37.720 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-20T12:49:37.721 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31" 2023-10-20T12:49:37.721 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-20T12:49:37.721 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://centos.org/" 2023-10-20T12:49:37.721 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-20T12:49:37.721 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-20T12:49:37.722 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-20T12:49:37.722 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2023-10-20T12:49:37.742 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: set os type and version on server 2023-10-20T12:49:37.743 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-10-20T12:49:37.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T12:49:37.810 DEBUG:teuthology.orchestra.run.smithi169:> true 2023-10-20T12:49:37.876 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-10-20T12:49:37.877 DEBUG:teuthology.orchestra.run.smithi169:> uname -m 2023-10-20T12:49:37.935 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64 2023-10-20T12:49:37.935 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2023-10-20T12:49:37.992 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream" 2023-10-20T12:49:37.993 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="8" 2023-10-20T12:49:37.993 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos" 2023-10-20T12:49:37.993 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora" 2023-10-20T12:49:37.993 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="8" 2023-10-20T12:49:37.994 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el8" 2023-10-20T12:49:37.994 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-20T12:49:37.994 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2023-10-20T12:49:37.994 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-20T12:49:37.994 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/" 2023-10-20T12:49:37.995 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-20T12:49:37.995 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-20T12:49:37.995 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-20T12:49:37.995 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2023-10-20T12:49:38.018 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:49:38.103 INFO:teuthology.dispatcher.supervisor:Running job 7427608 2023-10-20T12:49:38.104 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7427608 --name teuthology-2023-10-14_14:23:11-upgrade:pacific-x-reef-distro-default-smithi --description upgrade:pacific-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} -- /home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7427608/orig.config.yaml 2023-10-20T12:49:38.107 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7427608 2023-10-20T12:49:38.107 INFO:teuthology.dispatcher.supervisor:Job PID: 1979511 2023-10-20T12:49:38.108 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-20T12:51:38.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:53:38.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:55:38.529 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:57:38.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T12:59:38.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:01:39.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:03:39.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:05:39.373 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:07:39.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:09:39.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:11:39.876 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:13:40.105 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:15:40.278 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:17:40.444 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:19:40.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:21:40.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:23:40.942 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:25:41.110 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:27:41.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:29:41.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:31:41.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:33:41.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:35:41.956 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:37:42.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:39:42.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:41:42.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:43:42.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:45:42.974 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:47:43.141 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:49:43.321 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:51:43.496 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:53:43.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:55:43.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:57:43.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T13:59:44.164 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T14:01:44.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T14:03:44.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T14:05:44.661 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T14:07:44.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T14:09:45.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T14:11:45.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T14:11:45.230 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-20T14:11:45.403 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-20T14:11:45.403 INFO:teuthology.nuke:Checking targets against current locks 2023-10-20T14:11:45.448 DEBUG:teuthology.nuke:shortname: smithi148 2023-10-20T14:11:45.448 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-20T14:11:45.470 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7427608', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-20 12:44:15.984292', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJcO4MScARHlY5H7fkV0PfCTnbLjKvPD2TyQPI1r3fqYHOPT/dExkR61/ox1kzEtkf3D/fIwOln8OeWdpQkLJrU='} 2023-10-20T14:11:45.474 DEBUG:teuthology.nuke:shortname: smithi169 2023-10-20T14:11:45.475 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-20T14:11:45.495 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7427608', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-20 12:44:15.981914', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOyJGoSmRy3QNY+LP2OfV0fjx8o+QQ+SlxQTSIXENU7cRAgPbbw0OfJ4QC0+Bb9wOlsEz1jtSSv7NyMLm8jcFx4='} 2023-10-20T14:11:45.526 INFO:teuthology.orchestra.console.smithi148:Power off 2023-10-20T14:11:45.527 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-20T14:11:45.549 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off 2023-10-20T14:11:45.549 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T14:11:45.564 INFO:teuthology.orchestra.console.smithi169:Power off 2023-10-20T14:11:45.564 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-20T14:11:45.575 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2023-10-20T14:11:45.589 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off 2023-10-20T14:11:45.590 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T14:11:45.612 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-10-20T14:11:45.676 INFO:teuthology.orchestra.console.smithi148:Power off completed 2023-10-20T14:11:45.713 INFO:teuthology.orchestra.console.smithi169:Power off completed 2023-10-20T14:11:45.820 INFO:teuthology.lock.ops:unlocked: smithi148.front.sepia.ceph.com 2023-10-20T14:11:45.861 INFO:teuthology.lock.ops:unlocked: smithi169.front.sepia.ceph.com