2023-10-27T14:44:46.133 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-10-27T14:44:46.136 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-27T14:44:46.300 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5dd76f4c10>, signals=[15]) 2023-10-27T14:44:46.301 INFO:teuthology.lock.ops:Start node 'smithi062.front.sepia.ceph.com' reimaging 2023-10-27T14:44:46.302 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: reset os type and version on server 2023-10-27T14:44:46.302 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2023-10-27T14:44:46.324 INFO:teuthology.lock.ops:Start node 'smithi192.front.sepia.ceph.com' reimaging 2023-10-27T14:44:46.325 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: reset os type and version on server 2023-10-27T14:44:46.325 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2023-10-27T14:44:46.326 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /host {"name": "smithi062"} 2023-10-27T14:44:46.349 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /host {"name": "smithi192"} 2023-10-27T14:44:46.393 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-10-27T14:44:46.416 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-10-27T14:44:46.432 DEBUG:teuthology.provision.fog.smithi062:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-10-27T14:44:46.432 DEBUG:teuthology.provision.fog.smithi062:FOG request: PUT /host/167 {"imageID": 6} 2023-10-27T14:44:46.456 DEBUG:teuthology.provision.fog.smithi192:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-10-27T14:44:46.456 DEBUG:teuthology.provision.fog.smithi192:FOG request: PUT /host/297 {"imageID": 6} 2023-10-27T14:44:46.480 INFO:teuthology.provision.fog.smithi062:Scheduling deploy of ubuntu 22.04 2023-10-27T14:44:46.481 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-10-27T14:44:46.509 INFO:teuthology.provision.fog.smithi192:Scheduling deploy of ubuntu 22.04 2023-10-27T14:44:46.510 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-27T14:44:46.527 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /tasktype {"name": "deploy"} 2023-10-27T14:44:46.558 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /tasktype {"name": "deploy"} 2023-10-27T14:44:46.571 DEBUG:teuthology.provision.fog.smithi062:FOG request: POST /host/167/task {"taskTypeID": 1} 2023-10-27T14:44:46.609 DEBUG:teuthology.provision.fog.smithi192:FOG request: POST /host/297/task {"taskTypeID": 1} 2023-10-27T14:44:46.634 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-10-27T14:44:46.657 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-27T14:44:46.718 INFO:teuthology.orchestra.console.smithi062:Power off 2023-10-27T14:44:46.719 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-27T14:44:46.746 DEBUG:teuthology.orchestra.console.smithi062:power off output: Chassis Power Control: Down/Off 2023-10-27T14:44:46.747 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-27T14:44:46.763 INFO:teuthology.orchestra.console.smithi192:Power off 2023-10-27T14:44:46.764 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-27T14:44:46.771 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on 2023-10-27T14:44:46.787 DEBUG:teuthology.orchestra.console.smithi192:power off output: Chassis Power Control: Down/Off 2023-10-27T14:44:46.788 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-27T14:44:46.811 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2023-10-27T14:44:50.774 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-27T14:44:50.812 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-27T14:44:50.883 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on 2023-10-27T14:44:50.921 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2023-10-27T14:44:54.886 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-27T14:44:54.922 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-27T14:44:54.995 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off 2023-10-27T14:44:55.031 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2023-10-27T14:44:55.096 INFO:teuthology.orchestra.console.smithi062:Power off completed 2023-10-27T14:44:55.197 INFO:teuthology.orchestra.console.smithi062:Power on 2023-10-27T14:44:55.197 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-27T14:44:55.219 DEBUG:teuthology.orchestra.console.smithi062:power on output: Chassis Power Control: Up/On 2023-10-27T14:44:55.220 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-27T14:44:55.241 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off 2023-10-27T14:44:59.034 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-27T14:44:59.143 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2023-10-27T14:44:59.243 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-27T14:44:59.250 INFO:teuthology.orchestra.console.smithi192:Power off completed 2023-10-27T14:44:59.351 INFO:teuthology.orchestra.console.smithi192:Power on 2023-10-27T14:44:59.352 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-27T14:44:59.359 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off 2023-10-27T14:44:59.375 DEBUG:teuthology.orchestra.console.smithi192:power on output: Chassis Power Control: Up/On 2023-10-27T14:44:59.376 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-27T14:44:59.398 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2023-10-27T14:45:03.362 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-27T14:45:03.400 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-27T14:45:03.472 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on 2023-10-27T14:45:03.508 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2023-10-27T14:45:03.573 INFO:teuthology.orchestra.console.smithi062:Power on completed 2023-10-27T14:45:03.610 INFO:teuthology.orchestra.console.smithi192:Power on completed 2023-10-27T14:45:03.675 INFO:teuthology.provision.fog.smithi062:Waiting for deploy to finish 2023-10-27T14:45:03.675 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-10-27T14:45:03.711 INFO:teuthology.provision.fog.smithi192:Waiting for deploy to finish 2023-10-27T14:45:03.711 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-27T14:45:18.750 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-10-27T14:45:18.774 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-27T14:45:33.838 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-10-27T14:45:33.840 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-27T14:45:48.922 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-10-27T14:45:48.924 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-27T14:46:03.999 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-27T14:46:04.001 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-10-27T14:46:19.063 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-10-27T14:46:19.067 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-27T14:46:34.146 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-27T14:46:34.148 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-10-27T14:46:49.230 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-27T14:46:49.231 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-10-27T14:47:04.326 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-27T14:47:04.328 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-10-27T14:47:19.420 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-27T14:47:19.421 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-10-27T14:47:34.514 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-10-27T14:47:34.516 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-27T14:47:49.602 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-27T14:47:49.604 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-10-27T14:48:04.698 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-10-27T14:48:04.700 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-27T14:48:19.786 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-10-27T14:48:19.788 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-27T14:48:19.858 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-27T14:48:19.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-27T14:48:38.270 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-10-27T14:48:38.272 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-10-27T14:48:44.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-27T14:48:44.281 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-27T14:48:47.354 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-10-27T14:48:47.355 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-10-27T14:48:53.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-27T14:48:53.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-27T14:48:56.410 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-10-27T14:48:56.446 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-10-27T14:49:02.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-27T14:49:02.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-27T14:49:05.498 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-10-27T14:49:05.499 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-10-27T14:49:11.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-27T14:49:11.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-27T14:49:43.039 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-10-27T14:49:49.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-27T14:49:49.048 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-10-27T14:49:55.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-27T14:49:55.057 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-10-27T14:50:01.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-27T14:50:01.065 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-10-27T14:50:07.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-27T14:50:07.073 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-10-27T14:50:11.512 WARNING:teuthology.provision.fog.smithi062:timed out 2023-10-27T14:50:13.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-27T14:50:13.344 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-27T14:50:13.345 DEBUG:teuthology.orchestra.run.smithi192:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-27T14:50:13.973 INFO:teuthology.provision.fog.smithi192:Node is ready 2023-10-27T14:50:13.973 DEBUG:teuthology.orchestra.run.smithi192:> hostname 2023-10-27T14:50:14.021 INFO:teuthology.orchestra.run.smithi192.stdout:smithi192.front.sepia.ceph.com 2023-10-27T14:50:14.021 DEBUG:teuthology.orchestra.run.smithi192:> grep smithi192.front.sepia.ceph.com /etc/hosts 2023-10-27T14:50:14.069 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.15.192 smithi192.front.sepia.ceph.com smithi192 2023-10-27T14:50:14.070 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192 2023-10-27T14:50:14.203 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hosts 2023-10-27T14:50:14.217 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/172.21.15.192/172.21.15.192/g' /etc/hosts 2023-10-27T14:50:14.273 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hostname 2023-10-27T14:50:14.329 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192 2023-10-27T14:50:14.384 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2023-10-27T14:50:14.433 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-27T14:50:14.433 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="Ubuntu" 2023-10-27T14:50:14.434 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="22.04" 2023-10-27T14:50:14.434 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-27T14:50:14.434 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_CODENAME=jammy 2023-10-27T14:50:14.434 INFO:teuthology.orchestra.run.smithi192.stdout:ID=ubuntu 2023-10-27T14:50:14.434 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE=debian 2023-10-27T14:50:14.435 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-27T14:50:14.435 INFO:teuthology.orchestra.run.smithi192.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-27T14:50:14.435 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-27T14:50:14.435 INFO:teuthology.orchestra.run.smithi192.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-27T14:50:14.435 INFO:teuthology.orchestra.run.smithi192.stdout:UBUNTU_CODENAME=jammy 2023-10-27T14:50:14.436 INFO:teuthology.provision.fog.smithi192:Deploy complete! 2023-10-27T14:50:14.437 DEBUG:teuthology.parallel:result is None 2023-10-27T14:50:17.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-27T14:50:17.714 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-27T14:50:17.715 DEBUG:teuthology.orchestra.run.smithi062:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-27T14:50:18.127 INFO:teuthology.provision.fog.smithi062:Node is ready 2023-10-27T14:50:18.127 DEBUG:teuthology.orchestra.run.smithi062:> hostname 2023-10-27T14:50:18.177 INFO:teuthology.orchestra.run.smithi062.stdout:smithi062.front.sepia.ceph.com 2023-10-27T14:50:18.178 DEBUG:teuthology.orchestra.run.smithi062:> grep smithi062.front.sepia.ceph.com /etc/hosts 2023-10-27T14:50:18.224 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62 smithi062.front.sepia.ceph.com smithi062 2023-10-27T14:50:18.225 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062 2023-10-27T14:50:18.390 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi062.front.sepia.ceph.com/smithi062/g' /etc/hosts 2023-10-27T14:50:18.405 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/172.21.15.62/172.21.15.62/g' /etc/hosts 2023-10-27T14:50:18.461 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi062.front.sepia.ceph.com/smithi062/g' /etc/hostname 2023-10-27T14:50:18.516 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062 2023-10-27T14:50:18.572 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2023-10-27T14:50:18.624 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-27T14:50:18.625 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="Ubuntu" 2023-10-27T14:50:18.625 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="22.04" 2023-10-27T14:50:18.625 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-27T14:50:18.625 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_CODENAME=jammy 2023-10-27T14:50:18.626 INFO:teuthology.orchestra.run.smithi062.stdout:ID=ubuntu 2023-10-27T14:50:18.626 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE=debian 2023-10-27T14:50:18.626 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-27T14:50:18.626 INFO:teuthology.orchestra.run.smithi062.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-27T14:50:18.626 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-27T14:50:18.627 INFO:teuthology.orchestra.run.smithi062.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-27T14:50:18.627 INFO:teuthology.orchestra.run.smithi062.stdout:UBUNTU_CODENAME=jammy 2023-10-27T14:50:18.627 INFO:teuthology.provision.fog.smithi062:Deploy complete! 2023-10-27T14:50:18.628 DEBUG:teuthology.parallel:result is None 2023-10-27T14:50:18.812 INFO:teuthology.lock.ops:Checking smithi062.front.sepia.ceph.com 2023-10-27T14:50:18.813 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-27T14:50:18.831 INFO:teuthology.lock.ops:Checking smithi192.front.sepia.ceph.com 2023-10-27T14:50:18.832 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-27T14:50:18.858 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: set os type and version on server 2023-10-27T14:50:18.859 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2023-10-27T14:50:18.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-27T14:50:18.937 DEBUG:teuthology.orchestra.run.smithi062:> true 2023-10-27T14:50:19.022 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2023-10-27T14:50:19.022 DEBUG:teuthology.orchestra.run.smithi062:> uname -m 2023-10-27T14:50:19.068 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2023-10-27T14:50:19.068 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2023-10-27T14:50:19.115 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-27T14:50:19.116 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="Ubuntu" 2023-10-27T14:50:19.116 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="22.04" 2023-10-27T14:50:19.116 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-27T14:50:19.116 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_CODENAME=jammy 2023-10-27T14:50:19.116 INFO:teuthology.orchestra.run.smithi062.stdout:ID=ubuntu 2023-10-27T14:50:19.117 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE=debian 2023-10-27T14:50:19.117 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-27T14:50:19.117 INFO:teuthology.orchestra.run.smithi062.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-27T14:50:19.117 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-27T14:50:19.117 INFO:teuthology.orchestra.run.smithi062.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-27T14:50:19.118 INFO:teuthology.orchestra.run.smithi062.stdout:UBUNTU_CODENAME=jammy 2023-10-27T14:50:19.118 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2023-10-27T14:50:19.140 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: set os type and version on server 2023-10-27T14:50:19.140 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-10-27T14:50:19.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-27T14:50:19.214 DEBUG:teuthology.orchestra.run.smithi192:> true 2023-10-27T14:50:19.314 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-10-27T14:50:19.315 DEBUG:teuthology.orchestra.run.smithi192:> uname -m 2023-10-27T14:50:19.361 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64 2023-10-27T14:50:19.361 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2023-10-27T14:50:19.413 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-27T14:50:19.413 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="Ubuntu" 2023-10-27T14:50:19.414 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="22.04" 2023-10-27T14:50:19.414 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-27T14:50:19.414 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_CODENAME=jammy 2023-10-27T14:50:19.414 INFO:teuthology.orchestra.run.smithi192.stdout:ID=ubuntu 2023-10-27T14:50:19.414 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE=debian 2023-10-27T14:50:19.415 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-27T14:50:19.415 INFO:teuthology.orchestra.run.smithi192.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-27T14:50:19.415 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-27T14:50:19.415 INFO:teuthology.orchestra.run.smithi192.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-27T14:50:19.415 INFO:teuthology.orchestra.run.smithi192.stdout:UBUNTU_CODENAME=jammy 2023-10-27T14:50:19.416 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2023-10-27T14:50:19.440 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-27T14:50:19.532 INFO:teuthology.dispatcher.supervisor:Running job 7438912 2023-10-27T14:50:19.532 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-10-27_14:22:11-upgrade:octopus-x-quincy-distro-default-smithi/7438912 --name teuthology-2023-10-27_14:22:11-upgrade:octopus-x-quincy-distro-default-smithi --description upgrade:octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/primary} -- /home/teuthworker/archive/teuthology-2023-10-27_14:22:11-upgrade:octopus-x-quincy-distro-default-smithi/7438912/orig.config.yaml 2023-10-27T14:50:19.535 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-10-27_14:22:11-upgrade:octopus-x-quincy-distro-default-smithi/7438912 2023-10-27T14:50:19.536 INFO:teuthology.dispatcher.supervisor:Job PID: 2229744 2023-10-27T14:50:19.536 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-27T14:52:19.612 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-27T14:54:19.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-27T14:56:19.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-27T14:58:20.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-27T15:00:20.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-27T15:02:20.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-27T15:02:20.567 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-27T15:02:20.664 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-27T15:02:20.664 INFO:teuthology.nuke:Checking targets against current locks 2023-10-27T15:02:20.717 DEBUG:teuthology.nuke:shortname: smithi062 2023-10-27T15:02:20.718 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-27T15:02:20.741 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-27_14:22:11-upgrade:octopus-x-quincy-distro-default-smithi/7438912', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-27 14:44:45.300819', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJmry5fvLd+HNCWYT/44TcG1v9Sg/Kk7Q6GexxJMx7fbOXPhEV0KBpj7bGVw9TwO/Fo6BcDSj5ntDRpbBqvb+ro='} 2023-10-27T15:02:20.765 DEBUG:teuthology.nuke:shortname: smithi192 2023-10-27T15:02:20.765 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-27T15:02:20.791 INFO:teuthology.orchestra.console.smithi062:Power off 2023-10-27T15:02:20.792 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-27T15:02:20.801 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi192.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-27_14:22:11-upgrade:octopus-x-quincy-distro-default-smithi/7438912', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-27 14:44:45.302380', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHd2d1FoXIF34m/M7WR9Sj75hKKclzMaMJ5wom8FskDrRf54Uq1FOTzX3FM8bSE38TNzF88XGeR3aDTNYiilXvQ='} 2023-10-27T15:02:20.816 DEBUG:teuthology.orchestra.console.smithi062:power off output: Chassis Power Control: Down/Off 2023-10-27T15:02:20.816 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-27T15:02:20.836 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off 2023-10-27T15:02:20.855 INFO:teuthology.orchestra.console.smithi192:Power off 2023-10-27T15:02:20.856 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-27T15:02:20.877 DEBUG:teuthology.orchestra.console.smithi192:power off output: Chassis Power Control: Down/Off 2023-10-27T15:02:20.878 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-27T15:02:20.900 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2023-10-27T15:02:20.937 INFO:teuthology.orchestra.console.smithi062:Power off completed 2023-10-27T15:02:21.002 INFO:teuthology.orchestra.console.smithi192:Power off completed 2023-10-27T15:02:21.092 INFO:teuthology.lock.ops:unlocked: smithi062.front.sepia.ceph.com 2023-10-27T15:02:21.150 INFO:teuthology.lock.ops:unlocked: smithi192.front.sepia.ceph.com