2023-10-21T18:13:48.313 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-21T18:13:48.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:13:48.468 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd427fbdee0>, signals=[15]) 2023-10-21T18:13:48.469 INFO:teuthology.lock.ops:Start node 'smithi114.front.sepia.ceph.com' reimaging 2023-10-21T18:13:48.470 INFO:teuthology.lock.ops:Updating [smithi114.front.sepia.ceph.com]: reset os type and version on server 2023-10-21T18:13:48.470 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2023-10-21T18:13:48.490 INFO:teuthology.lock.ops:Start node 'smithi151.front.sepia.ceph.com' reimaging 2023-10-21T18:13:48.491 INFO:teuthology.lock.ops:Updating [smithi151.front.sepia.ceph.com]: reset os type and version on server 2023-10-21T18:13:48.491 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2023-10-21T18:13:48.493 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /host {"name": "smithi114"} 2023-10-21T18:13:48.515 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /host {"name": "smithi151"} 2023-10-21T18:13:48.567 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-21T18:13:48.593 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-21T18:13:48.614 DEBUG:teuthology.provision.fog.smithi114:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-21T18:13:48.615 DEBUG:teuthology.provision.fog.smithi114:FOG request: PUT /host/219 {"imageID": 2} 2023-10-21T18:13:48.632 DEBUG:teuthology.provision.fog.smithi151:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-21T18:13:48.633 DEBUG:teuthology.provision.fog.smithi151:FOG request: PUT /host/256 {"imageID": 2} 2023-10-21T18:13:48.661 INFO:teuthology.provision.fog.smithi114:Scheduling deploy of ubuntu 20.04 2023-10-21T18:13:48.661 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-21T18:13:48.678 INFO:teuthology.provision.fog.smithi151:Scheduling deploy of ubuntu 20.04 2023-10-21T18:13:48.678 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-21T18:13:48.699 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /tasktype {"name": "deploy"} 2023-10-21T18:13:48.721 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /tasktype {"name": "deploy"} 2023-10-21T18:13:48.732 DEBUG:teuthology.provision.fog.smithi114:FOG request: POST /host/219/task {"taskTypeID": 1} 2023-10-21T18:13:48.754 DEBUG:teuthology.provision.fog.smithi151:FOG request: POST /host/256/task {"taskTypeID": 1} 2023-10-21T18:13:48.786 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-21T18:13:48.800 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-21T18:13:48.872 INFO:teuthology.orchestra.console.smithi114:Power off 2023-10-21T18:13:48.873 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T18:13:48.888 INFO:teuthology.orchestra.console.smithi151:Power off 2023-10-21T18:13:48.889 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T18:13:48.899 DEBUG:teuthology.orchestra.console.smithi114:power off output: Chassis Power Control: Down/Off 2023-10-21T18:13:48.900 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T18:13:48.912 DEBUG:teuthology.orchestra.console.smithi151:power off output: Chassis Power Control: Down/Off 2023-10-21T18:13:48.912 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T18:13:48.928 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off 2023-10-21T18:13:48.938 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off 2023-10-21T18:13:49.030 INFO:teuthology.orchestra.console.smithi114:Power off completed 2023-10-21T18:13:49.040 INFO:teuthology.orchestra.console.smithi151:Power off completed 2023-10-21T18:13:49.131 INFO:teuthology.orchestra.console.smithi114:Power on 2023-10-21T18:13:49.132 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-21T18:13:49.140 INFO:teuthology.orchestra.console.smithi151:Power on 2023-10-21T18:13:49.141 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-21T18:13:49.155 DEBUG:teuthology.orchestra.console.smithi114:power on output: Chassis Power Control: Up/On 2023-10-21T18:13:49.156 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T18:13:49.167 DEBUG:teuthology.orchestra.console.smithi151:power on output: Chassis Power Control: Up/On 2023-10-21T18:13:49.168 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T18:13:49.183 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off 2023-10-21T18:13:49.189 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off 2023-10-21T18:13:53.186 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T18:13:53.193 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T18:13:53.296 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off 2023-10-21T18:13:53.303 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2023-10-21T18:13:53.404 INFO:teuthology.orchestra.console.smithi151:Power on completed 2023-10-21T18:13:53.505 INFO:teuthology.provision.fog.smithi151:Waiting for deploy to finish 2023-10-21T18:13:53.505 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-21T18:13:57.298 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T18:13:57.407 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on 2023-10-21T18:13:57.508 INFO:teuthology.orchestra.console.smithi114:Power on completed 2023-10-21T18:13:57.608 INFO:teuthology.provision.fog.smithi114:Waiting for deploy to finish 2023-10-21T18:13:57.609 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-21T18:14:08.570 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-21T18:14:12.666 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-21T18:14:23.634 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-21T18:14:27.723 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-21T18:14:38.702 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-21T18:14:42.778 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-21T18:14:53.766 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-21T18:14:57.834 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-21T18:15:08.826 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-21T18:15:12.890 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-21T18:15:23.890 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-21T18:15:27.951 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-21T18:15:38.954 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-21T18:15:43.010 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-21T18:15:54.018 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-21T18:15:58.070 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-21T18:16:09.082 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-21T18:16:13.138 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-21T18:16:24.147 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-21T18:16:28.202 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-21T18:16:39.206 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-21T18:16:43.262 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-21T18:16:54.265 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-21T18:16:58.718 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-21T18:17:09.334 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-21T18:17:13.790 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-21T18:17:24.415 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-21T18:17:28.846 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-21T18:17:28.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T18:17:39.474 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-21T18:17:47.386 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2023-10-21T18:17:53.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T18:17:54.525 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-21T18:17:54.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T18:17:56.478 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2023-10-21T18:18:02.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T18:18:05.562 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2023-10-21T18:18:11.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T18:18:12.986 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-10-21T18:18:14.622 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2023-10-21T18:18:18.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T18:18:20.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T18:18:22.042 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-10-21T18:18:23.710 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2023-10-21T18:18:28.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T18:18:29.713 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T18:18:31.102 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-10-21T18:18:37.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T18:18:40.186 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-10-21T18:18:46.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T18:18:49.246 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-10-21T18:18:55.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T18:19:28.066 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-21T18:19:28.067 DEBUG:teuthology.orchestra.run.smithi151:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-21T18:19:29.715 WARNING:teuthology.provision.fog.smithi114:timed out 2023-10-21T18:19:35.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T18:19:35.924 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-21T18:19:35.924 DEBUG:teuthology.orchestra.run.smithi114:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-21T18:19:36.381 INFO:teuthology.provision.fog.smithi114:Node is ready 2023-10-21T18:19:36.381 DEBUG:teuthology.orchestra.run.smithi114:> hostname 2023-10-21T18:19:36.388 INFO:teuthology.orchestra.run.smithi114.stdout:smithi114.front.sepia.ceph.com 2023-10-21T18:19:36.388 DEBUG:teuthology.orchestra.run.smithi114:> grep smithi114.front.sepia.ceph.com /etc/hosts 2023-10-21T18:19:36.395 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114 smithi114.front.sepia.ceph.com smithi114 2023-10-21T18:19:36.396 DEBUG:teuthology.orchestra.run.smithi114:> sudo hostname smithi114 2023-10-21T18:19:36.495 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/smithi114.front.sepia.ceph.com/smithi114/g' /etc/hosts 2023-10-21T18:19:36.510 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/172.21.15.114/172.21.15.114/g' /etc/hosts 2023-10-21T18:19:36.522 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/smithi114.front.sepia.ceph.com/smithi114/g' /etc/hostname 2023-10-21T18:19:36.533 DEBUG:teuthology.orchestra.run.smithi114:> sudo hostname smithi114 2023-10-21T18:19:36.544 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release 2023-10-21T18:19:36.550 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="Ubuntu" 2023-10-21T18:19:36.551 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-21T18:19:36.551 INFO:teuthology.orchestra.run.smithi114.stdout:ID=ubuntu 2023-10-21T18:19:36.551 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE=debian 2023-10-21T18:19:36.551 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-21T18:19:36.551 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="20.04" 2023-10-21T18:19:36.552 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-21T18:19:36.552 INFO:teuthology.orchestra.run.smithi114.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-21T18:19:36.552 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-21T18:19:36.552 INFO:teuthology.orchestra.run.smithi114.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-21T18:19:36.552 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_CODENAME=focal 2023-10-21T18:19:36.553 INFO:teuthology.orchestra.run.smithi114.stdout:UBUNTU_CODENAME=focal 2023-10-21T18:19:36.553 INFO:teuthology.provision.fog.smithi114:Deploy complete! 2023-10-21T18:19:36.555 DEBUG:teuthology.parallel:result is None 2023-10-21T18:19:49.246 INFO:teuthology.provision.fog.smithi151:Node is ready 2023-10-21T18:19:49.248 DEBUG:teuthology.orchestra.run.smithi151:> hostname 2023-10-21T18:19:49.261 INFO:teuthology.orchestra.run.smithi151.stdout:smithi151.front.sepia.ceph.com 2023-10-21T18:19:49.261 DEBUG:teuthology.orchestra.run.smithi151:> grep smithi151.front.sepia.ceph.com /etc/hosts 2023-10-21T18:19:49.314 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151 smithi151.front.sepia.ceph.com smithi151 2023-10-21T18:19:49.317 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname smithi151 2023-10-21T18:19:49.385 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/smithi151.front.sepia.ceph.com/smithi151/g' /etc/hosts 2023-10-21T18:19:49.402 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/172.21.15.151/172.21.15.151/g' /etc/hosts 2023-10-21T18:19:49.415 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/smithi151.front.sepia.ceph.com/smithi151/g' /etc/hostname 2023-10-21T18:19:49.429 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname smithi151 2023-10-21T18:19:49.485 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2023-10-21T18:19:49.490 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="Ubuntu" 2023-10-21T18:19:49.490 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-21T18:19:49.490 INFO:teuthology.orchestra.run.smithi151.stdout:ID=ubuntu 2023-10-21T18:19:49.490 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE=debian 2023-10-21T18:19:49.491 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-21T18:19:49.491 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="20.04" 2023-10-21T18:19:49.491 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-21T18:19:49.491 INFO:teuthology.orchestra.run.smithi151.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-21T18:19:49.491 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-21T18:19:49.492 INFO:teuthology.orchestra.run.smithi151.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-21T18:19:49.492 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_CODENAME=focal 2023-10-21T18:19:49.492 INFO:teuthology.orchestra.run.smithi151.stdout:UBUNTU_CODENAME=focal 2023-10-21T18:19:49.493 INFO:teuthology.provision.fog.smithi151:Deploy complete! 2023-10-21T18:19:49.493 DEBUG:teuthology.parallel:result is None 2023-10-21T18:19:49.721 INFO:teuthology.lock.ops:Checking smithi114.front.sepia.ceph.com 2023-10-21T18:19:49.722 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-21T18:19:49.743 INFO:teuthology.lock.ops:Checking smithi151.front.sepia.ceph.com 2023-10-21T18:19:49.744 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-21T18:19:49.760 INFO:teuthology.lock.ops:Updating [smithi114.front.sepia.ceph.com]: set os type and version on server 2023-10-21T18:19:49.761 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2023-10-21T18:19:49.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T18:19:49.811 DEBUG:teuthology.orchestra.run.smithi114:> true 2023-10-21T18:19:50.024 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi114.front.sepia.ceph.com' 2023-10-21T18:19:50.024 DEBUG:teuthology.orchestra.run.smithi114:> uname -m 2023-10-21T18:19:50.031 INFO:teuthology.orchestra.run.smithi114.stdout:x86_64 2023-10-21T18:19:50.031 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release 2023-10-21T18:19:50.038 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="Ubuntu" 2023-10-21T18:19:50.038 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-21T18:19:50.039 INFO:teuthology.orchestra.run.smithi114.stdout:ID=ubuntu 2023-10-21T18:19:50.039 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE=debian 2023-10-21T18:19:50.039 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-21T18:19:50.039 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="20.04" 2023-10-21T18:19:50.039 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-21T18:19:50.040 INFO:teuthology.orchestra.run.smithi114.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-21T18:19:50.040 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-21T18:19:50.040 INFO:teuthology.orchestra.run.smithi114.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-21T18:19:50.040 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_CODENAME=focal 2023-10-21T18:19:50.040 INFO:teuthology.orchestra.run.smithi114.stdout:UBUNTU_CODENAME=focal 2023-10-21T18:19:50.041 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2023-10-21T18:19:50.059 INFO:teuthology.lock.ops:Updating [smithi151.front.sepia.ceph.com]: set os type and version on server 2023-10-21T18:19:50.060 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-10-21T18:19:50.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T18:19:50.118 DEBUG:teuthology.orchestra.run.smithi151:> true 2023-10-21T18:19:50.241 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-10-21T18:19:50.242 DEBUG:teuthology.orchestra.run.smithi151:> uname -m 2023-10-21T18:19:50.249 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64 2023-10-21T18:19:50.250 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2023-10-21T18:19:50.297 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="Ubuntu" 2023-10-21T18:19:50.297 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-21T18:19:50.298 INFO:teuthology.orchestra.run.smithi151.stdout:ID=ubuntu 2023-10-21T18:19:50.298 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE=debian 2023-10-21T18:19:50.298 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-21T18:19:50.298 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="20.04" 2023-10-21T18:19:50.298 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-21T18:19:50.299 INFO:teuthology.orchestra.run.smithi151.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-21T18:19:50.299 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-21T18:19:50.299 INFO:teuthology.orchestra.run.smithi151.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-21T18:19:50.299 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_CODENAME=focal 2023-10-21T18:19:50.299 INFO:teuthology.orchestra.run.smithi151.stdout:UBUNTU_CODENAME=focal 2023-10-21T18:19:50.300 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2023-10-21T18:19:50.334 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:19:50.426 INFO:teuthology.dispatcher.supervisor:Running job 7427732 2023-10-21T18:19:50.426 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7427732 --name teuthology-2023-10-14_14:23:11-upgrade:quincy-x-reef-distro-default-smithi --description upgrade:quincy-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} -- /home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7427732/orig.config.yaml 2023-10-21T18:19:50.430 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7427732 2023-10-21T18:19:50.431 INFO:teuthology.dispatcher.supervisor:Job PID: 215137 2023-10-21T18:19:50.431 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-21T18:21:50.526 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:23:50.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:25:50.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:27:51.154 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:29:51.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:31:51.493 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:33:51.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:35:51.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:37:51.993 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:39:52.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:41:52.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:43:52.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:45:52.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:47:52.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:49:52.973 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:51:53.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:51:53.203 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-21T18:51:53.370 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-21T18:51:53.371 INFO:teuthology.nuke:Checking targets against current locks 2023-10-21T18:51:53.415 DEBUG:teuthology.nuke:shortname: smithi114 2023-10-21T18:51:53.416 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-21T18:51:53.434 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi114.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7427732', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-21 18:13:47.479629', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-21T18:51:53.442 DEBUG:teuthology.nuke:shortname: smithi151 2023-10-21T18:51:53.442 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-21T18:51:53.465 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7427732', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-21 18:13:47.477884', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-21T18:51:53.482 INFO:teuthology.orchestra.console.smithi114:Power off 2023-10-21T18:51:53.483 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T18:51:53.506 DEBUG:teuthology.orchestra.console.smithi114:power off output: Chassis Power Control: Down/Off 2023-10-21T18:51:53.506 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T18:51:53.519 INFO:teuthology.orchestra.console.smithi151:Power off 2023-10-21T18:51:53.520 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T18:51:53.527 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off 2023-10-21T18:51:53.540 DEBUG:teuthology.orchestra.console.smithi151:power off output: Chassis Power Control: Down/Off 2023-10-21T18:51:53.541 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T18:51:53.564 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off 2023-10-21T18:51:53.629 INFO:teuthology.orchestra.console.smithi114:Power off completed 2023-10-21T18:51:53.666 INFO:teuthology.orchestra.console.smithi151:Power off completed 2023-10-21T18:51:53.778 INFO:teuthology.lock.ops:unlocked: smithi114.front.sepia.ceph.com 2023-10-21T18:51:53.819 INFO:teuthology.lock.ops:unlocked: smithi151.front.sepia.ceph.com