2023-11-09T23:00:08.236 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-09T23:00:08.238 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T23:00:08.417 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f445a43c670>, signals=[15]) 2023-11-09T23:00:08.419 INFO:teuthology.lock.ops:Start node 'smithi098.front.sepia.ceph.com' reimaging 2023-11-09T23:00:08.419 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: reset os type and version on server 2023-11-09T23:00:08.420 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2023-11-09T23:00:08.454 INFO:teuthology.lock.ops:Start node 'smithi184.front.sepia.ceph.com' reimaging 2023-11-09T23:00:08.454 INFO:teuthology.lock.ops:Updating [smithi184.front.sepia.ceph.com]: reset os type and version on server 2023-11-09T23:00:08.455 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2023-11-09T23:00:08.456 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /host {"name": "smithi098"} 2023-11-09T23:00:08.496 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /host {"name": "smithi184"} 2023-11-09T23:00:08.571 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-11-09T23:00:08.603 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-11-09T23:00:08.629 DEBUG:teuthology.provision.fog.smithi098:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-11-09T23:00:08.629 DEBUG:teuthology.provision.fog.smithi098:FOG request: PUT /host/203 {"imageID": 2} 2023-11-09T23:00:08.653 DEBUG:teuthology.provision.fog.smithi184:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-11-09T23:00:08.654 DEBUG:teuthology.provision.fog.smithi184:FOG request: PUT /host/289 {"imageID": 2} 2023-11-09T23:00:08.685 INFO:teuthology.provision.fog.smithi098:Scheduling deploy of ubuntu 20.04 2023-11-09T23:00:08.686 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-11-09T23:00:08.711 INFO:teuthology.provision.fog.smithi184:Scheduling deploy of ubuntu 20.04 2023-11-09T23:00:08.712 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-11-09T23:00:08.758 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /tasktype {"name": "deploy"} 2023-11-09T23:00:08.777 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /tasktype {"name": "deploy"} 2023-11-09T23:00:08.805 DEBUG:teuthology.provision.fog.smithi098:FOG request: POST /host/203/task {"taskTypeID": 1} 2023-11-09T23:00:08.825 DEBUG:teuthology.provision.fog.smithi184:FOG request: POST /host/289/task {"taskTypeID": 1} 2023-11-09T23:00:08.885 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-11-09T23:00:08.899 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-11-09T23:00:09.012 INFO:teuthology.orchestra.console.smithi098:Power off 2023-11-09T23:00:09.013 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-09T23:00:09.027 INFO:teuthology.orchestra.console.smithi184:Power off 2023-11-09T23:00:09.027 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-09T23:00:09.043 DEBUG:teuthology.orchestra.console.smithi098:power off output: Chassis Power Control: Down/Off 2023-11-09T23:00:09.044 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T23:00:09.056 DEBUG:teuthology.orchestra.console.smithi184:power off output: Chassis Power Control: Down/Off 2023-11-09T23:00:09.057 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T23:00:09.074 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2023-11-09T23:00:09.088 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off 2023-11-09T23:00:09.175 INFO:teuthology.orchestra.console.smithi098:Power off completed 2023-11-09T23:00:09.190 INFO:teuthology.orchestra.console.smithi184:Power off completed 2023-11-09T23:00:09.277 INFO:teuthology.orchestra.console.smithi098:Power on 2023-11-09T23:00:09.277 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-09T23:00:09.292 INFO:teuthology.orchestra.console.smithi184:Power on 2023-11-09T23:00:09.292 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-09T23:00:09.327 DEBUG:teuthology.orchestra.console.smithi098:power on output: Chassis Power Control: Up/On 2023-11-09T23:00:09.327 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T23:00:09.344 DEBUG:teuthology.orchestra.console.smithi184:power on output: Chassis Power Control: Up/On 2023-11-09T23:00:09.344 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T23:00:09.358 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2023-11-09T23:00:09.376 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off 2023-11-09T23:00:13.362 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T23:00:13.377 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T23:00:13.471 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2023-11-09T23:00:13.487 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off 2023-11-09T23:00:17.474 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T23:00:17.488 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T23:00:17.597 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2023-11-09T23:00:17.654 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2023-11-09T23:00:17.698 INFO:teuthology.orchestra.console.smithi184:Power on completed 2023-11-09T23:00:17.755 INFO:teuthology.orchestra.console.smithi098:Power on completed 2023-11-09T23:00:17.800 INFO:teuthology.provision.fog.smithi184:Waiting for deploy to finish 2023-11-09T23:00:17.800 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-11-09T23:00:17.857 INFO:teuthology.provision.fog.smithi098:Waiting for deploy to finish 2023-11-09T23:00:17.857 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-11-09T23:00:32.920 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-11-09T23:00:32.946 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-11-09T23:00:48.006 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-11-09T23:00:48.017 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-11-09T23:01:03.106 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-11-09T23:01:03.108 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-11-09T23:01:18.226 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-11-09T23:01:18.228 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-11-09T23:01:33.314 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-11-09T23:01:33.316 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-11-09T23:01:48.398 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-11-09T23:01:48.400 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-11-09T23:02:03.482 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-11-09T23:02:03.484 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-11-09T23:02:18.570 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-11-09T23:02:18.572 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-11-09T23:02:33.658 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-11-09T23:02:33.660 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-11-09T23:02:48.742 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-11-09T23:02:48.744 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-11-09T23:03:03.830 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-11-09T23:03:03.832 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-11-09T23:03:18.918 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-11-09T23:03:18.920 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-11-09T23:03:34.022 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-11-09T23:03:34.024 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-11-09T23:03:49.126 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-11-09T23:03:49.128 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-11-09T23:04:04.222 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-11-09T23:04:04.223 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-11-09T23:04:04.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T23:04:04.341 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T23:04:22.907 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-11-09T23:04:22.908 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-11-09T23:04:28.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T23:04:28.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T23:04:31.998 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-11-09T23:04:31.999 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-11-09T23:04:38.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T23:04:38.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T23:04:41.082 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-11-09T23:04:41.114 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-11-09T23:04:47.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T23:04:47.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T23:04:50.170 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-11-09T23:04:50.202 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-11-09T23:04:56.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T23:04:56.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T23:04:59.258 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-11-09T23:05:05.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T23:05:37.564 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-09T23:05:37.565 DEBUG:teuthology.orchestra.run.smithi098:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-09T23:05:56.230 WARNING:teuthology.provision.fog.smithi184:timed out 2023-11-09T23:05:59.002 INFO:teuthology.provision.fog.smithi098:Node is ready 2023-11-09T23:05:59.003 DEBUG:teuthology.orchestra.run.smithi098:> hostname 2023-11-09T23:05:59.010 INFO:teuthology.orchestra.run.smithi098.stdout:smithi098.front.sepia.ceph.com 2023-11-09T23:05:59.010 DEBUG:teuthology.orchestra.run.smithi098:> grep smithi098.front.sepia.ceph.com /etc/hosts 2023-11-09T23:05:59.017 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98 smithi098.front.sepia.ceph.com smithi098 2023-11-09T23:05:59.018 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098 2023-11-09T23:05:59.093 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hosts 2023-11-09T23:05:59.108 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/172.21.15.98/172.21.15.98/g' /etc/hosts 2023-11-09T23:05:59.165 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hostname 2023-11-09T23:05:59.177 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098 2023-11-09T23:05:59.189 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2023-11-09T23:05:59.194 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="Ubuntu" 2023-11-09T23:05:59.195 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-09T23:05:59.195 INFO:teuthology.orchestra.run.smithi098.stdout:ID=ubuntu 2023-11-09T23:05:59.195 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE=debian 2023-11-09T23:05:59.195 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-09T23:05:59.195 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="20.04" 2023-11-09T23:05:59.196 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-09T23:05:59.196 INFO:teuthology.orchestra.run.smithi098.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-09T23:05:59.196 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-09T23:05:59.196 INFO:teuthology.orchestra.run.smithi098.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-09T23:05:59.196 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_CODENAME=focal 2023-11-09T23:05:59.197 INFO:teuthology.orchestra.run.smithi098.stdout:UBUNTU_CODENAME=focal 2023-11-09T23:05:59.197 INFO:teuthology.provision.fog.smithi098:Deploy complete! 2023-11-09T23:05:59.199 DEBUG:teuthology.parallel:result is None 2023-11-09T23:06:02.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T23:06:02.480 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-09T23:06:02.481 DEBUG:teuthology.orchestra.run.smithi184:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-09T23:06:03.001 INFO:teuthology.provision.fog.smithi184:Node is ready 2023-11-09T23:06:03.001 DEBUG:teuthology.orchestra.run.smithi184:> hostname 2023-11-09T23:06:03.007 INFO:teuthology.orchestra.run.smithi184.stdout:smithi184.front.sepia.ceph.com 2023-11-09T23:06:03.008 DEBUG:teuthology.orchestra.run.smithi184:> grep smithi184.front.sepia.ceph.com /etc/hosts 2023-11-09T23:06:03.014 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.15.184 smithi184.front.sepia.ceph.com smithi184 2023-11-09T23:06:03.015 DEBUG:teuthology.orchestra.run.smithi184:> sudo hostname smithi184 2023-11-09T23:06:03.133 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/smithi184.front.sepia.ceph.com/smithi184/g' /etc/hosts 2023-11-09T23:06:03.149 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/172.21.15.184/172.21.15.184/g' /etc/hosts 2023-11-09T23:06:03.163 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/smithi184.front.sepia.ceph.com/smithi184/g' /etc/hostname 2023-11-09T23:06:03.176 DEBUG:teuthology.orchestra.run.smithi184:> sudo hostname smithi184 2023-11-09T23:06:03.187 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2023-11-09T23:06:03.192 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="Ubuntu" 2023-11-09T23:06:03.192 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-09T23:06:03.192 INFO:teuthology.orchestra.run.smithi184.stdout:ID=ubuntu 2023-11-09T23:06:03.192 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE=debian 2023-11-09T23:06:03.192 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-09T23:06:03.193 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="20.04" 2023-11-09T23:06:03.193 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-09T23:06:03.193 INFO:teuthology.orchestra.run.smithi184.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-09T23:06:03.193 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-09T23:06:03.193 INFO:teuthology.orchestra.run.smithi184.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-09T23:06:03.194 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_CODENAME=focal 2023-11-09T23:06:03.194 INFO:teuthology.orchestra.run.smithi184.stdout:UBUNTU_CODENAME=focal 2023-11-09T23:06:03.194 INFO:teuthology.provision.fog.smithi184:Deploy complete! 2023-11-09T23:06:03.195 DEBUG:teuthology.parallel:result is None 2023-11-09T23:06:03.553 INFO:teuthology.lock.ops:Checking smithi098.front.sepia.ceph.com 2023-11-09T23:06:03.553 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-09T23:06:03.586 INFO:teuthology.lock.ops:Checking smithi184.front.sepia.ceph.com 2023-11-09T23:06:03.586 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-09T23:06:03.621 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: set os type and version on server 2023-11-09T23:06:03.621 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-11-09T23:06:03.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T23:06:03.699 DEBUG:teuthology.orchestra.run.smithi098:> true 2023-11-09T23:06:03.815 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-11-09T23:06:03.816 DEBUG:teuthology.orchestra.run.smithi098:> uname -m 2023-11-09T23:06:03.821 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2023-11-09T23:06:03.822 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2023-11-09T23:06:03.871 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="Ubuntu" 2023-11-09T23:06:03.871 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-09T23:06:03.871 INFO:teuthology.orchestra.run.smithi098.stdout:ID=ubuntu 2023-11-09T23:06:03.871 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE=debian 2023-11-09T23:06:03.872 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-09T23:06:03.872 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="20.04" 2023-11-09T23:06:03.872 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-09T23:06:03.872 INFO:teuthology.orchestra.run.smithi098.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-09T23:06:03.872 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-09T23:06:03.873 INFO:teuthology.orchestra.run.smithi098.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-09T23:06:03.873 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_CODENAME=focal 2023-11-09T23:06:03.873 INFO:teuthology.orchestra.run.smithi098.stdout:UBUNTU_CODENAME=focal 2023-11-09T23:06:03.873 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2023-11-09T23:06:03.903 INFO:teuthology.lock.ops:Updating [smithi184.front.sepia.ceph.com]: set os type and version on server 2023-11-09T23:06:03.903 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-11-09T23:06:03.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T23:06:03.979 DEBUG:teuthology.orchestra.run.smithi184:> true 2023-11-09T23:06:04.104 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-11-09T23:06:04.104 DEBUG:teuthology.orchestra.run.smithi184:> uname -m 2023-11-09T23:06:04.110 INFO:teuthology.orchestra.run.smithi184.stdout:x86_64 2023-11-09T23:06:04.111 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2023-11-09T23:06:04.115 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="Ubuntu" 2023-11-09T23:06:04.115 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-09T23:06:04.116 INFO:teuthology.orchestra.run.smithi184.stdout:ID=ubuntu 2023-11-09T23:06:04.116 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE=debian 2023-11-09T23:06:04.116 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-09T23:06:04.116 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="20.04" 2023-11-09T23:06:04.117 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-09T23:06:04.117 INFO:teuthology.orchestra.run.smithi184.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-09T23:06:04.117 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-09T23:06:04.117 INFO:teuthology.orchestra.run.smithi184.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-09T23:06:04.117 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_CODENAME=focal 2023-11-09T23:06:04.118 INFO:teuthology.orchestra.run.smithi184.stdout:UBUNTU_CODENAME=focal 2023-11-09T23:06:04.118 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2023-11-09T23:06:04.144 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T23:06:04.242 INFO:teuthology.dispatcher.supervisor:Running job 7453258 2023-11-09T23:06:04.242 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-11-09_21:43:29-fs-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi/7453258 --name yuriw-2023-11-09_21:43:29-fs-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi --description fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/damage} -- /home/teuthworker/archive/yuriw-2023-11-09_21:43:29-fs-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi/7453258/orig.config.yaml 2023-11-09T23:06:04.246 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-11-09_21:43:29-fs-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi/7453258 2023-11-09T23:06:04.246 INFO:teuthology.dispatcher.supervisor:Job PID: 305482 2023-11-09T23:06:04.247 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-09T23:08:04.340 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T23:10:04.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T23:12:04.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T23:14:04.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T23:16:05.054 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T23:18:05.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T23:20:05.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T23:22:05.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T23:24:05.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T23:26:05.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T23:28:06.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T23:28:06.140 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-11-09T23:28:06.252 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-09T23:28:06.252 INFO:teuthology.nuke:Checking targets against current locks 2023-11-09T23:28:06.306 DEBUG:teuthology.nuke:shortname: smithi098 2023-11-09T23:28:06.306 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-09T23:28:06.328 DEBUG:teuthology.nuke:shortname: smithi184 2023-11-09T23:28:06.329 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-09T23:28:06.332 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-09_21:43:29-fs-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi/7453258', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-09 23:00:07.371538', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-11-09T23:28:06.362 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-09_21:43:29-fs-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi/7453258', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-09 23:00:07.373104', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-11-09T23:28:06.393 INFO:teuthology.orchestra.console.smithi098:Power off 2023-11-09T23:28:06.394 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-09T23:28:06.423 DEBUG:teuthology.orchestra.console.smithi098:power off output: Chassis Power Control: Down/Off 2023-11-09T23:28:06.424 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T23:28:06.440 INFO:teuthology.orchestra.console.smithi184:Power off 2023-11-09T23:28:06.441 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-09T23:28:06.454 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2023-11-09T23:28:06.467 DEBUG:teuthology.orchestra.console.smithi184:power off output: Chassis Power Control: Down/Off 2023-11-09T23:28:06.467 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T23:28:06.492 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off 2023-11-09T23:28:06.557 INFO:teuthology.orchestra.console.smithi098:Power off completed 2023-11-09T23:28:06.594 INFO:teuthology.orchestra.console.smithi184:Power off completed 2023-11-09T23:28:06.705 INFO:teuthology.lock.ops:unlocked: smithi098.front.sepia.ceph.com 2023-11-09T23:28:06.747 INFO:teuthology.lock.ops:unlocked: smithi184.front.sepia.ceph.com