2023-09-03T18:46:04.798 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556 2023-09-03T18:46:04.800 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T18:46:04.928 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fbc77d65d30>, signals=[15]) 2023-09-03T18:46:04.929 INFO:teuthology.lock.ops:Start node 'smithi098.front.sepia.ceph.com' reimaging 2023-09-03T18:46:04.930 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: reset os type and version on server 2023-09-03T18:46:04.930 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2023-09-03T18:46:04.951 INFO:teuthology.lock.ops:Start node 'smithi203.front.sepia.ceph.com' reimaging 2023-09-03T18:46:04.951 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: reset os type and version on server 2023-09-03T18:46:04.952 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2023-09-03T18:46:04.953 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /host {"name": "smithi098"} 2023-09-03T18:46:04.977 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /host {"name": "smithi203"} 2023-09-03T18:46:05.022 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-09-03T18:46:05.044 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-09-03T18:46:05.065 DEBUG:teuthology.provision.fog.smithi098:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-09-03T18:46:05.065 DEBUG:teuthology.provision.fog.smithi098:FOG request: PUT /host/203 {"imageID": 6} 2023-09-03T18:46:05.087 DEBUG:teuthology.provision.fog.smithi203:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-09-03T18:46:05.087 DEBUG:teuthology.provision.fog.smithi203:FOG request: PUT /host/307 {"imageID": 6} 2023-09-03T18:46:05.105 INFO:teuthology.provision.fog.smithi098:Scheduling deploy of ubuntu 22.04 2023-09-03T18:46:05.106 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-09-03T18:46:05.132 INFO:teuthology.provision.fog.smithi203:Scheduling deploy of ubuntu 22.04 2023-09-03T18:46:05.132 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-03T18:46:05.146 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /tasktype {"name": "deploy"} 2023-09-03T18:46:05.172 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /tasktype {"name": "deploy"} 2023-09-03T18:46:05.184 DEBUG:teuthology.provision.fog.smithi098:FOG request: POST /host/203/task {"taskTypeID": 1} 2023-09-03T18:46:05.206 DEBUG:teuthology.provision.fog.smithi203:FOG request: POST /host/307/task {"taskTypeID": 1} 2023-09-03T18:46:05.244 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-09-03T18:46:05.268 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-03T18:46:05.325 INFO:teuthology.orchestra.console.smithi098:Power off 2023-09-03T18:46:05.326 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-03T18:46:05.339 INFO:teuthology.orchestra.console.smithi203:Power off 2023-09-03T18:46:05.340 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-03T18:46:05.349 DEBUG:teuthology.orchestra.console.smithi098:power off output: Chassis Power Control: Down/Off 2023-09-03T18:46:05.350 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T18:46:05.361 DEBUG:teuthology.orchestra.console.smithi203:power off output: Chassis Power Control: Down/Off 2023-09-03T18:46:05.361 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T18:46:05.370 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2023-09-03T18:46:05.381 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2023-09-03T18:46:05.471 INFO:teuthology.orchestra.console.smithi098:Power off completed 2023-09-03T18:46:05.483 INFO:teuthology.orchestra.console.smithi203:Power off completed 2023-09-03T18:46:05.572 INFO:teuthology.orchestra.console.smithi098:Power on 2023-09-03T18:46:05.573 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-03T18:46:05.584 INFO:teuthology.orchestra.console.smithi203:Power on 2023-09-03T18:46:05.585 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-03T18:46:05.593 DEBUG:teuthology.orchestra.console.smithi098:power on output: Chassis Power Control: Up/On 2023-09-03T18:46:05.593 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T18:46:05.605 DEBUG:teuthology.orchestra.console.smithi203:power on output: Chassis Power Control: Up/On 2023-09-03T18:46:05.606 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T18:46:05.616 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2023-09-03T18:46:05.627 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2023-09-03T18:46:09.619 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T18:46:09.629 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T18:46:09.728 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2023-09-03T18:46:09.737 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2023-09-03T18:46:13.731 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T18:46:13.738 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T18:46:13.840 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2023-09-03T18:46:13.942 INFO:teuthology.orchestra.console.smithi098:Power on completed 2023-09-03T18:46:13.952 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2023-09-03T18:46:14.043 INFO:teuthology.provision.fog.smithi098:Waiting for deploy to finish 2023-09-03T18:46:14.044 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-09-03T18:46:14.053 INFO:teuthology.orchestra.console.smithi203:Power on completed 2023-09-03T18:46:14.154 INFO:teuthology.provision.fog.smithi203:Waiting for deploy to finish 2023-09-03T18:46:14.155 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-03T18:46:29.142 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-09-03T18:46:29.243 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-03T18:46:44.311 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-09-03T18:46:44.419 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-03T18:46:59.466 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-09-03T18:46:59.552 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-03T18:47:14.630 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-09-03T18:47:14.688 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-03T18:47:29.792 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-09-03T18:47:29.844 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-03T18:47:44.998 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-09-03T18:47:45.018 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-03T18:48:00.177 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-09-03T18:48:00.190 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-03T18:48:15.407 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-03T18:48:15.408 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-09-03T18:48:30.679 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-03T18:48:30.681 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-09-03T18:48:45.982 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-03T18:48:45.983 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-09-03T18:49:01.275 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-09-03T18:49:01.287 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-03T18:49:16.604 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-09-03T18:49:16.605 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-03T18:49:31.844 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-09-03T18:49:31.845 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-03T18:49:32.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T18:49:47.094 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-03T18:49:47.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T18:49:50.490 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-09-03T18:49:56.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T18:49:59.582 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-09-03T18:50:05.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T18:50:05.850 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-09-03T18:50:08.666 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-09-03T18:50:11.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T18:50:14.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T18:50:14.906 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-09-03T18:50:17.722 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-09-03T18:50:20.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T18:50:23.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T18:50:23.962 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-09-03T18:50:26.778 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-09-03T18:50:29.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T18:50:32.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T18:50:33.018 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-09-03T18:50:39.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T18:50:42.106 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-09-03T18:50:48.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T18:51:04.218 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-09-03T18:51:10.225 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T18:51:10.227 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-09-03T18:51:16.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T18:51:16.236 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-09-03T18:51:22.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T18:51:22.244 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-09-03T18:51:28.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T18:51:28.252 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-09-03T18:51:34.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T18:51:34.547 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-03T18:51:34.548 DEBUG:teuthology.orchestra.run.smithi098:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-03T18:51:35.017 INFO:teuthology.provision.fog.smithi098:Node is ready 2023-09-03T18:51:35.018 DEBUG:teuthology.orchestra.run.smithi098:> hostname 2023-09-03T18:51:35.063 INFO:teuthology.orchestra.run.smithi098.stdout:smithi098.front.sepia.ceph.com 2023-09-03T18:51:35.063 DEBUG:teuthology.orchestra.run.smithi098:> grep smithi098.front.sepia.ceph.com /etc/hosts 2023-09-03T18:51:35.111 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98 smithi098.front.sepia.ceph.com smithi098 2023-09-03T18:51:35.111 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098 2023-09-03T18:51:35.242 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hosts 2023-09-03T18:51:35.255 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/172.21.15.98/172.21.15.98/g' /etc/hosts 2023-09-03T18:51:35.311 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hostname 2023-09-03T18:51:35.367 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098 2023-09-03T18:51:35.421 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2023-09-03T18:51:35.470 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-03T18:51:35.471 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="Ubuntu" 2023-09-03T18:51:35.471 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="22.04" 2023-09-03T18:51:35.471 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-03T18:51:35.471 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_CODENAME=jammy 2023-09-03T18:51:35.471 INFO:teuthology.orchestra.run.smithi098.stdout:ID=ubuntu 2023-09-03T18:51:35.472 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE=debian 2023-09-03T18:51:35.472 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-03T18:51:35.472 INFO:teuthology.orchestra.run.smithi098.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-03T18:51:35.472 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-03T18:51:35.472 INFO:teuthology.orchestra.run.smithi098.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-03T18:51:35.473 INFO:teuthology.orchestra.run.smithi098.stdout:UBUNTU_CODENAME=jammy 2023-09-03T18:51:35.473 INFO:teuthology.provision.fog.smithi098:Deploy complete! 2023-09-03T18:51:35.475 DEBUG:teuthology.parallel:result is None 2023-09-03T18:51:48.122 WARNING:teuthology.provision.fog.smithi203:timed out 2023-09-03T18:51:54.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T18:51:54.337 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-03T18:51:54.337 DEBUG:teuthology.orchestra.run.smithi203:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-03T18:51:54.842 INFO:teuthology.provision.fog.smithi203:Node is ready 2023-09-03T18:51:54.842 DEBUG:teuthology.orchestra.run.smithi203:> hostname 2023-09-03T18:51:54.888 INFO:teuthology.orchestra.run.smithi203.stdout:smithi203.front.sepia.ceph.com 2023-09-03T18:51:54.889 DEBUG:teuthology.orchestra.run.smithi203:> grep smithi203.front.sepia.ceph.com /etc/hosts 2023-09-03T18:51:54.937 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.15.203 smithi203.front.sepia.ceph.com smithi203 2023-09-03T18:51:54.937 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203 2023-09-03T18:51:55.119 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hosts 2023-09-03T18:51:55.134 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/172.21.15.203/172.21.15.203/g' /etc/hosts 2023-09-03T18:51:55.188 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hostname 2023-09-03T18:51:55.245 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203 2023-09-03T18:51:55.299 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release 2023-09-03T18:51:55.349 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-03T18:51:55.349 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="Ubuntu" 2023-09-03T18:51:55.349 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="22.04" 2023-09-03T18:51:55.349 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-03T18:51:55.350 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_CODENAME=jammy 2023-09-03T18:51:55.350 INFO:teuthology.orchestra.run.smithi203.stdout:ID=ubuntu 2023-09-03T18:51:55.350 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE=debian 2023-09-03T18:51:55.350 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-03T18:51:55.350 INFO:teuthology.orchestra.run.smithi203.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-03T18:51:55.350 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-03T18:51:55.351 INFO:teuthology.orchestra.run.smithi203.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-03T18:51:55.351 INFO:teuthology.orchestra.run.smithi203.stdout:UBUNTU_CODENAME=jammy 2023-09-03T18:51:55.351 INFO:teuthology.provision.fog.smithi203:Deploy complete! 2023-09-03T18:51:55.352 DEBUG:teuthology.parallel:result is None 2023-09-03T18:51:55.525 INFO:teuthology.lock.ops:Checking smithi098.front.sepia.ceph.com 2023-09-03T18:51:55.525 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-03T18:51:55.555 INFO:teuthology.lock.ops:Checking smithi203.front.sepia.ceph.com 2023-09-03T18:51:55.555 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-03T18:51:55.572 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: set os type and version on server 2023-09-03T18:51:55.573 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-09-03T18:51:55.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T18:51:55.644 DEBUG:teuthology.orchestra.run.smithi098:> true 2023-09-03T18:51:55.861 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-09-03T18:51:55.862 DEBUG:teuthology.orchestra.run.smithi098:> uname -m 2023-09-03T18:51:55.906 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2023-09-03T18:51:55.907 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2023-09-03T18:51:55.954 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-03T18:51:55.954 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="Ubuntu" 2023-09-03T18:51:55.955 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="22.04" 2023-09-03T18:51:55.955 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-03T18:51:55.955 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_CODENAME=jammy 2023-09-03T18:51:55.955 INFO:teuthology.orchestra.run.smithi098.stdout:ID=ubuntu 2023-09-03T18:51:55.955 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE=debian 2023-09-03T18:51:55.956 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-03T18:51:55.956 INFO:teuthology.orchestra.run.smithi098.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-03T18:51:55.956 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-03T18:51:55.956 INFO:teuthology.orchestra.run.smithi098.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-03T18:51:55.956 INFO:teuthology.orchestra.run.smithi098.stdout:UBUNTU_CODENAME=jammy 2023-09-03T18:51:55.957 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2023-09-03T18:51:55.980 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: set os type and version on server 2023-09-03T18:51:55.980 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2023-09-03T18:51:55.981 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T18:51:56.059 DEBUG:teuthology.orchestra.run.smithi203:> true 2023-09-03T18:51:56.166 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com' 2023-09-03T18:51:56.166 DEBUG:teuthology.orchestra.run.smithi203:> uname -m 2023-09-03T18:51:56.212 INFO:teuthology.orchestra.run.smithi203.stdout:x86_64 2023-09-03T18:51:56.212 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release 2023-09-03T18:51:56.260 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-03T18:51:56.260 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="Ubuntu" 2023-09-03T18:51:56.260 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="22.04" 2023-09-03T18:51:56.261 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-03T18:51:56.261 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_CODENAME=jammy 2023-09-03T18:51:56.261 INFO:teuthology.orchestra.run.smithi203.stdout:ID=ubuntu 2023-09-03T18:51:56.261 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE=debian 2023-09-03T18:51:56.261 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-03T18:51:56.262 INFO:teuthology.orchestra.run.smithi203.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-03T18:51:56.262 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-03T18:51:56.262 INFO:teuthology.orchestra.run.smithi203.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-03T18:51:56.262 INFO:teuthology.orchestra.run.smithi203.stdout:UBUNTU_CODENAME=jammy 2023-09-03T18:51:56.263 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2023-09-03T18:51:56.288 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T18:51:56.377 INFO:teuthology.dispatcher.supervisor:Running job 7387885 2023-09-03T18:51:56.377 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/virtualenv/bin/teuthology -v --owner scheduled_rfriedma@teuthology --archive /home/teuthworker/archive/rfriedma-2023-09-03_18:42:09-rados:thrash-wip-rf-1b1-v16-distro-default-smithi/7387885 --name rfriedma-2023-09-03_18:42:09-rados:thrash-wip-rf-1b1-v16-distro-default-smithi --description rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} -- /home/teuthworker/archive/rfriedma-2023-09-03_18:42:09-rados:thrash-wip-rf-1b1-v16-distro-default-smithi/7387885/orig.config.yaml 2023-09-03T18:51:56.380 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rfriedma-2023-09-03_18:42:09-rados:thrash-wip-rf-1b1-v16-distro-default-smithi/7387885 2023-09-03T18:51:56.381 INFO:teuthology.dispatcher.supervisor:Job PID: 1652204 2023-09-03T18:51:56.381 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-03T18:53:56.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T18:53:56.552 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-09-03T18:53:56.646 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-03T18:53:56.646 INFO:teuthology.nuke:Checking targets against current locks 2023-09-03T18:53:56.691 DEBUG:teuthology.nuke:shortname: smithi098 2023-09-03T18:53:56.692 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-03T18:53:56.715 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rfriedma-2023-09-03_18:42:09-rados:thrash-wip-rf-1b1-v16-distro-default-smithi/7387885', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-03 18:46:03.998052', 'locked_by': 'scheduled_rfriedma@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPtZQBD+yONCVzoqjLc+p8KbQ5lrQzmPRGpEgqr0Km20'} 2023-09-03T18:53:56.717 DEBUG:teuthology.nuke:shortname: smithi203 2023-09-03T18:53:56.718 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-03T18:53:56.740 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi203.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rfriedma-2023-09-03_18:42:09-rados:thrash-wip-rf-1b1-v16-distro-default-smithi/7387885', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-03 18:46:03.999938', 'locked_by': 'scheduled_rfriedma@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJW0MeYtUj6Qk9DXWnvXBh4grvWib3g8HCj6/74vVea0'} 2023-09-03T18:53:56.760 INFO:teuthology.orchestra.console.smithi098:Power off 2023-09-03T18:53:56.760 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-03T18:53:56.780 DEBUG:teuthology.orchestra.console.smithi098:power off output: Chassis Power Control: Down/Off 2023-09-03T18:53:56.781 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T18:53:56.793 INFO:teuthology.orchestra.console.smithi203:Power off 2023-09-03T18:53:56.794 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-03T18:53:56.802 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2023-09-03T18:53:56.816 DEBUG:teuthology.orchestra.console.smithi203:power off output: Chassis Power Control: Down/Off 2023-09-03T18:53:56.816 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T18:53:56.836 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2023-09-03T18:53:56.903 INFO:teuthology.orchestra.console.smithi098:Power off completed 2023-09-03T18:53:56.938 INFO:teuthology.orchestra.console.smithi203:Power off completed 2023-09-03T18:53:57.057 INFO:teuthology.lock.ops:unlocked: smithi098.front.sepia.ceph.com 2023-09-03T18:53:57.092 INFO:teuthology.lock.ops:unlocked: smithi203.front.sepia.ceph.com