2023-09-03T18:46:17.846 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556
2023-09-03T18:46:17.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-03T18:46:17.977 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f8013438be0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f80131dbc10>, signals=[15])
2023-09-03T18:46:17.978 INFO:teuthology.lock.ops:Start node 'smithi029.front.sepia.ceph.com' reimaging
2023-09-03T18:46:17.979 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: reset os type and version on server
2023-09-03T18:46:17.979 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server
2023-09-03T18:46:18.003 INFO:teuthology.lock.ops:Start node 'smithi052.front.sepia.ceph.com' reimaging
2023-09-03T18:46:18.004 INFO:teuthology.lock.ops:Updating [smithi052.front.sepia.ceph.com]: reset os type and version on server
2023-09-03T18:46:18.004 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server
2023-09-03T18:46:18.006 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /host {"name": "smithi029"}
2023-09-03T18:46:18.046 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /host {"name": "smithi052"}
2023-09-03T18:46:18.078 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /image {"name": "smithi_ubuntu_22.04"}
2023-09-03T18:46:18.117 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /image {"name": "smithi_ubuntu_22.04"}
2023-09-03T18:46:18.120 DEBUG:teuthology.provision.fog.smithi029:Requesting image smithi_ubuntu_22.04 (ID 6)
2023-09-03T18:46:18.120 DEBUG:teuthology.provision.fog.smithi029:FOG request: PUT /host/134 {"imageID": 6}
2023-09-03T18:46:18.160 DEBUG:teuthology.provision.fog.smithi052:Requesting image smithi_ubuntu_22.04 (ID 6)
2023-09-03T18:46:18.161 DEBUG:teuthology.provision.fog.smithi052:FOG request: PUT /host/157 {"imageID": 6}
2023-09-03T18:46:18.167 INFO:teuthology.provision.fog.smithi029:Scheduling deploy of ubuntu 22.04
2023-09-03T18:46:18.167 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-09-03T18:46:18.225 INFO:teuthology.provision.fog.smithi052:Scheduling deploy of ubuntu 22.04
2023-09-03T18:46:18.225 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None
2023-09-03T18:46:18.289 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /tasktype {"name": "deploy"}
2023-09-03T18:46:18.328 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /tasktype {"name": "deploy"}
2023-09-03T18:46:18.332 DEBUG:teuthology.provision.fog.smithi029:FOG request: POST /host/134/task {"taskTypeID": 1}
2023-09-03T18:46:18.366 DEBUG:teuthology.provision.fog.smithi052:FOG request: POST /host/157/task {"taskTypeID": 1}
2023-09-03T18:46:18.399 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-09-03T18:46:18.411 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None
2023-09-03T18:46:18.541 INFO:teuthology.orchestra.console.smithi052:Power off
2023-09-03T18:46:18.541 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-03T18:46:18.555 INFO:teuthology.orchestra.console.smithi029:Power off
2023-09-03T18:46:18.556 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-03T18:46:18.564 DEBUG:teuthology.orchestra.console.smithi052:power off output: Chassis Power Control: Down/Off
2023-09-03T18:46:18.565 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-03T18:46:18.581 DEBUG:teuthology.orchestra.console.smithi029:power off output: Chassis Power Control: Down/Off
2023-09-03T18:46:18.581 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-03T18:46:18.590 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on
2023-09-03T18:46:18.603 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on
2023-09-03T18:46:22.593 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-03T18:46:22.604 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-03T18:46:22.701 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on
2023-09-03T18:46:22.712 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on
2023-09-03T18:46:26.706 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-03T18:46:26.714 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-03T18:46:26.815 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off
2023-09-03T18:46:26.822 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on
2023-09-03T18:46:26.917 INFO:teuthology.orchestra.console.smithi052:Power off completed
2023-09-03T18:46:27.017 INFO:teuthology.orchestra.console.smithi052:Power on
2023-09-03T18:46:27.018 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-03T18:46:27.038 DEBUG:teuthology.orchestra.console.smithi052:power on output: Chassis Power Control: Up/On
2023-09-03T18:46:27.038 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-03T18:46:27.058 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off
2023-09-03T18:46:30.829 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-03T18:46:30.937 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off
2023-09-03T18:46:31.038 INFO:teuthology.orchestra.console.smithi029:Power off completed
2023-09-03T18:46:31.060 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-03T18:46:31.139 INFO:teuthology.orchestra.console.smithi029:Power on
2023-09-03T18:46:31.140 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-03T18:46:31.160 DEBUG:teuthology.orchestra.console.smithi029:power on output: Chassis Power Control: Up/On
2023-09-03T18:46:31.161 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-03T18:46:31.169 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off
2023-09-03T18:46:31.181 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off
2023-09-03T18:46:35.172 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-03T18:46:35.182 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-03T18:46:35.280 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on
2023-09-03T18:46:35.290 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on
2023-09-03T18:46:35.382 INFO:teuthology.orchestra.console.smithi052:Power on completed
2023-09-03T18:46:35.391 INFO:teuthology.orchestra.console.smithi029:Power on completed
2023-09-03T18:46:35.483 INFO:teuthology.provision.fog.smithi052:Waiting for deploy to finish
2023-09-03T18:46:35.484 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None
2023-09-03T18:46:35.493 INFO:teuthology.provision.fog.smithi029:Waiting for deploy to finish
2023-09-03T18:46:35.493 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-09-03T18:46:50.665 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-09-03T18:46:50.670 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None
2023-09-03T18:47:05.862 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None
2023-09-03T18:47:05.863 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-09-03T18:47:21.025 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None
2023-09-03T18:47:21.027 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-09-03T18:47:36.198 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-09-03T18:47:36.202 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None
2023-09-03T18:47:51.370 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None
2023-09-03T18:47:51.371 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-09-03T18:48:06.574 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None
2023-09-03T18:48:06.575 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-09-03T18:48:21.794 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None
2023-09-03T18:48:21.796 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-09-03T18:48:37.038 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-09-03T18:48:37.041 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None
2023-09-03T18:48:52.294 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-09-03T18:48:52.296 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None
2023-09-03T18:49:07.563 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-09-03T18:49:07.565 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None
2023-09-03T18:49:22.798 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-09-03T18:49:22.799 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None
2023-09-03T18:49:38.010 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-09-03T18:49:38.017 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None
2023-09-03T18:49:53.226 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-09-03T18:49:53.227 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None
2023-09-03T18:49:53.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-03T18:50:08.458 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-09-03T18:50:11.994 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52
2023-09-03T18:50:17.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-03T18:50:21.050 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52
2023-09-03T18:50:23.666 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-09-03T18:50:27.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-03T18:50:30.106 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52
2023-09-03T18:50:36.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-03T18:50:38.878 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-09-03T18:50:39.194 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52
2023-09-03T18:50:45.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-03T18:50:54.086 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-09-03T18:51:09.278 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-09-03T18:51:24.488 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-09-03T18:51:39.682 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-09-03T18:51:45.208 WARNING:teuthology.provision.fog.smithi052:timed out
2023-09-03T18:51:51.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-03T18:51:51.213 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52
2023-09-03T18:51:54.838 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-09-03T18:51:57.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-03T18:51:57.428 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-03T18:51:57.429 DEBUG:teuthology.orchestra.run.smithi052:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-03T18:51:57.860 INFO:teuthology.provision.fog.smithi052:Node is ready
2023-09-03T18:51:57.860 DEBUG:teuthology.orchestra.run.smithi052:> hostname
2023-09-03T18:51:57.907 INFO:teuthology.orchestra.run.smithi052.stdout:smithi052.front.sepia.ceph.com
2023-09-03T18:51:57.908 DEBUG:teuthology.orchestra.run.smithi052:> grep smithi052.front.sepia.ceph.com /etc/hosts
2023-09-03T18:51:57.955 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52 smithi052.front.sepia.ceph.com smithi052
2023-09-03T18:51:57.955 DEBUG:teuthology.orchestra.run.smithi052:> sudo hostname smithi052
2023-09-03T18:51:58.119 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/smithi052.front.sepia.ceph.com/smithi052/g' /etc/hosts
2023-09-03T18:51:58.133 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/172.21.15.52/172.21.15.52/g' /etc/hosts
2023-09-03T18:51:58.188 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/smithi052.front.sepia.ceph.com/smithi052/g' /etc/hostname
2023-09-03T18:51:58.242 DEBUG:teuthology.orchestra.run.smithi052:> sudo hostname smithi052
2023-09-03T18:51:58.299 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release
2023-09-03T18:51:58.346 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-09-03T18:51:58.347 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="Ubuntu"
2023-09-03T18:51:58.347 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="22.04"
2023-09-03T18:51:58.347 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-09-03T18:51:58.347 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_CODENAME=jammy
2023-09-03T18:51:58.348 INFO:teuthology.orchestra.run.smithi052.stdout:ID=ubuntu
2023-09-03T18:51:58.348 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE=debian
2023-09-03T18:51:58.348 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://www.ubuntu.com/"
2023-09-03T18:51:58.348 INFO:teuthology.orchestra.run.smithi052.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-09-03T18:51:58.348 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-09-03T18:51:58.349 INFO:teuthology.orchestra.run.smithi052.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-09-03T18:51:58.349 INFO:teuthology.orchestra.run.smithi052.stdout:UBUNTU_CODENAME=jammy
2023-09-03T18:51:58.349 INFO:teuthology.provision.fog.smithi052:Deploy complete!
2023-09-03T18:51:58.351 DEBUG:teuthology.parallel:result is None
2023-09-03T18:52:10.030 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-09-03T18:52:25.178 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-09-03T18:52:40.304 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-09-03T18:52:40.442 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-03T18:52:43.514 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29
2023-09-03T18:52:49.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-03T18:52:52.570 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29
2023-09-03T18:52:58.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-03T18:53:01.626 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29
2023-09-03T18:53:07.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-03T18:53:10.686 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29
2023-09-03T18:53:16.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-03T18:53:19.770 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29
2023-09-03T18:53:25.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-03T18:53:28.826 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29
2023-09-03T18:53:34.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-03T18:54:34.894 WARNING:teuthology.provision.fog.smithi029:timed out
2023-09-03T18:54:40.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-03T18:54:40.904 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29
2023-09-03T18:54:46.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-03T18:54:50.968 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29
2023-09-03T18:54:56.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-03T18:54:57.225 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-03T18:54:57.226 DEBUG:teuthology.orchestra.run.smithi029:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-03T18:54:57.827 INFO:teuthology.provision.fog.smithi029:Node is ready
2023-09-03T18:54:57.828 DEBUG:teuthology.orchestra.run.smithi029:> hostname
2023-09-03T18:54:57.877 INFO:teuthology.orchestra.run.smithi029.stdout:smithi029.front.sepia.ceph.com
2023-09-03T18:54:57.877 DEBUG:teuthology.orchestra.run.smithi029:> grep smithi029.front.sepia.ceph.com /etc/hosts
2023-09-03T18:54:57.926 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29 smithi029.front.sepia.ceph.com smithi029
2023-09-03T18:54:57.927 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname smithi029
2023-09-03T18:54:58.110 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/smithi029.front.sepia.ceph.com/smithi029/g' /etc/hosts
2023-09-03T18:54:58.126 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/172.21.15.29/172.21.15.29/g' /etc/hosts
2023-09-03T18:54:58.185 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/smithi029.front.sepia.ceph.com/smithi029/g' /etc/hostname
2023-09-03T18:54:58.240 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname smithi029
2023-09-03T18:54:58.300 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release
2023-09-03T18:54:58.349 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-09-03T18:54:58.349 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="Ubuntu"
2023-09-03T18:54:58.349 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="22.04"
2023-09-03T18:54:58.349 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-09-03T18:54:58.350 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_CODENAME=jammy
2023-09-03T18:54:58.350 INFO:teuthology.orchestra.run.smithi029.stdout:ID=ubuntu
2023-09-03T18:54:58.350 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE=debian
2023-09-03T18:54:58.350 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://www.ubuntu.com/"
2023-09-03T18:54:58.350 INFO:teuthology.orchestra.run.smithi029.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-09-03T18:54:58.351 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-09-03T18:54:58.351 INFO:teuthology.orchestra.run.smithi029.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-09-03T18:54:58.351 INFO:teuthology.orchestra.run.smithi029.stdout:UBUNTU_CODENAME=jammy
2023-09-03T18:54:58.351 INFO:teuthology.provision.fog.smithi029:Deploy complete!
2023-09-03T18:54:58.352 DEBUG:teuthology.parallel:result is None
2023-09-03T18:54:58.542 INFO:teuthology.lock.ops:Checking smithi029.front.sepia.ceph.com
2023-09-03T18:54:58.543 INFO:teuthology.lock.ops:New key found. Updating...
2023-09-03T18:54:58.606 INFO:teuthology.lock.ops:Checking smithi052.front.sepia.ceph.com
2023-09-03T18:54:58.607 INFO:teuthology.lock.ops:New key found. Updating...
2023-09-03T18:54:58.659 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: set os type and version on server
2023-09-03T18:54:58.659 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com'
2023-09-03T18:54:58.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-03T18:54:58.745 DEBUG:teuthology.orchestra.run.smithi029:> true
2023-09-03T18:54:58.854 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com'
2023-09-03T18:54:58.854 DEBUG:teuthology.orchestra.run.smithi029:> uname -m
2023-09-03T18:54:58.901 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64
2023-09-03T18:54:58.901 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release
2023-09-03T18:54:58.950 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-09-03T18:54:58.950 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="Ubuntu"
2023-09-03T18:54:58.950 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="22.04"
2023-09-03T18:54:58.950 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-09-03T18:54:58.951 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_CODENAME=jammy
2023-09-03T18:54:58.951 INFO:teuthology.orchestra.run.smithi029.stdout:ID=ubuntu
2023-09-03T18:54:58.951 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE=debian
2023-09-03T18:54:58.951 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://www.ubuntu.com/"
2023-09-03T18:54:58.951 INFO:teuthology.orchestra.run.smithi029.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-09-03T18:54:58.952 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-09-03T18:54:58.952 INFO:teuthology.orchestra.run.smithi029.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-09-03T18:54:58.952 INFO:teuthology.orchestra.run.smithi029.stdout:UBUNTU_CODENAME=jammy
2023-09-03T18:54:58.953 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server
2023-09-03T18:54:58.971 INFO:teuthology.lock.ops:Updating [smithi052.front.sepia.ceph.com]: set os type and version on server
2023-09-03T18:54:58.971 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com'
2023-09-03T18:54:58.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-03T18:54:59.049 DEBUG:teuthology.orchestra.run.smithi052:> true
2023-09-03T18:54:59.261 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com'
2023-09-03T18:54:59.262 DEBUG:teuthology.orchestra.run.smithi052:> uname -m
2023-09-03T18:54:59.309 INFO:teuthology.orchestra.run.smithi052.stdout:x86_64
2023-09-03T18:54:59.310 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release
2023-09-03T18:54:59.358 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-09-03T18:54:59.359 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="Ubuntu"
2023-09-03T18:54:59.359 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="22.04"
2023-09-03T18:54:59.359 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-09-03T18:54:59.359 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_CODENAME=jammy
2023-09-03T18:54:59.359 INFO:teuthology.orchestra.run.smithi052.stdout:ID=ubuntu
2023-09-03T18:54:59.360 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE=debian
2023-09-03T18:54:59.360 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://www.ubuntu.com/"
2023-09-03T18:54:59.360 INFO:teuthology.orchestra.run.smithi052.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-09-03T18:54:59.360 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-09-03T18:54:59.360 INFO:teuthology.orchestra.run.smithi052.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-09-03T18:54:59.361 INFO:teuthology.orchestra.run.smithi052.stdout:UBUNTU_CODENAME=jammy
2023-09-03T18:54:59.361 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server
2023-09-03T18:54:59.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-03T18:54:59.469 INFO:teuthology.dispatcher.supervisor:Running job 7387900
2023-09-03T18:54:59.469 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/virtualenv/bin/teuthology -v --owner scheduled_rfriedma@teuthology --archive /home/teuthworker/archive/rfriedma-2023-09-03_18:42:09-rados:thrash-wip-rf-1b1-v16-distro-default-smithi/7387900 --name rfriedma-2023-09-03_18:42:09-rados:thrash-wip-rf-1b1-v16-distro-default-smithi --description rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/small-objects-localized} -- /home/teuthworker/archive/rfriedma-2023-09-03_18:42:09-rados:thrash-wip-rf-1b1-v16-distro-default-smithi/7387900/orig.config.yaml
2023-09-03T18:54:59.472 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rfriedma-2023-09-03_18:42:09-rados:thrash-wip-rf-1b1-v16-distro-default-smithi/7387900
2023-09-03T18:54:59.473 INFO:teuthology.dispatcher.supervisor:Job PID: 1652569
2023-09-03T18:54:59.473 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-09-03T18:56:59.570 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-03T18:56:59.640 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-09-03T18:56:59.751 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-09-03T18:56:59.751 INFO:teuthology.nuke:Checking targets against current locks
2023-09-03T18:56:59.803 DEBUG:teuthology.nuke:shortname: smithi029
2023-09-03T18:56:59.803 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-03T18:56:59.821 DEBUG:teuthology.nuke:shortname: smithi052
2023-09-03T18:56:59.822 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-03T18:56:59.828 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi029.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rfriedma-2023-09-03_18:42:09-rados:thrash-wip-rf-1b1-v16-distro-default-smithi/7387900', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-03 18:46:17.037903', 'locked_by': 'scheduled_rfriedma@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHciuxxBwuqX4YouXNa+InNrB8Dgs1Krm4jljlalWuvy'}
2023-09-03T18:56:59.847 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi052.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rfriedma-2023-09-03_18:42:09-rados:thrash-wip-rf-1b1-v16-distro-default-smithi/7387900', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-03 18:46:17.039262', 'locked_by': 'scheduled_rfriedma@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICAJam1fZqmV64y1WXnX9eO1t/wEICX2Ocg69myaYR1K'}
2023-09-03T18:56:59.876 INFO:teuthology.orchestra.console.smithi029:Power off
2023-09-03T18:56:59.878 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-03T18:56:59.903 DEBUG:teuthology.orchestra.console.smithi029:power off output: Chassis Power Control: Down/Off
2023-09-03T18:56:59.903 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-03T18:56:59.918 INFO:teuthology.orchestra.console.smithi052:Power off
2023-09-03T18:56:59.919 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-03T18:56:59.927 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off
2023-09-03T18:56:59.941 DEBUG:teuthology.orchestra.console.smithi052:power off output: Chassis Power Control: Down/Off
2023-09-03T18:56:59.942 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-03T18:56:59.963 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off
2023-09-03T18:57:00.029 INFO:teuthology.orchestra.console.smithi029:Power off completed
2023-09-03T18:57:00.064 INFO:teuthology.orchestra.console.smithi052:Power off completed
2023-09-03T18:57:00.177 INFO:teuthology.lock.ops:unlocked: smithi029.front.sepia.ceph.com
2023-09-03T18:57:00.211 INFO:teuthology.lock.ops:unlocked: smithi052.front.sepia.ceph.com