2023-12-27T20:47:41.745 INFO:root:teuthology version: 0.0.1.dev228+g01dd171
2023-12-27T20:47:41.746 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-27T20:47:41.875 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7ffb3d40d580>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7ffb3e367940>, signals=[15])
2023-12-27T20:47:41.875 INFO:teuthology.lock.ops:Start node 'smithi121.front.sepia.ceph.com' reimaging
2023-12-27T20:47:41.876 INFO:teuthology.lock.ops:Updating [smithi121.front.sepia.ceph.com]: reset os type and version on server
2023-12-27T20:47:41.876 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server
2023-12-27T20:47:41.902 INFO:teuthology.lock.ops:Start node 'smithi123.front.sepia.ceph.com' reimaging
2023-12-27T20:47:41.902 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: reset os type and version on server
2023-12-27T20:47:41.902 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server
2023-12-27T20:47:42.039 DEBUG:teuthology.provision.fog.smithi121:Requesting image smithi_ubuntu_22.04 (ID 6)
2023-12-27T20:47:42.065 DEBUG:teuthology.provision.fog.smithi123:Requesting image smithi_ubuntu_22.04 (ID 6)
2023-12-27T20:47:42.096 INFO:teuthology.provision.fog.smithi121:Scheduling deploy of ubuntu 22.04
2023-12-27T20:47:42.116 INFO:teuthology.provision.fog.smithi123:Scheduling deploy of ubuntu 22.04
2023-12-27T20:47:42.384 INFO:teuthology.orchestra.console.smithi121:Power off
2023-12-27T20:47:42.384 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-27T20:47:42.399 INFO:teuthology.orchestra.console.smithi123:Power off
2023-12-27T20:47:42.399 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-27T20:47:42.408 DEBUG:teuthology.orchestra.console.smithi121:power off output: Chassis Power Control: Down/Off
2023-12-27T20:47:42.408 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-27T20:47:42.422 DEBUG:teuthology.orchestra.console.smithi123:power off output: Chassis Power Control: Down/Off
2023-12-27T20:47:42.422 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-27T20:47:42.430 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is on
2023-12-27T20:47:42.445 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on
2023-12-27T20:47:46.433 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-27T20:47:46.447 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-27T20:47:46.550 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is on
2023-12-27T20:47:46.561 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on
2023-12-27T20:47:50.553 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-27T20:47:50.563 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-27T20:47:50.663 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is off
2023-12-27T20:47:50.672 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on
2023-12-27T20:47:50.764 INFO:teuthology.orchestra.console.smithi121:Power off completed
2023-12-27T20:47:50.865 INFO:teuthology.orchestra.console.smithi121:Power on
2023-12-27T20:47:50.865 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-27T20:47:50.887 DEBUG:teuthology.orchestra.console.smithi121:power on output: Chassis Power Control: Up/On
2023-12-27T20:47:50.887 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-27T20:47:50.909 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is off
2023-12-27T20:47:54.673 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-27T20:47:54.783 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off
2023-12-27T20:47:54.884 INFO:teuthology.orchestra.console.smithi123:Power off completed
2023-12-27T20:47:54.910 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-27T20:47:54.985 INFO:teuthology.orchestra.console.smithi123:Power on
2023-12-27T20:47:54.986 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-27T20:47:55.009 DEBUG:teuthology.orchestra.console.smithi123:power on output: Chassis Power Control: Up/On
2023-12-27T20:47:55.009 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-27T20:47:55.022 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is off
2023-12-27T20:47:55.030 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off
2023-12-27T20:47:59.025 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-27T20:47:59.033 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-27T20:47:59.135 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is on
2023-12-27T20:47:59.141 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off
2023-12-27T20:47:59.237 INFO:teuthology.orchestra.console.smithi121:Power on completed
2023-12-27T20:47:59.338 INFO:teuthology.provision.fog.smithi121:Waiting for deploy to finish
2023-12-27T20:48:03.145 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-27T20:48:03.255 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on
2023-12-27T20:48:03.356 INFO:teuthology.orchestra.console.smithi123:Power on completed
2023-12-27T20:48:03.456 INFO:teuthology.provision.fog.smithi123:Waiting for deploy to finish
2023-12-27T20:51:04.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-27T20:51:07.441 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-12-27T20:51:13.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-27T20:51:15.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-27T20:51:16.530 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-12-27T20:51:18.449 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121
2023-12-27T20:51:22.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-27T20:51:24.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-27T20:51:25.585 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-12-27T20:51:27.509 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121
2023-12-27T20:51:31.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-27T20:51:33.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-27T20:51:34.641 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-12-27T20:51:36.597 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121
2023-12-27T20:51:40.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-27T20:51:42.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-27T20:51:43.701 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-12-27T20:51:45.681 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121
2023-12-27T20:51:49.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-27T20:51:51.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-27T20:51:52.789 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-12-27T20:51:54.737 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121
2023-12-27T20:51:58.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-27T20:52:00.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-27T20:52:01.873 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-12-27T20:52:07.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-27T20:52:39.314 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-12-27T20:52:45.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-27T20:52:45.320 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-12-27T20:52:51.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-27T20:52:51.328 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-12-27T20:52:57.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-27T20:52:57.336 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-12-27T20:53:00.745 WARNING:teuthology.provision.fog.smithi121:timed out
2023-12-27T20:53:03.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-27T20:53:03.340 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-12-27T20:53:06.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-27T20:53:06.752 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121
2023-12-27T20:53:09.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-27T20:53:09.541 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-27T20:53:09.541 DEBUG:teuthology.orchestra.run.smithi123:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-27T20:53:10.007 INFO:teuthology.provision.fog.smithi123:Node is ready
2023-12-27T20:53:10.007 DEBUG:teuthology.orchestra.run.smithi123:> hostname
2023-12-27T20:53:10.055 INFO:teuthology.orchestra.run.smithi123.stdout:smithi123.front.sepia.ceph.com
2023-12-27T20:53:10.056 DEBUG:teuthology.orchestra.run.smithi123:> grep smithi123.front.sepia.ceph.com /etc/hosts
2023-12-27T20:53:10.107 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123 smithi123.front.sepia.ceph.com smithi123
2023-12-27T20:53:10.108 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123
2023-12-27T20:53:10.220 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123.front.sepia.ceph.com/smithi123/g' /etc/hosts
2023-12-27T20:53:10.233 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/172.21.15.123/172.21.15.123/g' /etc/hosts
2023-12-27T20:53:10.292 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123.front.sepia.ceph.com/smithi123/g' /etc/hostname
2023-12-27T20:53:10.346 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123
2023-12-27T20:53:10.403 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release
2023-12-27T20:53:10.451 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-12-27T20:53:10.452 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="Ubuntu"
2023-12-27T20:53:10.452 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="22.04"
2023-12-27T20:53:10.452 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-12-27T20:53:10.452 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_CODENAME=jammy
2023-12-27T20:53:10.452 INFO:teuthology.orchestra.run.smithi123.stdout:ID=ubuntu
2023-12-27T20:53:10.452 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE=debian
2023-12-27T20:53:10.453 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://www.ubuntu.com/"
2023-12-27T20:53:10.453 INFO:teuthology.orchestra.run.smithi123.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-12-27T20:53:10.453 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-12-27T20:53:10.453 INFO:teuthology.orchestra.run.smithi123.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-12-27T20:53:10.453 INFO:teuthology.orchestra.run.smithi123.stdout:UBUNTU_CODENAME=jammy
2023-12-27T20:53:10.458 INFO:teuthology.provision.fog.smithi123:Deploy complete!
2023-12-27T20:53:10.460 DEBUG:teuthology.parallel:result is None
2023-12-27T20:53:12.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-27T20:53:12.963 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-27T20:53:12.964 DEBUG:teuthology.orchestra.run.smithi121:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-27T20:53:13.466 INFO:teuthology.provision.fog.smithi121:Node is ready
2023-12-27T20:53:13.467 DEBUG:teuthology.orchestra.run.smithi121:> hostname
2023-12-27T20:53:13.515 INFO:teuthology.orchestra.run.smithi121.stdout:smithi121.front.sepia.ceph.com
2023-12-27T20:53:13.516 DEBUG:teuthology.orchestra.run.smithi121:> grep smithi121.front.sepia.ceph.com /etc/hosts
2023-12-27T20:53:13.564 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121 smithi121.front.sepia.ceph.com smithi121
2023-12-27T20:53:13.564 DEBUG:teuthology.orchestra.run.smithi121:> sudo hostname smithi121
2023-12-27T20:53:13.682 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/smithi121.front.sepia.ceph.com/smithi121/g' /etc/hosts
2023-12-27T20:53:13.697 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/172.21.15.121/172.21.15.121/g' /etc/hosts
2023-12-27T20:53:13.752 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/smithi121.front.sepia.ceph.com/smithi121/g' /etc/hostname
2023-12-27T20:53:13.808 DEBUG:teuthology.orchestra.run.smithi121:> sudo hostname smithi121
2023-12-27T20:53:13.863 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release
2023-12-27T20:53:13.911 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-12-27T20:53:13.911 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="Ubuntu"
2023-12-27T20:53:13.911 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="22.04"
2023-12-27T20:53:13.911 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-12-27T20:53:13.912 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_CODENAME=jammy
2023-12-27T20:53:13.912 INFO:teuthology.orchestra.run.smithi121.stdout:ID=ubuntu
2023-12-27T20:53:13.912 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE=debian
2023-12-27T20:53:13.912 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://www.ubuntu.com/"
2023-12-27T20:53:13.912 INFO:teuthology.orchestra.run.smithi121.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-12-27T20:53:13.912 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-12-27T20:53:13.912 INFO:teuthology.orchestra.run.smithi121.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-12-27T20:53:13.912 INFO:teuthology.orchestra.run.smithi121.stdout:UBUNTU_CODENAME=jammy
2023-12-27T20:53:13.912 INFO:teuthology.provision.fog.smithi121:Deploy complete!
2023-12-27T20:53:13.913 DEBUG:teuthology.parallel:result is None
2023-12-27T20:53:14.126 INFO:teuthology.lock.ops:Checking smithi121.front.sepia.ceph.com
2023-12-27T20:53:14.126 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-27T20:53:14.156 INFO:teuthology.lock.ops:Checking smithi123.front.sepia.ceph.com
2023-12-27T20:53:14.156 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-27T20:53:14.182 INFO:teuthology.lock.ops:Updating [smithi121.front.sepia.ceph.com]: set os type and version on server
2023-12-27T20:53:14.182 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com'
2023-12-27T20:53:14.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-27T20:53:14.257 DEBUG:teuthology.orchestra.run.smithi121:> true
2023-12-27T20:53:14.365 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi121.front.sepia.ceph.com'
2023-12-27T20:53:14.365 DEBUG:teuthology.orchestra.run.smithi121:> uname -m
2023-12-27T20:53:14.411 INFO:teuthology.orchestra.run.smithi121.stdout:x86_64
2023-12-27T20:53:14.411 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release
2023-12-27T20:53:14.458 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-12-27T20:53:14.459 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="Ubuntu"
2023-12-27T20:53:14.459 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="22.04"
2023-12-27T20:53:14.459 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-12-27T20:53:14.459 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_CODENAME=jammy
2023-12-27T20:53:14.459 INFO:teuthology.orchestra.run.smithi121.stdout:ID=ubuntu
2023-12-27T20:53:14.459 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE=debian
2023-12-27T20:53:14.459 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://www.ubuntu.com/"
2023-12-27T20:53:14.459 INFO:teuthology.orchestra.run.smithi121.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-12-27T20:53:14.459 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-12-27T20:53:14.459 INFO:teuthology.orchestra.run.smithi121.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-12-27T20:53:14.459 INFO:teuthology.orchestra.run.smithi121.stdout:UBUNTU_CODENAME=jammy
2023-12-27T20:53:14.460 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server
2023-12-27T20:53:14.481 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: set os type and version on server
2023-12-27T20:53:14.481 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com'
2023-12-27T20:53:14.481 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-27T20:53:14.557 DEBUG:teuthology.orchestra.run.smithi123:> true
2023-12-27T20:53:14.670 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com'
2023-12-27T20:53:14.670 DEBUG:teuthology.orchestra.run.smithi123:> uname -m
2023-12-27T20:53:14.716 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64
2023-12-27T20:53:14.716 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release
2023-12-27T20:53:14.763 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-12-27T20:53:14.763 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="Ubuntu"
2023-12-27T20:53:14.763 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="22.04"
2023-12-27T20:53:14.763 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-12-27T20:53:14.763 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_CODENAME=jammy
2023-12-27T20:53:14.764 INFO:teuthology.orchestra.run.smithi123.stdout:ID=ubuntu
2023-12-27T20:53:14.764 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE=debian
2023-12-27T20:53:14.764 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://www.ubuntu.com/"
2023-12-27T20:53:14.764 INFO:teuthology.orchestra.run.smithi123.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-12-27T20:53:14.764 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-12-27T20:53:14.764 INFO:teuthology.orchestra.run.smithi123.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-12-27T20:53:14.764 INFO:teuthology.orchestra.run.smithi123.stdout:UBUNTU_CODENAME=jammy
2023-12-27T20:53:14.764 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server
2023-12-27T20:53:14.789 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-27T20:53:14.884 INFO:teuthology.dispatcher.supervisor:Running job 7502061
2023-12-27T20:53:14.884 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/virtualenv/bin/teuthology -v --owner scheduled_rfriedma@teuthology --archive /home/teuthworker/archive/rfriedma-2023-12-27_19:20:11-rados-wip-rf-active-primary-distro-default-smithi/7502061 --name rfriedma-2023-12-27_19:20:11-rados-wip-rf-active-primary-distro-default-smithi --description rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/rados_api_tests} -- /home/teuthworker/archive/rfriedma-2023-12-27_19:20:11-rados-wip-rf-active-primary-distro-default-smithi/7502061/orig.config.yaml
2023-12-27T20:53:14.887 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rfriedma-2023-12-27_19:20:11-rados-wip-rf-active-primary-distro-default-smithi/7502061
2023-12-27T20:53:14.888 INFO:teuthology.dispatcher.supervisor:Job PID: 3600100
2023-12-27T20:53:14.888 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-12-27T20:55:14.986 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-27T20:57:15.166 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-27T20:59:15.330 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-27T21:01:15.498 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-27T21:03:15.666 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-27T21:05:15.854 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-27T21:07:16.029 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-27T21:09:16.202 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-27T21:11:16.378 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-27T21:13:16.554 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-27T21:15:16.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-27T21:17:16.886 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-27T21:19:17.094 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-27T21:21:17.282 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-27T21:23:17.456 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-27T21:25:17.622 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-27T21:27:17.804 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-27T21:27:17.870 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-12-27T21:27:18.067 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-12-27T21:27:18.068 INFO:teuthology.nuke:Checking targets against current locks
2023-12-27T21:27:18.116 DEBUG:teuthology.nuke:shortname: smithi121
2023-12-27T21:27:18.117 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-27T21:27:18.140 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi121.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rfriedma-2023-12-27_19:20:11-rados-wip-rf-active-primary-distro-default-smithi/7502061', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-27 20:47:40.907822', 'locked_by': 'scheduled_rfriedma@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNoiLHgH2oMjA4FrIUMgTuXDkbTb4f+CRYKTds8941lDhZophE5wgWOj3SkNYZw8MBmdOV0U6xj1oM5+fSm908c='}
2023-12-27T21:27:18.143 DEBUG:teuthology.nuke:shortname: smithi123
2023-12-27T21:27:18.143 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-27T21:27:18.165 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rfriedma-2023-12-27_19:20:11-rados-wip-rf-active-primary-distro-default-smithi/7502061', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-27 20:47:40.909287', 'locked_by': 'scheduled_rfriedma@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNL/E3gaaqwmWzkcSEVPJGRY3g+aJOxGDmNUwQoqy3FKNUWHFPb9fjZEo7YnvLaB2k8GiZLi9OirxYpiVaRtNT8='}
2023-12-27T21:27:18.188 INFO:teuthology.orchestra.console.smithi121:Power off
2023-12-27T21:27:18.189 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-27T21:27:18.213 DEBUG:teuthology.orchestra.console.smithi121:power off output: Chassis Power Control: Down/Off
2023-12-27T21:27:18.214 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-27T21:27:18.231 INFO:teuthology.orchestra.console.smithi123:Power off
2023-12-27T21:27:18.231 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-27T21:27:18.241 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is off
2023-12-27T21:27:18.253 DEBUG:teuthology.orchestra.console.smithi123:power off output: Chassis Power Control: Down/Off
2023-12-27T21:27:18.254 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-27T21:27:18.276 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off
2023-12-27T21:27:18.342 INFO:teuthology.orchestra.console.smithi121:Power off completed
2023-12-27T21:27:18.378 INFO:teuthology.orchestra.console.smithi123:Power off completed
2023-12-27T21:27:18.495 INFO:teuthology.lock.ops:unlocked: smithi121.front.sepia.ceph.com
2023-12-27T21:27:18.519 INFO:teuthology.lock.ops:unlocked: smithi123.front.sepia.ceph.com