2024-01-28T01:53:22.736 INFO:root:teuthology version: 0.0.1.dev251+gc856e0f
2024-01-28T01:53:22.736 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T01:53:22.908 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f230f9c1f70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f2310a27c10>, signals=[15])
2024-01-28T01:53:22.908 INFO:teuthology.lock.ops:Start node 'smithi072.front.sepia.ceph.com' reimaging
2024-01-28T01:53:22.908 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: reset os type and version on server
2024-01-28T01:53:22.908 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server
2024-01-28T01:53:22.935 INFO:teuthology.lock.ops:Start node 'smithi143.front.sepia.ceph.com' reimaging
2024-01-28T01:53:22.935 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: reset os type and version on server
2024-01-28T01:53:22.935 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server
2024-01-28T01:53:22.960 INFO:teuthology.lock.ops:Start node 'smithi187.front.sepia.ceph.com' reimaging
2024-01-28T01:53:22.960 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: reset os type and version on server
2024-01-28T01:53:22.960 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server
2024-01-28T01:53:23.058 DEBUG:teuthology.provision.fog.smithi072:Requesting image smithi_ubuntu_20.04 (ID 2)
2024-01-28T01:53:23.081 DEBUG:teuthology.provision.fog.smithi143:Requesting image smithi_ubuntu_20.04 (ID 2)
2024-01-28T01:53:23.101 DEBUG:teuthology.provision.fog.smithi187:Requesting image smithi_ubuntu_20.04 (ID 2)
2024-01-28T01:53:23.118 INFO:teuthology.provision.fog.smithi072:Scheduling deploy of ubuntu 20.04
2024-01-28T01:53:23.128 INFO:teuthology.provision.fog.smithi143:Scheduling deploy of ubuntu 20.04
2024-01-28T01:53:23.150 INFO:teuthology.provision.fog.smithi187:Scheduling deploy of ubuntu 20.04
2024-01-28T01:53:23.339 INFO:teuthology.orchestra.console.smithi072:Power off
2024-01-28T01:53:23.340 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-28T01:53:23.354 INFO:teuthology.orchestra.console.smithi187:Power off
2024-01-28T01:53:23.355 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-28T01:53:23.365 INFO:teuthology.orchestra.console.smithi143:Power off
2024-01-28T01:53:23.365 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-28T01:53:23.373 DEBUG:teuthology.orchestra.console.smithi072:power off output: Chassis Power Control: Down/Off
2024-01-28T01:53:23.373 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-28T01:53:23.382 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off
2024-01-28T01:53:23.382 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-28T01:53:23.390 DEBUG:teuthology.orchestra.console.smithi143:power off output: Chassis Power Control: Down/Off
2024-01-28T01:53:23.390 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-28T01:53:23.398 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on
2024-01-28T01:53:23.403 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on
2024-01-28T01:53:23.413 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on
2024-01-28T01:53:27.403 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-28T01:53:27.410 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-28T01:53:27.420 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-28T01:53:27.513 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on
2024-01-28T01:53:27.522 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on
2024-01-28T01:53:27.528 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on
2024-01-28T01:53:31.518 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-28T01:53:31.525 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-28T01:53:31.533 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-28T01:53:31.628 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off
2024-01-28T01:53:31.635 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off
2024-01-28T01:53:31.640 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off
2024-01-28T01:53:31.729 INFO:teuthology.orchestra.console.smithi072:Power off completed
2024-01-28T01:53:31.736 INFO:teuthology.orchestra.console.smithi187:Power off completed
2024-01-28T01:53:31.742 INFO:teuthology.orchestra.console.smithi143:Power off completed
2024-01-28T01:53:31.830 INFO:teuthology.orchestra.console.smithi072:Power on
2024-01-28T01:53:31.830 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-28T01:53:31.837 INFO:teuthology.orchestra.console.smithi187:Power on
2024-01-28T01:53:31.837 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-28T01:53:31.843 INFO:teuthology.orchestra.console.smithi143:Power on
2024-01-28T01:53:31.843 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-28T01:53:31.852 DEBUG:teuthology.orchestra.console.smithi072:power on output: Chassis Power Control: Up/On
2024-01-28T01:53:31.852 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-28T01:53:31.860 DEBUG:teuthology.orchestra.console.smithi187:power on output: Chassis Power Control: Up/On
2024-01-28T01:53:31.860 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-28T01:53:31.868 DEBUG:teuthology.orchestra.console.smithi143:power on output: Chassis Power Control: Up/On
2024-01-28T01:53:31.868 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-28T01:53:31.876 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off
2024-01-28T01:53:31.882 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off
2024-01-28T01:53:31.887 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off
2024-01-28T01:53:35.881 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-28T01:53:35.887 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-28T01:53:35.892 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-28T01:53:35.989 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off
2024-01-28T01:53:35.995 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off
2024-01-28T01:53:36.001 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off
2024-01-28T01:53:39.993 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-28T01:53:40.001 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-28T01:53:40.008 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-28T01:53:40.103 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on
2024-01-28T01:53:40.110 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on
2024-01-28T01:53:40.117 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on
2024-01-28T01:53:40.204 INFO:teuthology.orchestra.console.smithi072:Power on completed
2024-01-28T01:53:40.210 INFO:teuthology.orchestra.console.smithi187:Power on completed
2024-01-28T01:53:40.218 INFO:teuthology.orchestra.console.smithi143:Power on completed
2024-01-28T01:53:40.305 INFO:teuthology.provision.fog.smithi072:Waiting for deploy to finish
2024-01-28T01:53:40.311 INFO:teuthology.provision.fog.smithi187:Waiting for deploy to finish
2024-01-28T01:53:40.319 INFO:teuthology.provision.fog.smithi143:Waiting for deploy to finish
2024-01-28T01:57:26.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-28T01:57:26.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-28T01:57:44.892 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143
2024-01-28T01:57:44.892 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187
2024-01-28T01:57:50.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-28T01:57:50.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-28T01:57:53.984 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143
2024-01-28T01:57:53.984 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187
2024-01-28T01:57:59.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-28T01:57:59.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-28T01:58:03.068 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143
2024-01-28T01:58:03.069 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187
2024-01-28T01:58:09.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-28T01:58:09.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-28T01:58:12.124 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143
2024-01-28T01:58:12.124 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187
2024-01-28T01:58:18.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-28T01:58:18.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-28T01:58:50.081 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-28T01:58:50.082 DEBUG:teuthology.orchestra.run.smithi187:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-28T01:59:10.953 INFO:teuthology.provision.fog.smithi187:Node is ready
2024-01-28T01:59:10.953 DEBUG:teuthology.orchestra.run.smithi187:> hostname
2024-01-28T01:59:10.960 INFO:teuthology.orchestra.run.smithi187.stdout:smithi129
2024-01-28T01:59:10.960 DEBUG:teuthology.orchestra.run.smithi187:> grep smithi129 /etc/hosts
2024-01-28T01:59:10.967 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.15.129 smithi129 smithi129
2024-01-28T01:59:10.968 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187
2024-01-28T01:59:11.044 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi129/smithi187/g' /etc/hosts
2024-01-28T01:59:11.061 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/172.21.15.129/172.21.15.187/g' /etc/hosts
2024-01-28T01:59:11.117 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi129/smithi187/g' /etc/hostname
2024-01-28T01:59:11.129 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187
2024-01-28T01:59:11.141 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release
2024-01-28T01:59:11.191 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="Ubuntu"
2024-01-28T01:59:11.191 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2024-01-28T01:59:11.191 INFO:teuthology.orchestra.run.smithi187.stdout:ID=ubuntu
2024-01-28T01:59:11.191 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE=debian
2024-01-28T01:59:11.191 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2024-01-28T01:59:11.192 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="20.04"
2024-01-28T01:59:11.192 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-28T01:59:11.192 INFO:teuthology.orchestra.run.smithi187.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-28T01:59:11.192 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-28T01:59:11.192 INFO:teuthology.orchestra.run.smithi187.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-28T01:59:11.192 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_CODENAME=focal
2024-01-28T01:59:11.192 INFO:teuthology.orchestra.run.smithi187.stdout:UBUNTU_CODENAME=focal
2024-01-28T01:59:11.193 INFO:teuthology.provision.fog.smithi187:Deploy complete!
2024-01-28T01:59:11.195 DEBUG:teuthology.parallel:result is None
2024-01-28T01:59:11.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-28T01:59:18.140 WARNING:teuthology.provision.fog.smithi143:timed out
2024-01-28T01:59:24.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-28T01:59:24.387 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-28T01:59:24.387 DEBUG:teuthology.orchestra.run.smithi143:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-28T01:59:24.849 INFO:teuthology.provision.fog.smithi143:Node is ready
2024-01-28T01:59:24.850 DEBUG:teuthology.orchestra.run.smithi143:> hostname
2024-01-28T01:59:24.856 INFO:teuthology.orchestra.run.smithi143.stdout:smithi143.front.sepia.ceph.com
2024-01-28T01:59:24.856 DEBUG:teuthology.orchestra.run.smithi143:> grep smithi143.front.sepia.ceph.com /etc/hosts
2024-01-28T01:59:24.863 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.15.143 smithi143.front.sepia.ceph.com smithi143
2024-01-28T01:59:24.863 DEBUG:teuthology.orchestra.run.smithi143:> sudo hostname smithi143
2024-01-28T01:59:25.021 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/smithi143.front.sepia.ceph.com/smithi143/g' /etc/hosts
2024-01-28T01:59:25.038 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/172.21.15.143/172.21.15.143/g' /etc/hosts
2024-01-28T01:59:25.050 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/smithi143.front.sepia.ceph.com/smithi143/g' /etc/hostname
2024-01-28T01:59:25.108 DEBUG:teuthology.orchestra.run.smithi143:> sudo hostname smithi143
2024-01-28T01:59:25.119 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release
2024-01-28T01:59:25.124 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="Ubuntu"
2024-01-28T01:59:25.124 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2024-01-28T01:59:25.125 INFO:teuthology.orchestra.run.smithi143.stdout:ID=ubuntu
2024-01-28T01:59:25.125 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE=debian
2024-01-28T01:59:25.125 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2024-01-28T01:59:25.125 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="20.04"
2024-01-28T01:59:25.125 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-28T01:59:25.125 INFO:teuthology.orchestra.run.smithi143.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-28T01:59:25.125 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-28T01:59:25.125 INFO:teuthology.orchestra.run.smithi143.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-28T01:59:25.125 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_CODENAME=focal
2024-01-28T01:59:25.125 INFO:teuthology.orchestra.run.smithi143.stdout:UBUNTU_CODENAME=focal
2024-01-28T01:59:25.125 INFO:teuthology.provision.fog.smithi143:Deploy complete!
2024-01-28T01:59:25.126 DEBUG:teuthology.parallel:result is None
2024-01-28T01:59:30.364 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72
2024-01-28T01:59:36.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-28T01:59:39.420 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72
2024-01-28T01:59:45.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-28T01:59:48.476 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72
2024-01-28T01:59:54.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-28T01:59:57.532 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72
2024-01-28T02:00:03.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-28T02:01:03.584 WARNING:teuthology.provision.fog.smithi072:timed out
2024-01-28T02:01:09.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-28T02:01:09.837 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-28T02:01:09.837 DEBUG:teuthology.orchestra.run.smithi072:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-28T02:01:10.430 INFO:teuthology.provision.fog.smithi072:Node is ready
2024-01-28T02:01:10.430 DEBUG:teuthology.orchestra.run.smithi072:> hostname
2024-01-28T02:01:10.436 INFO:teuthology.orchestra.run.smithi072.stdout:smithi072.front.sepia.ceph.com
2024-01-28T02:01:10.437 DEBUG:teuthology.orchestra.run.smithi072:> grep smithi072.front.sepia.ceph.com /etc/hosts
2024-01-28T02:01:10.444 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72 smithi072.front.sepia.ceph.com smithi072
2024-01-28T02:01:10.444 DEBUG:teuthology.orchestra.run.smithi072:> sudo hostname smithi072
2024-01-28T02:01:10.593 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/smithi072.front.sepia.ceph.com/smithi072/g' /etc/hosts
2024-01-28T02:01:10.608 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/172.21.15.72/172.21.15.72/g' /etc/hosts
2024-01-28T02:01:10.618 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/smithi072.front.sepia.ceph.com/smithi072/g' /etc/hostname
2024-01-28T02:01:10.630 DEBUG:teuthology.orchestra.run.smithi072:> sudo hostname smithi072
2024-01-28T02:01:10.684 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release
2024-01-28T02:01:10.689 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="Ubuntu"
2024-01-28T02:01:10.689 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2024-01-28T02:01:10.689 INFO:teuthology.orchestra.run.smithi072.stdout:ID=ubuntu
2024-01-28T02:01:10.689 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE=debian
2024-01-28T02:01:10.689 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2024-01-28T02:01:10.689 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="20.04"
2024-01-28T02:01:10.689 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-28T02:01:10.689 INFO:teuthology.orchestra.run.smithi072.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-28T02:01:10.689 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-28T02:01:10.689 INFO:teuthology.orchestra.run.smithi072.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-28T02:01:10.689 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_CODENAME=focal
2024-01-28T02:01:10.689 INFO:teuthology.orchestra.run.smithi072.stdout:UBUNTU_CODENAME=focal
2024-01-28T02:01:10.690 INFO:teuthology.provision.fog.smithi072:Deploy complete!
2024-01-28T02:01:10.690 DEBUG:teuthology.parallel:result is None
2024-01-28T02:01:10.985 INFO:teuthology.lock.ops:Checking smithi072.front.sepia.ceph.com
2024-01-28T02:01:10.986 INFO:teuthology.lock.ops:Checking smithi143.front.sepia.ceph.com
2024-01-28T02:01:10.986 INFO:teuthology.lock.ops:Checking smithi187.front.sepia.ceph.com
2024-01-28T02:01:10.987 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: set os type and version on server
2024-01-28T02:01:10.988 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com'
2024-01-28T02:01:10.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-28T02:01:11.085 DEBUG:teuthology.orchestra.run.smithi072:> true
2024-01-28T02:01:11.209 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com'
2024-01-28T02:01:11.210 DEBUG:teuthology.orchestra.run.smithi072:> uname -m
2024-01-28T02:01:11.215 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64
2024-01-28T02:01:11.215 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release
2024-01-28T02:01:11.221 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="Ubuntu"
2024-01-28T02:01:11.221 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2024-01-28T02:01:11.221 INFO:teuthology.orchestra.run.smithi072.stdout:ID=ubuntu
2024-01-28T02:01:11.221 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE=debian
2024-01-28T02:01:11.221 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2024-01-28T02:01:11.221 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="20.04"
2024-01-28T02:01:11.221 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-28T02:01:11.221 INFO:teuthology.orchestra.run.smithi072.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-28T02:01:11.221 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-28T02:01:11.221 INFO:teuthology.orchestra.run.smithi072.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-28T02:01:11.221 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_CODENAME=focal
2024-01-28T02:01:11.222 INFO:teuthology.orchestra.run.smithi072.stdout:UBUNTU_CODENAME=focal
2024-01-28T02:01:11.222 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server
2024-01-28T02:01:11.242 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: set os type and version on server
2024-01-28T02:01:11.242 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com'
2024-01-28T02:01:11.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-28T02:01:11.340 DEBUG:teuthology.orchestra.run.smithi143:> true
2024-01-28T02:01:11.541 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi143.front.sepia.ceph.com'
2024-01-28T02:01:11.541 DEBUG:teuthology.orchestra.run.smithi143:> uname -m
2024-01-28T02:01:11.548 INFO:teuthology.orchestra.run.smithi143.stdout:x86_64
2024-01-28T02:01:11.548 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release
2024-01-28T02:01:11.596 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="Ubuntu"
2024-01-28T02:01:11.596 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2024-01-28T02:01:11.596 INFO:teuthology.orchestra.run.smithi143.stdout:ID=ubuntu
2024-01-28T02:01:11.596 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE=debian
2024-01-28T02:01:11.597 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2024-01-28T02:01:11.597 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="20.04"
2024-01-28T02:01:11.597 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-28T02:01:11.597 INFO:teuthology.orchestra.run.smithi143.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-28T02:01:11.597 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-28T02:01:11.597 INFO:teuthology.orchestra.run.smithi143.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-28T02:01:11.597 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_CODENAME=focal
2024-01-28T02:01:11.597 INFO:teuthology.orchestra.run.smithi143.stdout:UBUNTU_CODENAME=focal
2024-01-28T02:01:11.597 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server
2024-01-28T02:01:11.616 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: set os type and version on server
2024-01-28T02:01:11.617 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com'
2024-01-28T02:01:11.617 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-28T02:01:11.717 DEBUG:teuthology.orchestra.run.smithi187:> true
2024-01-28T02:01:11.921 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com'
2024-01-28T02:01:11.921 DEBUG:teuthology.orchestra.run.smithi187:> uname -m
2024-01-28T02:01:11.928 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64
2024-01-28T02:01:11.928 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release
2024-01-28T02:01:11.934 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="Ubuntu"
2024-01-28T02:01:11.934 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2024-01-28T02:01:11.934 INFO:teuthology.orchestra.run.smithi187.stdout:ID=ubuntu
2024-01-28T02:01:11.934 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE=debian
2024-01-28T02:01:11.934 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2024-01-28T02:01:11.934 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="20.04"
2024-01-28T02:01:11.935 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-28T02:01:11.935 INFO:teuthology.orchestra.run.smithi187.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-28T02:01:11.935 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-28T02:01:11.935 INFO:teuthology.orchestra.run.smithi187.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-28T02:01:11.935 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_CODENAME=focal
2024-01-28T02:01:11.935 INFO:teuthology.orchestra.run.smithi187.stdout:UBUNTU_CODENAME=focal
2024-01-28T02:01:11.935 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server
2024-01-28T02:01:11.958 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T02:01:12.056 INFO:teuthology.dispatcher.supervisor:Running job 7535701
2024-01-28T02:01:12.056 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-01-28_01:35:07-upgrade:quincy-p2p-quincy-distro-default-smithi/7535701 --name teuthology-2024-01-28_01:35:07-upgrade:quincy-p2p-quincy-distro-default-smithi --description upgrade:quincy-p2p/quincy-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/quincy 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-final-workload/{rbd-python snaps-many-objects} objectstore/bluestore-stupid supported-all-distro/ubuntu_latest thrashosds-health} -- /home/teuthworker/archive/teuthology-2024-01-28_01:35:07-upgrade:quincy-p2p-quincy-distro-default-smithi/7535701/orig.config.yaml
2024-01-28T02:01:12.060 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-01-28_01:35:07-upgrade:quincy-p2p-quincy-distro-default-smithi/7535701
2024-01-28T02:01:12.060 INFO:teuthology.dispatcher.supervisor:Job PID: 3164337
2024-01-28T02:01:12.060 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-01-28T02:03:12.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T02:05:12.329 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T02:07:12.496 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T02:09:12.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T02:11:12.764 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T02:13:12.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T02:15:13.096 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T02:17:13.243 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T02:19:13.404 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T02:21:13.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T02:23:13.708 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T02:25:13.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T02:27:13.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T02:29:14.089 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T02:31:14.245 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T02:33:14.364 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T02:35:14.530 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T02:37:14.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T02:39:14.828 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T02:41:14.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T02:43:15.162 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T02:45:15.340 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T02:47:15.480 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T02:49:15.641 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T02:51:15.816 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T02:53:15.965 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T02:55:16.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T02:57:16.300 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T02:59:16.460 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T03:01:16.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T03:03:16.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T03:05:16.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T03:07:17.176 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T03:09:17.344 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T03:11:17.500 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T03:13:17.670 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T03:15:17.842 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T03:17:18.004 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T03:19:18.109 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T03:21:18.264 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T03:23:18.442 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T03:25:18.572 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T03:27:18.734 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T03:29:18.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T03:31:19.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T03:33:19.224 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T03:35:19.384 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T03:37:19.569 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T03:39:19.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T03:41:19.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T03:43:20.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T03:45:20.234 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T03:47:20.398 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T03:49:20.568 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T03:51:20.766 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T03:53:20.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T03:55:21.076 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T03:57:21.232 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T03:59:21.398 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T04:01:21.560 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T04:03:21.724 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T04:05:21.884 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T04:07:22.045 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T04:09:22.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T04:11:22.389 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T04:13:22.556 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T04:15:22.732 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T04:17:22.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T04:19:23.049 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T04:21:23.217 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T04:23:23.386 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T04:25:23.548 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T04:27:23.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T04:29:23.868 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T04:31:24.033 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T04:33:24.201 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T04:35:24.365 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T04:37:24.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T04:39:24.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T04:41:24.848 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T04:43:25.010 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T04:45:25.145 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T04:47:25.308 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T04:49:25.396 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T04:51:25.560 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T04:53:25.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T04:55:25.880 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T04:57:26.052 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T04:59:26.228 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T05:01:26.392 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T05:03:26.560 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T05:05:26.716 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T05:07:26.881 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T05:09:27.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T05:11:27.173 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T05:13:27.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T05:15:27.510 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T05:17:27.666 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T05:19:27.813 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T05:21:27.972 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T05:23:28.146 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T05:25:28.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T05:27:28.448 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T05:29:28.604 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T05:31:28.777 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T05:33:28.946 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T05:35:29.120 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T05:37:29.264 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T05:39:29.436 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T05:41:29.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T05:43:29.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T05:45:29.920 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T05:47:30.091 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T05:49:30.260 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T05:51:30.428 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T05:53:30.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T05:55:30.780 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T05:57:30.944 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T05:59:31.105 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T06:01:31.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T06:03:31.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T06:05:31.577 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T06:07:31.726 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T06:09:31.893 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T06:11:32.056 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T06:13:32.233 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T06:15:32.404 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T06:17:32.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T06:19:32.788 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T06:21:32.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T06:23:33.125 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T06:25:33.270 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T06:27:33.441 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T06:29:33.605 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T06:31:33.777 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T06:33:33.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T06:35:34.136 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T06:37:34.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T06:39:34.496 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T06:41:34.670 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T06:43:34.885 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T06:45:35.056 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T06:47:35.240 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T06:49:35.438 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T06:51:35.569 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T06:53:35.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T06:55:35.922 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T06:57:36.076 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T06:59:36.248 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T07:01:36.412 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T07:03:36.558 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T07:05:36.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T07:07:36.890 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T07:09:37.056 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T07:11:37.237 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T07:13:37.401 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T07:15:37.572 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T07:17:37.761 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T07:19:37.928 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T07:21:38.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T07:23:38.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T07:25:38.437 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T07:27:38.612 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T07:29:38.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T07:31:38.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T07:33:39.120 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T07:35:39.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T07:37:39.496 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T07:39:39.666 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T07:41:39.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T07:43:39.994 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T07:45:40.162 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T07:47:40.334 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T07:49:40.504 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T07:51:40.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T07:53:40.784 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T07:53:40.856 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-01-28T07:53:41.077 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2024-01-28T07:53:41.077 INFO:teuthology.nuke:Checking targets against current locks
2024-01-28T07:53:41.122 DEBUG:teuthology.nuke:shortname: smithi072
2024-01-28T07:53:41.123 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-28T07:53:41.150 DEBUG:teuthology.nuke:shortname: smithi143
2024-01-28T07:53:41.150 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-28T07:53:41.155 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-01-28_01:35:07-upgrade:quincy-p2p-quincy-distro-default-smithi/7535701', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-28 01:53:21.667950', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}
2024-01-28T07:53:41.177 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi143.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-01-28_01:35:07-upgrade:quincy-p2p-quincy-distro-default-smithi/7535701', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-28 01:53:21.666772', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}
2024-01-28T07:53:41.182 DEBUG:teuthology.nuke:shortname: smithi187
2024-01-28T07:53:41.182 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-28T07:53:41.216 INFO:teuthology.orchestra.console.smithi072:Power off
2024-01-28T07:53:41.216 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-28T07:53:41.223 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi187.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-01-28_01:35:07-upgrade:quincy-p2p-quincy-distro-default-smithi/7535701', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-28 01:53:21.668917', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}
2024-01-28T07:53:41.240 DEBUG:teuthology.orchestra.console.smithi072:power off output: Chassis Power Control: Down/Off
2024-01-28T07:53:41.240 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-28T07:53:41.255 INFO:teuthology.orchestra.console.smithi143:Power off
2024-01-28T07:53:41.255 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-28T07:53:41.265 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off
2024-01-28T07:53:41.274 DEBUG:teuthology.orchestra.console.smithi143:power off output: Chassis Power Control: Down/Off
2024-01-28T07:53:41.275 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-28T07:53:41.290 INFO:teuthology.orchestra.console.smithi187:Power off
2024-01-28T07:53:41.291 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-28T07:53:41.300 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off
2024-01-28T07:53:41.314 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off
2024-01-28T07:53:41.314 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-28T07:53:41.335 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off
2024-01-28T07:53:41.365 INFO:teuthology.orchestra.console.smithi072:Power off completed
2024-01-28T07:53:41.401 INFO:teuthology.orchestra.console.smithi143:Power off completed
2024-01-28T07:53:41.436 INFO:teuthology.orchestra.console.smithi187:Power off completed
2024-01-28T07:53:41.513 INFO:teuthology.lock.ops:unlocked: smithi072.front.sepia.ceph.com
2024-01-28T07:53:41.546 INFO:teuthology.lock.ops:unlocked: smithi143.front.sepia.ceph.com
2024-01-28T07:53:41.579 INFO:teuthology.lock.ops:unlocked: smithi187.front.sepia.ceph.com