2023-12-11T19:46:20.587 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-11T19:46:20.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T19:46:20.730 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa4730e4940>, signals=[15]) 2023-12-11T19:46:20.730 INFO:teuthology.lock.ops:Start node 'smithi027.front.sepia.ceph.com' reimaging 2023-12-11T19:46:20.731 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: reset os type and version on server 2023-12-11T19:46:20.731 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2023-12-11T19:46:20.755 INFO:teuthology.lock.ops:Start node 'smithi203.front.sepia.ceph.com' reimaging 2023-12-11T19:46:20.755 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: reset os type and version on server 2023-12-11T19:46:20.755 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2023-12-11T19:46:20.884 DEBUG:teuthology.provision.fog.smithi027:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-12-11T19:46:20.898 DEBUG:teuthology.provision.fog.smithi203:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-12-11T19:46:20.930 INFO:teuthology.provision.fog.smithi027:Scheduling deploy of ubuntu 20.04 2023-12-11T19:46:20.941 INFO:teuthology.provision.fog.smithi203:Scheduling deploy of ubuntu 20.04 2023-12-11T19:46:21.281 INFO:teuthology.orchestra.console.smithi203:Power off 2023-12-11T19:46:21.282 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-11T19:46:21.293 INFO:teuthology.orchestra.console.smithi027:Power off 2023-12-11T19:46:21.293 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-11T19:46:21.303 DEBUG:teuthology.orchestra.console.smithi203:power off output: Chassis Power Control: Down/Off 2023-12-11T19:46:21.303 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T19:46:21.314 DEBUG:teuthology.orchestra.console.smithi027:power off output: Chassis Power Control: Down/Off 2023-12-11T19:46:21.315 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T19:46:21.325 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2023-12-11T19:46:21.335 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2023-12-11T19:46:25.330 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T19:46:25.337 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T19:46:25.439 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2023-12-11T19:46:25.445 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2023-12-11T19:46:29.443 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T19:46:29.453 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T19:46:29.555 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2023-12-11T19:46:29.566 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2023-12-11T19:46:29.656 INFO:teuthology.orchestra.console.smithi203:Power off completed 2023-12-11T19:46:29.757 INFO:teuthology.orchestra.console.smithi203:Power on 2023-12-11T19:46:29.758 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-11T19:46:29.794 DEBUG:teuthology.orchestra.console.smithi203:power on output: Chassis Power Control: Up/On 2023-12-11T19:46:29.794 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T19:46:29.822 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2023-12-11T19:46:33.570 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T19:46:33.679 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2023-12-11T19:46:33.780 INFO:teuthology.orchestra.console.smithi027:Power off completed 2023-12-11T19:46:33.823 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T19:46:33.882 INFO:teuthology.orchestra.console.smithi027:Power on 2023-12-11T19:46:33.882 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-11T19:46:33.905 DEBUG:teuthology.orchestra.console.smithi027:power on output: Chassis Power Control: Up/On 2023-12-11T19:46:33.906 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T19:46:33.927 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2023-12-11T19:46:33.932 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2023-12-11T19:46:37.930 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T19:46:37.937 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T19:46:38.040 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2023-12-11T19:46:38.046 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2023-12-11T19:46:38.147 INFO:teuthology.orchestra.console.smithi203:Power on completed 2023-12-11T19:46:38.247 INFO:teuthology.provision.fog.smithi203:Waiting for deploy to finish 2023-12-11T19:46:42.042 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T19:46:42.151 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2023-12-11T19:46:42.252 INFO:teuthology.orchestra.console.smithi027:Power on completed 2023-12-11T19:46:42.352 INFO:teuthology.provision.fog.smithi027:Waiting for deploy to finish 2023-12-11T19:50:24.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:50:27.522 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-12-11T19:50:33.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:50:36.578 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-12-11T19:50:42.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:50:45.666 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-12-11T19:50:51.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:50:54.754 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-12-11T19:51:00.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:51:03.810 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-12-11T19:51:09.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:51:12.870 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-12-11T19:51:13.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:51:16.706 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-12-11T19:51:18.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:51:21.954 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-12-11T19:51:22.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:51:25.762 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-12-11T19:51:27.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:51:31.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:51:34.819 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-12-11T19:51:40.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:51:43.874 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-12-11T19:51:49.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:51:52.930 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-12-11T19:51:58.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:52:01.986 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-12-11T19:52:07.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:52:11.075 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-12-11T19:52:17.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:52:20.130 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-12-11T19:52:26.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:52:27.963 WARNING:teuthology.provision.fog.smithi203:timed out 2023-12-11T19:52:29.186 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-12-11T19:52:33.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:52:34.175 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-11T19:52:34.175 DEBUG:teuthology.orchestra.run.smithi203:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-11T19:52:34.695 INFO:teuthology.provision.fog.smithi203:Node is ready 2023-12-11T19:52:34.695 DEBUG:teuthology.orchestra.run.smithi203:> hostname 2023-12-11T19:52:34.702 INFO:teuthology.orchestra.run.smithi203.stdout:smithi203.front.sepia.ceph.com 2023-12-11T19:52:34.702 DEBUG:teuthology.orchestra.run.smithi203:> grep smithi203.front.sepia.ceph.com /etc/hosts 2023-12-11T19:52:34.751 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.15.203 smithi203.front.sepia.ceph.com smithi203 2023-12-11T19:52:34.751 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203 2023-12-11T19:52:34.864 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hosts 2023-12-11T19:52:34.881 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/172.21.15.203/172.21.15.203/g' /etc/hosts 2023-12-11T19:52:34.892 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hostname 2023-12-11T19:52:34.903 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203 2023-12-11T19:52:34.957 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release 2023-12-11T19:52:34.964 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="Ubuntu" 2023-12-11T19:52:34.964 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-12-11T19:52:34.964 INFO:teuthology.orchestra.run.smithi203.stdout:ID=ubuntu 2023-12-11T19:52:34.965 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE=debian 2023-12-11T19:52:34.965 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-12-11T19:52:34.965 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="20.04" 2023-12-11T19:52:34.965 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-11T19:52:34.965 INFO:teuthology.orchestra.run.smithi203.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-11T19:52:34.965 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-11T19:52:34.965 INFO:teuthology.orchestra.run.smithi203.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-11T19:52:34.965 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_CODENAME=focal 2023-12-11T19:52:34.965 INFO:teuthology.orchestra.run.smithi203.stdout:UBUNTU_CODENAME=focal 2023-12-11T19:52:34.966 INFO:teuthology.provision.fog.smithi203:Deploy complete! 2023-12-11T19:52:34.967 DEBUG:teuthology.parallel:result is None 2023-12-11T19:52:35.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:52:38.246 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-12-11T19:52:44.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:52:47.330 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-12-11T19:52:53.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:52:56.418 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-12-11T19:53:02.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:53:20.994 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-12-11T19:53:26.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:53:30.054 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-12-11T19:53:36.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:53:39.138 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-12-11T19:53:45.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:53:45.931 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-11T19:53:45.932 DEBUG:teuthology.orchestra.run.smithi027:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-11T19:53:46.444 INFO:teuthology.provision.fog.smithi027:Node is ready 2023-12-11T19:53:46.444 DEBUG:teuthology.orchestra.run.smithi027:> hostname 2023-12-11T19:53:46.450 INFO:teuthology.orchestra.run.smithi027.stdout:smithi129 2023-12-11T19:53:46.450 DEBUG:teuthology.orchestra.run.smithi027:> grep smithi129 /etc/hosts 2023-12-11T19:53:46.499 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.129 smithi129 smithi129 2023-12-11T19:53:46.499 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname smithi027 2023-12-11T19:53:46.610 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/smithi129/smithi027/g' /etc/hosts 2023-12-11T19:53:46.628 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/172.21.15.129/172.21.15.27/g' /etc/hosts 2023-12-11T19:53:46.642 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/smithi129/smithi027/g' /etc/hostname 2023-12-11T19:53:46.701 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname smithi027 2023-12-11T19:53:46.716 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release 2023-12-11T19:53:46.722 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="Ubuntu" 2023-12-11T19:53:46.722 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-12-11T19:53:46.722 INFO:teuthology.orchestra.run.smithi027.stdout:ID=ubuntu 2023-12-11T19:53:46.722 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE=debian 2023-12-11T19:53:46.722 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-12-11T19:53:46.722 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="20.04" 2023-12-11T19:53:46.723 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-11T19:53:46.723 INFO:teuthology.orchestra.run.smithi027.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-11T19:53:46.723 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-11T19:53:46.723 INFO:teuthology.orchestra.run.smithi027.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-11T19:53:46.723 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_CODENAME=focal 2023-12-11T19:53:46.723 INFO:teuthology.orchestra.run.smithi027.stdout:UBUNTU_CODENAME=focal 2023-12-11T19:53:46.723 INFO:teuthology.provision.fog.smithi027:Deploy complete! 2023-12-11T19:53:46.724 DEBUG:teuthology.parallel:result is None 2023-12-11T19:53:46.959 INFO:teuthology.lock.ops:Checking smithi027.front.sepia.ceph.com 2023-12-11T19:53:46.960 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-11T19:53:46.986 INFO:teuthology.lock.ops:Checking smithi203.front.sepia.ceph.com 2023-12-11T19:53:46.986 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-11T19:53:47.004 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: set os type and version on server 2023-12-11T19:53:47.004 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-12-11T19:53:47.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:53:47.050 DEBUG:teuthology.orchestra.run.smithi027:> true 2023-12-11T19:53:47.181 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-12-11T19:53:47.181 DEBUG:teuthology.orchestra.run.smithi027:> uname -m 2023-12-11T19:53:47.186 INFO:teuthology.orchestra.run.smithi027.stdout:x86_64 2023-12-11T19:53:47.186 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release 2023-12-11T19:53:47.192 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="Ubuntu" 2023-12-11T19:53:47.192 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-12-11T19:53:47.192 INFO:teuthology.orchestra.run.smithi027.stdout:ID=ubuntu 2023-12-11T19:53:47.192 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE=debian 2023-12-11T19:53:47.193 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-12-11T19:53:47.193 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="20.04" 2023-12-11T19:53:47.193 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-11T19:53:47.193 INFO:teuthology.orchestra.run.smithi027.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-11T19:53:47.193 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-11T19:53:47.193 INFO:teuthology.orchestra.run.smithi027.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-11T19:53:47.193 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_CODENAME=focal 2023-12-11T19:53:47.193 INFO:teuthology.orchestra.run.smithi027.stdout:UBUNTU_CODENAME=focal 2023-12-11T19:53:47.193 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2023-12-11T19:53:47.219 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: set os type and version on server 2023-12-11T19:53:47.220 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2023-12-11T19:53:47.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:53:47.271 DEBUG:teuthology.orchestra.run.smithi203:> true 2023-12-11T19:53:47.476 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com' 2023-12-11T19:53:47.476 DEBUG:teuthology.orchestra.run.smithi203:> uname -m 2023-12-11T19:53:47.526 INFO:teuthology.orchestra.run.smithi203.stdout:x86_64 2023-12-11T19:53:47.526 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release 2023-12-11T19:53:47.533 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="Ubuntu" 2023-12-11T19:53:47.533 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-12-11T19:53:47.533 INFO:teuthology.orchestra.run.smithi203.stdout:ID=ubuntu 2023-12-11T19:53:47.533 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE=debian 2023-12-11T19:53:47.534 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-12-11T19:53:47.534 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="20.04" 2023-12-11T19:53:47.534 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-11T19:53:47.534 INFO:teuthology.orchestra.run.smithi203.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-11T19:53:47.535 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-11T19:53:47.535 INFO:teuthology.orchestra.run.smithi203.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-11T19:53:47.535 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_CODENAME=focal 2023-12-11T19:53:47.535 INFO:teuthology.orchestra.run.smithi203.stdout:UBUNTU_CODENAME=focal 2023-12-11T19:53:47.536 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2023-12-11T19:53:47.570 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T19:53:47.662 INFO:teuthology.dispatcher.supervisor:Running job 7487262 2023-12-11T19:53:47.663 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-11_16:41:51-rados-wip-yuri3-testing-2023-12-07-0727-distro-default-smithi/7487262 --name yuriw-2023-12-11_16:41:51-rados-wip-yuri3-testing-2023-12-07-0727-distro-default-smithi --description rados/upgrade/parallel/{0-random-distro$/{ubuntu_20.04} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} -- /home/teuthworker/archive/yuriw-2023-12-11_16:41:51-rados-wip-yuri3-testing-2023-12-07-0727-distro-default-smithi/7487262/orig.config.yaml 2023-12-11T19:53:47.666 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-11_16:41:51-rados-wip-yuri3-testing-2023-12-07-0727-distro-default-smithi/7487262 2023-12-11T19:53:47.666 INFO:teuthology.dispatcher.supervisor:Job PID: 1232938 2023-12-11T19:53:47.666 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-11T19:55:47.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T19:57:47.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T19:59:48.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:01:48.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:03:48.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:05:48.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:07:48.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:09:48.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:11:49.142 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:13:49.323 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:15:49.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:17:49.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:19:49.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:21:50.000 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:23:50.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:25:50.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:27:50.507 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:29:50.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:31:50.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:33:51.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:35:51.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:37:51.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:39:51.512 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:41:51.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:43:51.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:45:52.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:47:52.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:49:52.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:51:52.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:53:52.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:55:52.822 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:57:53.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:59:53.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:01:53.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:03:53.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:05:53.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:07:53.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:09:54.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:11:54.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:13:54.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:15:54.540 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:17:54.714 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:19:54.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:21:55.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:23:55.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:25:55.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:27:55.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:29:55.726 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:31:55.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:33:56.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:35:56.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:37:56.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:39:56.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:41:56.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:43:56.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:45:57.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:47:57.233 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:49:57.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:51:57.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:53:57.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:55:57.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:57:58.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:59:58.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T22:01:58.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T22:03:58.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T22:05:58.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T22:07:58.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T22:09:59.091 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T22:11:59.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T22:13:59.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T22:15:59.602 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T22:17:59.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T22:19:59.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T22:22:00.103 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T22:24:00.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T22:26:00.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T22:28:00.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T22:30:00.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T22:32:01.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T22:34:01.188 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T22:36:01.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T22:38:01.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T22:40:01.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T22:42:01.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T22:44:02.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T22:46:02.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T22:48:02.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T22:50:02.526 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T22:52:02.694 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T22:54:02.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T22:56:03.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T22:58:03.206 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T23:00:03.371 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T23:02:03.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T23:04:03.661 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T23:06:03.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T23:08:03.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T23:10:04.137 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T23:12:04.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T23:14:04.460 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T23:16:04.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T23:18:04.790 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T23:20:04.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T23:22:05.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T23:24:05.317 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T23:26:05.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T23:28:05.646 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T23:30:05.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T23:32:05.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T23:34:06.124 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T23:36:06.293 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T23:38:06.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T23:40:06.621 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T23:42:06.796 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T23:44:06.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T23:46:07.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T23:48:07.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T23:50:07.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T23:52:07.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T23:54:07.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T23:56:07.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T23:58:08.152 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T00:00:08.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T00:02:08.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T00:04:08.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T00:06:08.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T00:08:08.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T00:10:09.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T00:12:09.323 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T00:14:09.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T00:16:09.664 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T00:18:09.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T00:20:10.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T00:22:10.206 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T00:24:10.370 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T00:26:10.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T00:28:10.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T00:30:10.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T00:32:11.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T00:34:11.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T00:36:11.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T00:38:11.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T00:40:11.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T00:42:11.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T00:44:12.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T00:46:12.243 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T00:48:12.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T00:50:12.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T00:52:12.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T00:54:12.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T00:56:13.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T00:58:13.280 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T01:00:13.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T01:02:13.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T01:04:13.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T01:06:13.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T01:08:14.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T01:10:14.290 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T01:12:14.468 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T01:14:14.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T01:16:14.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T01:18:14.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T01:20:15.152 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T01:22:15.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T01:24:15.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T01:26:15.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T01:28:15.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T01:30:16.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T01:32:16.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T01:34:16.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T01:36:16.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T01:38:16.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T01:40:16.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T01:42:17.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T01:44:17.244 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T01:46:17.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T01:48:17.576 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T01:50:17.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T01:52:17.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T01:54:18.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T01:56:18.260 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T01:58:18.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T02:00:18.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T02:02:18.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T02:04:18.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T02:06:19.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T02:08:19.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T02:10:19.420 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T02:12:19.595 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T02:14:19.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T02:16:19.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T02:18:20.089 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T02:20:20.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T02:22:20.429 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T02:24:20.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T02:26:20.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T02:28:20.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T02:30:21.069 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T02:32:21.239 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T02:34:21.406 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T02:36:21.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T02:38:21.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T02:40:21.934 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T02:42:22.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T02:44:22.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T02:46:22.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T02:48:22.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T02:50:22.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T02:52:22.953 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T02:54:23.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T02:56:23.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T02:58:23.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T03:00:23.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T03:02:23.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T03:04:23.994 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T03:06:24.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T03:08:24.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T03:10:24.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T03:12:24.676 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T03:14:24.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T03:16:25.020 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T03:18:25.193 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T03:20:25.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T03:22:25.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T03:24:25.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T03:26:25.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T03:28:26.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T03:30:26.239 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T03:32:26.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T03:34:26.682 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T03:36:26.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T03:38:27.000 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T03:40:27.172 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T03:42:27.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T03:44:27.507 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T03:46:27.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T03:48:27.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T03:50:28.012 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T03:52:28.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T03:54:28.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T03:56:28.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T03:58:28.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T04:00:28.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T04:02:29.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T04:04:29.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T04:06:29.374 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T04:08:29.540 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T04:10:29.710 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T04:12:29.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T04:14:30.059 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T04:16:30.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T04:18:30.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T04:20:30.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T04:22:30.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T04:24:31.008 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T04:26:31.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T04:28:31.348 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T04:30:31.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T04:32:31.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T04:34:31.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T04:36:32.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T04:38:32.272 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T04:40:32.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T04:42:32.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T04:44:32.794 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T04:46:32.960 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T04:48:33.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T04:50:33.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T04:52:33.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T04:54:33.641 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T04:56:33.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T04:58:33.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T05:00:34.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T05:02:34.326 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T05:04:34.498 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T05:06:34.660 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T05:08:34.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T05:10:35.130 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T05:12:35.326 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T05:14:35.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T05:16:35.674 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T05:18:35.837 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T05:20:36.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T05:22:36.214 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T05:24:36.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T05:26:36.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T05:28:36.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T05:30:36.870 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T05:32:37.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T05:34:37.206 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T05:36:37.376 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T05:38:37.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T05:40:37.708 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T05:42:37.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T05:44:38.040 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T05:46:38.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T05:48:38.371 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T05:50:38.546 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T05:52:38.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T05:54:38.888 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T05:56:39.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T05:58:39.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T06:00:39.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T06:02:39.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T06:04:39.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T06:06:39.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T06:08:40.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T06:10:40.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T06:12:40.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T06:14:40.576 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T06:16:40.745 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T06:18:40.936 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T06:20:41.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T06:22:41.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T06:24:41.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T06:26:41.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T06:28:41.761 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T06:30:41.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T06:32:42.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T06:34:42.282 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T06:36:42.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T06:38:42.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T06:40:42.786 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T06:42:42.951 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T06:44:43.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T06:46:43.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T06:48:43.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T06:50:43.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T06:52:43.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T06:54:44.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T06:56:44.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T06:58:44.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T07:00:44.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T07:02:44.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T07:04:44.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T07:06:45.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T07:08:45.201 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T07:10:45.290 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T07:12:45.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T07:14:45.598 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T07:16:45.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T07:18:45.937 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T07:20:46.118 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T07:22:46.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T07:24:46.446 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T07:26:46.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T07:28:46.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T07:30:46.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T07:32:46.973 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T07:34:47.136 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T07:36:47.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T07:38:47.436 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T07:40:47.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T07:42:47.781 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T07:44:47.945 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T07:46:48.050 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T07:48:48.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T07:50:48.354 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T07:52:48.536 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T07:54:48.711 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2023-12-12T07:54:48.835 INFO:teuthology.kill:Killing Pids: {1232938} 2023-12-12T07:54:49.681 INFO:teuthology.task.internal:roles: ubuntu@smithi027.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a'] 2023-12-12T07:54:49.681 INFO:teuthology.task.internal:roles: ubuntu@smithi203.front.sepia.ceph.com - ['mon.b', 'mds.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b'] 2023-12-12T07:54:49.681 INFO:teuthology.misc:Compressing logs... 2023-12-12T07:54:49.681 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-12-12T07:54:49.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T07:54:49.776 DEBUG:teuthology.orchestra.run.smithi027:> true 2023-12-12T07:54:49.994 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-12-12T07:54:49.994 DEBUG:teuthology.orchestra.run.smithi027:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-12T07:54:50.037 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2023-12-12T07:54:50.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T07:54:50.122 DEBUG:teuthology.orchestra.run.smithi203:> true 2023-12-12T07:54:50.240 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com' 2023-12-12T07:54:50.240 DEBUG:teuthology.orchestra.run.smithi203:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-12T07:54:50.305 DEBUG:teuthology.misc:Transferring archived files from smithi027:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-11_16:41:51-rados-wip-yuri3-testing-2023-12-07-0727-distro-default-smithi/7487262/remote/smithi027/crash 2023-12-12T07:54:50.306 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-12T07:54:50.339 DEBUG:teuthology.misc:Transferring archived files from smithi203:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-11_16:41:51-rados-wip-yuri3-testing-2023-12-07-0727-distro-default-smithi/7487262/remote/smithi203/crash 2023-12-12T07:54:50.340 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-12T07:54:50.362 INFO:teuthology.misc:Compressing logs... 2023-12-12T07:54:50.363 DEBUG:teuthology.orchestra.run.smithi027:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-12T07:54:50.385 DEBUG:teuthology.orchestra.run.smithi203:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-12T07:54:50.411 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-12T07:54:50.412 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-12T07:54:50.421 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-12T07:54:50.422 INFO:teuthology.orchestra.run.smithi027.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: /home/ubuntu/cephtest/archive/syslog/misc.log: 49.8% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-12-12T07:54:50.423 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-12T07:54:50.423 INFO:teuthology.orchestra.run.smithi203.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: /home/ubuntu/cephtest/archive/syslog/misc.log: 51.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-12-12T07:54:50.535 INFO:teuthology.orchestra.run.smithi203.stderr: 88.9% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-12-12T07:54:50.643 INFO:teuthology.orchestra.run.smithi027.stderr: 92.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-12-12T07:54:50.645 DEBUG:teuthology.misc:Transferring archived files from smithi027:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-11_16:41:51-rados-wip-yuri3-testing-2023-12-07-0727-distro-default-smithi/7487262/remote/smithi027/ 2023-12-12T07:54:50.646 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-12T07:54:50.733 DEBUG:teuthology.misc:Transferring archived files from smithi203:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-11_16:41:51-rados-wip-yuri3-testing-2023-12-07-0727-distro-default-smithi/7487262/remote/smithi203/ 2023-12-12T07:54:50.733 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-12T07:54:50.771 INFO:teuthology.misc:Compressing logs... 2023-12-12T07:54:50.771 DEBUG:teuthology.orchestra.run.smithi027:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-12T07:54:50.773 DEBUG:teuthology.orchestra.run.smithi203:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-12T07:54:50.786 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-12T07:54:50.787 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-mon.a.log 2023-12-12T07:54:50.787 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-mds.a.log 2023-12-12T07:54:50.788 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-mgr.y.log 2023-12-12T07:54:50.788 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-mds.a.log: gzip /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-mon.a.log: -5 --verbose -- /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-mon.c.log 2023-12-12T07:54:50.789 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-osd.1.log 2023-12-12T07:54:50.789 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-mgr.y.log: /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-osd.0.log 2023-12-12T07:54:50.790 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-osd.3.log 2023-12-12T07:54:50.790 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-volume.log 2023-12-12T07:54:50.790 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-osd.1.log: /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-osd.2.log 2023-12-12T07:54:50.822 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-12T07:54:50.823 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-mon.b.log 2023-12-12T07:54:50.823 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-osd.5.log 2023-12-12T07:54:50.823 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-mgr.x.log 2023-12-12T07:54:50.824 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-osd.6.log 2023-12-12T07:54:50.825 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-mds.b.log 2023-12-12T07:54:50.825 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-mgr.x.log: /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-osd.4.log 2023-12-12T07:54:50.826 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-volume.log 2023-12-12T07:54:50.826 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-osd.4.log: 80.1% -- replaced with /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-mds.b.log.gz 2023-12-12T07:54:50.827 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-osd.7.log 2023-12-12T07:54:50.831 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-volume.log: /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-osd.7.log: 88.5% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-12T07:54:50.861 INFO:teuthology.orchestra.run.smithi203.stderr: 91.4% -- replaced with /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-volume.log.gz 2023-12-12T07:54:50.897 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-volume.log: /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-osd.2.log: 91.2% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-12T07:54:50.899 INFO:teuthology.orchestra.run.smithi027.stderr: 66.9% -- replaced with /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-mds.a.log.gz 2023-12-12T07:54:50.954 INFO:teuthology.orchestra.run.smithi203.stderr: 93.4% -- replaced with /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-mgr.x.log.gz 2023-12-12T07:54:51.045 INFO:teuthology.orchestra.run.smithi027.stderr: 91.4% -- replaced with /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-volume.log.gz 2023-12-12T07:54:58.661 INFO:teuthology.orchestra.run.smithi203.stderr:gzip: /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-mon.b.log: file size changed while zipping 2023-12-12T07:54:58.662 INFO:teuthology.orchestra.run.smithi203.stderr: 93.2% -- replaced with /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-mon.b.log.gz 2023-12-12T07:55:03.050 INFO:teuthology.orchestra.run.smithi027.stderr:gzip: /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-mgr.y.log: file size changed while zipping 2023-12-12T07:55:03.050 INFO:teuthology.orchestra.run.smithi027.stderr: 90.3% -- replaced with /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-mgr.y.log.gz 2023-12-12T07:55:21.059 INFO:teuthology.orchestra.run.smithi203.stderr:gzip: /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-osd.6.log: file size changed while zipping 2023-12-12T07:55:21.060 INFO:teuthology.orchestra.run.smithi203.stderr: 94.0% -- replaced with /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-osd.6.log.gz 2023-12-12T07:55:23.218 INFO:teuthology.orchestra.run.smithi203.stderr:gzip: /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-osd.4.log: file size changed while zipping 2023-12-12T07:55:23.219 INFO:teuthology.orchestra.run.smithi203.stderr: 93.9% -- replaced with /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-osd.4.log.gz 2023-12-12T07:55:25.784 INFO:teuthology.orchestra.run.smithi203.stderr:gzip: /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-osd.7.log: file size changed while zipping 2023-12-12T07:55:25.784 INFO:teuthology.orchestra.run.smithi203.stderr: 94.0% -- replaced with /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-osd.7.log.gz 2023-12-12T07:55:28.298 INFO:teuthology.orchestra.run.smithi203.stderr:gzip: /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-osd.5.log: file size changed while zipping 2023-12-12T07:55:28.299 INFO:teuthology.orchestra.run.smithi203.stderr: 94.2% -- replaced with /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-osd.5.log.gz 2023-12-12T07:55:29.030 INFO:teuthology.orchestra.run.smithi027.stderr:gzip: /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-mon.c.log: file size changed while zipping 2023-12-12T07:55:29.030 INFO:teuthology.orchestra.run.smithi027.stderr: 92.1% -- replaced with /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-mon.c.log.gz 2023-12-12T07:56:13.529 INFO:teuthology.orchestra.run.smithi027.stderr:gzip: /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-mon.a.log: file size changed while zipping 2023-12-12T07:56:13.529 INFO:teuthology.orchestra.run.smithi027.stderr: 90.2% -- replaced with /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-mon.a.log.gz 2023-12-12T07:56:16.799 INFO:teuthology.orchestra.run.smithi027.stderr:gzip: /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-osd.2.log: file size changed while zipping 2023-12-12T07:56:16.799 INFO:teuthology.orchestra.run.smithi027.stderr: 93.7% -- replaced with /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-osd.2.log.gz 2023-12-12T07:56:46.268 INFO:teuthology.orchestra.run.smithi027.stderr:gzip: /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-osd.1.log: file size changed while zipping 2023-12-12T07:56:46.269 INFO:teuthology.orchestra.run.smithi027.stderr: 93.9% -- replaced with /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-osd.1.log.gz 2023-12-12T07:56:50.718 INFO:teuthology.orchestra.run.smithi027.stderr:gzip: /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-osd.3.log: file size changed while zipping 2023-12-12T07:56:50.719 INFO:teuthology.orchestra.run.smithi027.stderr: 94.0% -- replaced with /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-osd.3.log.gz 2023-12-12T07:56:54.136 INFO:teuthology.orchestra.run.smithi027.stderr:gzip: /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-osd.0.log: file size changed while zipping 2023-12-12T07:56:54.136 INFO:teuthology.orchestra.run.smithi027.stderr: 94.3% -- replaced with /var/log/ceph/bcbad010-9860-11ee-95a3-87774f69a715/ceph-osd.0.log.gz 2023-12-12T07:56:54.138 DEBUG:teuthology.misc:Transferring archived files from smithi027:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-11_16:41:51-rados-wip-yuri3-testing-2023-12-07-0727-distro-default-smithi/7487262/remote/smithi027/log 2023-12-12T07:56:54.140 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-12T07:57:22.434 DEBUG:teuthology.misc:Transferring archived files from smithi203:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-11_16:41:51-rados-wip-yuri3-testing-2023-12-07-0727-distro-default-smithi/7487262/remote/smithi203/log 2023-12-12T07:57:22.435 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-12T07:57:42.823 INFO:teuthology.kill:No teuthology processes running 2023-12-12T07:57:42.824 ERROR:teuthology.dispatcher.supervisor:Failed to kill job and unlock machines Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/dispatcher/supervisor.py", line 331, in run_with_watchdog kill.kill_job( File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/kill.py", line 89, in kill_job if kill_processes(run_name, [job_info.get('pid')]): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/kill.py", line 210, in kill_processes if survivors: UnboundLocalError: local variable 'survivors' referenced before assignment 2023-12-12T07:57:42.825 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T07:59:42.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T07:59:43.156 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2023-12-12T07:59:43.269 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-12T07:59:43.270 INFO:teuthology.nuke:Checking targets against current locks 2023-12-12T07:59:43.323 DEBUG:teuthology.nuke:shortname: smithi027 2023-12-12T07:59:43.323 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-12T07:59:43.339 DEBUG:teuthology.nuke:shortname: smithi203 2023-12-12T07:59:43.340 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-12T07:59:43.343 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi027.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-11_16:41:51-rados-wip-yuri3-testing-2023-12-07-0727-distro-default-smithi/7487262', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-11 19:46:19.745488', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-12-12T07:59:43.367 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi203.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-11_16:41:51-rados-wip-yuri3-testing-2023-12-07-0727-distro-default-smithi/7487262', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-11 19:46:19.747104', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-12-12T07:59:43.398 INFO:teuthology.orchestra.console.smithi027:Power off 2023-12-12T07:59:43.398 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-12T07:59:43.423 DEBUG:teuthology.orchestra.console.smithi027:power off output: Chassis Power Control: Down/Off 2023-12-12T07:59:43.424 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T07:59:43.441 INFO:teuthology.orchestra.console.smithi203:Power off 2023-12-12T07:59:43.441 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-12T07:59:43.449 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2023-12-12T07:59:43.462 DEBUG:teuthology.orchestra.console.smithi203:power off output: Chassis Power Control: Down/Off 2023-12-12T07:59:43.463 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T07:59:43.487 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2023-12-12T07:59:47.454 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T07:59:47.487 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T07:59:47.563 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2023-12-12T07:59:47.596 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2023-12-12T07:59:51.566 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T07:59:51.597 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T07:59:51.677 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2023-12-12T07:59:51.707 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2023-12-12T07:59:51.779 INFO:teuthology.orchestra.console.smithi027:Power off completed 2023-12-12T07:59:51.934 INFO:teuthology.lock.ops:unlocked: smithi027.front.sepia.ceph.com 2023-12-12T07:59:55.711 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T07:59:55.822 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2023-12-12T07:59:55.923 INFO:teuthology.orchestra.console.smithi203:Power off completed 2023-12-12T07:59:56.084 INFO:teuthology.lock.ops:unlocked: smithi203.front.sepia.ceph.com