2023-12-15T20:56:27.473 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-15T20:56:27.474 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T20:56:27.625 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f85b7c28940>, signals=[15]) 2023-12-15T20:56:27.625 INFO:teuthology.lock.ops:Start node 'smithi031.front.sepia.ceph.com' reimaging 2023-12-15T20:56:27.625 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: reset os type and version on server 2023-12-15T20:56:27.626 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2023-12-15T20:56:27.646 INFO:teuthology.lock.ops:Start node 'smithi089.front.sepia.ceph.com' reimaging 2023-12-15T20:56:27.647 INFO:teuthology.lock.ops:Updating [smithi089.front.sepia.ceph.com]: reset os type and version on server 2023-12-15T20:56:27.647 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2023-12-15T20:56:27.761 DEBUG:teuthology.provision.fog.smithi031:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-12-15T20:56:27.787 DEBUG:teuthology.provision.fog.smithi089:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-12-15T20:56:27.802 INFO:teuthology.provision.fog.smithi031:Scheduling deploy of ubuntu 20.04 2023-12-15T20:56:27.829 INFO:teuthology.provision.fog.smithi089:Scheduling deploy of ubuntu 20.04 2023-12-15T20:56:28.051 INFO:teuthology.orchestra.console.smithi031:Power off 2023-12-15T20:56:28.052 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-15T20:56:28.067 INFO:teuthology.orchestra.console.smithi089:Power off 2023-12-15T20:56:28.067 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-15T20:56:28.087 DEBUG:teuthology.orchestra.console.smithi089:power off output: Chassis Power Control: Down/Off 2023-12-15T20:56:28.088 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-15T20:56:28.096 DEBUG:teuthology.orchestra.console.smithi031:power off output: Chassis Power Control: Down/Off 2023-12-15T20:56:28.096 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-15T20:56:28.110 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2023-12-15T20:56:28.120 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-12-15T20:56:32.113 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-15T20:56:32.122 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-15T20:56:32.224 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2023-12-15T20:56:32.230 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-12-15T20:56:36.226 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-15T20:56:36.236 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-15T20:56:36.338 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2023-12-15T20:56:36.344 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2023-12-15T20:56:36.444 INFO:teuthology.orchestra.console.smithi031:Power off completed 2023-12-15T20:56:36.545 INFO:teuthology.orchestra.console.smithi031:Power on 2023-12-15T20:56:36.545 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-15T20:56:36.566 DEBUG:teuthology.orchestra.console.smithi031:power on output: Chassis Power Control: Up/On 2023-12-15T20:56:36.566 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-15T20:56:36.591 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2023-12-15T20:56:40.342 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-15T20:56:40.451 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off 2023-12-15T20:56:40.552 INFO:teuthology.orchestra.console.smithi089:Power off completed 2023-12-15T20:56:40.592 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-15T20:56:40.653 INFO:teuthology.orchestra.console.smithi089:Power on 2023-12-15T20:56:40.653 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-15T20:56:40.674 DEBUG:teuthology.orchestra.console.smithi089:power on output: Chassis Power Control: Up/On 2023-12-15T20:56:40.675 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-15T20:56:40.695 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off 2023-12-15T20:56:40.705 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2023-12-15T20:56:44.699 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-15T20:56:44.706 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-15T20:56:44.809 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off 2023-12-15T20:56:44.815 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-12-15T20:56:44.915 INFO:teuthology.orchestra.console.smithi031:Power on completed 2023-12-15T20:56:45.016 INFO:teuthology.provision.fog.smithi031:Waiting for deploy to finish 2023-12-15T20:56:48.813 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-15T20:56:48.922 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2023-12-15T20:56:49.022 INFO:teuthology.orchestra.console.smithi089:Power on completed 2023-12-15T20:56:49.123 INFO:teuthology.provision.fog.smithi089:Waiting for deploy to finish 2023-12-15T21:00:01.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T21:00:01.418 ERROR:teuthology.orchestra.connection:Error authenticating with smithi031.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-15T21:00:35.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T21:00:38.449 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-12-15T21:00:44.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T21:00:47.505 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-12-15T21:00:53.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T21:00:56.561 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-12-15T21:01:02.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T21:01:05.421 WARNING:teuthology.provision.fog.smithi031:timed out 2023-12-15T21:01:05.617 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-12-15T21:01:11.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T21:01:11.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T21:01:14.485 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-12-15T21:01:14.673 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-12-15T21:01:20.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T21:01:20.674 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T21:01:23.537 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-12-15T21:01:23.730 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-12-15T21:01:29.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T21:01:29.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T21:01:32.597 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-12-15T21:01:38.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T21:01:38.800 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-15T21:01:38.801 DEBUG:teuthology.orchestra.run.smithi031:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-15T21:01:39.273 INFO:teuthology.provision.fog.smithi031:Node is ready 2023-12-15T21:01:39.274 DEBUG:teuthology.orchestra.run.smithi031:> hostname 2023-12-15T21:01:39.280 INFO:teuthology.orchestra.run.smithi031.stdout:smithi129 2023-12-15T21:01:39.280 DEBUG:teuthology.orchestra.run.smithi031:> grep smithi129 /etc/hosts 2023-12-15T21:01:39.335 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.129 smithi129 smithi129 2023-12-15T21:01:39.335 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031 2023-12-15T21:01:39.408 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi129/smithi031/g' /etc/hosts 2023-12-15T21:01:39.424 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/172.21.15.129/172.21.15.31/g' /etc/hosts 2023-12-15T21:01:39.483 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi129/smithi031/g' /etc/hostname 2023-12-15T21:01:39.498 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031 2023-12-15T21:01:39.510 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2023-12-15T21:01:39.514 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="Ubuntu" 2023-12-15T21:01:39.514 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-12-15T21:01:39.514 INFO:teuthology.orchestra.run.smithi031.stdout:ID=ubuntu 2023-12-15T21:01:39.514 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE=debian 2023-12-15T21:01:39.514 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-12-15T21:01:39.514 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="20.04" 2023-12-15T21:01:39.514 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-15T21:01:39.514 INFO:teuthology.orchestra.run.smithi031.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-15T21:01:39.514 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-15T21:01:39.514 INFO:teuthology.orchestra.run.smithi031.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-15T21:01:39.514 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_CODENAME=focal 2023-12-15T21:01:39.515 INFO:teuthology.orchestra.run.smithi031.stdout:UBUNTU_CODENAME=focal 2023-12-15T21:01:39.515 INFO:teuthology.provision.fog.smithi031:Deploy complete! 2023-12-15T21:01:39.517 DEBUG:teuthology.parallel:result is None 2023-12-15T21:01:48.177 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-12-15T21:01:54.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T21:01:57.237 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-12-15T21:02:03.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T21:02:04.856 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-15T21:02:04.856 DEBUG:teuthology.orchestra.run.smithi089:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-15T21:02:25.765 INFO:teuthology.provision.fog.smithi089:Node is ready 2023-12-15T21:02:25.765 DEBUG:teuthology.orchestra.run.smithi089:> hostname 2023-12-15T21:02:25.771 INFO:teuthology.orchestra.run.smithi089.stdout:smithi129 2023-12-15T21:02:25.771 DEBUG:teuthology.orchestra.run.smithi089:> grep smithi129 /etc/hosts 2023-12-15T21:02:25.778 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.129 smithi129 smithi129 2023-12-15T21:02:25.779 DEBUG:teuthology.orchestra.run.smithi089:> sudo hostname smithi089 2023-12-15T21:02:25.841 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i -e 's/smithi129/smithi089/g' /etc/hosts 2023-12-15T21:02:25.858 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i -e 's/172.21.15.129/172.21.15.89/g' /etc/hosts 2023-12-15T21:02:25.870 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i -e 's/smithi129/smithi089/g' /etc/hostname 2023-12-15T21:02:25.882 DEBUG:teuthology.orchestra.run.smithi089:> sudo hostname smithi089 2023-12-15T21:02:25.938 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2023-12-15T21:02:25.944 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="Ubuntu" 2023-12-15T21:02:25.944 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-12-15T21:02:25.944 INFO:teuthology.orchestra.run.smithi089.stdout:ID=ubuntu 2023-12-15T21:02:25.944 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE=debian 2023-12-15T21:02:25.944 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-12-15T21:02:25.944 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="20.04" 2023-12-15T21:02:25.944 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-15T21:02:25.944 INFO:teuthology.orchestra.run.smithi089.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-15T21:02:25.945 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-15T21:02:25.945 INFO:teuthology.orchestra.run.smithi089.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-15T21:02:25.945 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_CODENAME=focal 2023-12-15T21:02:25.945 INFO:teuthology.orchestra.run.smithi089.stdout:UBUNTU_CODENAME=focal 2023-12-15T21:02:25.945 INFO:teuthology.provision.fog.smithi089:Deploy complete! 2023-12-15T21:02:25.945 DEBUG:teuthology.parallel:result is None 2023-12-15T21:02:26.172 INFO:teuthology.lock.ops:Checking smithi031.front.sepia.ceph.com 2023-12-15T21:02:26.172 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-15T21:02:26.196 INFO:teuthology.lock.ops:Checking smithi089.front.sepia.ceph.com 2023-12-15T21:02:26.197 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-15T21:02:26.222 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: set os type and version on server 2023-12-15T21:02:26.223 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-12-15T21:02:26.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T21:02:26.273 DEBUG:teuthology.orchestra.run.smithi031:> true 2023-12-15T21:02:26.483 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-12-15T21:02:26.483 DEBUG:teuthology.orchestra.run.smithi031:> uname -m 2023-12-15T21:02:26.489 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64 2023-12-15T21:02:26.489 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2023-12-15T21:02:26.496 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="Ubuntu" 2023-12-15T21:02:26.497 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-12-15T21:02:26.497 INFO:teuthology.orchestra.run.smithi031.stdout:ID=ubuntu 2023-12-15T21:02:26.497 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE=debian 2023-12-15T21:02:26.497 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-12-15T21:02:26.497 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="20.04" 2023-12-15T21:02:26.497 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-15T21:02:26.497 INFO:teuthology.orchestra.run.smithi031.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-15T21:02:26.497 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-15T21:02:26.497 INFO:teuthology.orchestra.run.smithi031.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-15T21:02:26.497 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_CODENAME=focal 2023-12-15T21:02:26.497 INFO:teuthology.orchestra.run.smithi031.stdout:UBUNTU_CODENAME=focal 2023-12-15T21:02:26.498 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2023-12-15T21:02:26.522 INFO:teuthology.lock.ops:Updating [smithi089.front.sepia.ceph.com]: set os type and version on server 2023-12-15T21:02:26.522 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-12-15T21:02:26.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T21:02:26.570 DEBUG:teuthology.orchestra.run.smithi089:> true 2023-12-15T21:02:26.703 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-12-15T21:02:26.703 DEBUG:teuthology.orchestra.run.smithi089:> uname -m 2023-12-15T21:02:26.709 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64 2023-12-15T21:02:26.710 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2023-12-15T21:02:26.715 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="Ubuntu" 2023-12-15T21:02:26.715 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-12-15T21:02:26.715 INFO:teuthology.orchestra.run.smithi089.stdout:ID=ubuntu 2023-12-15T21:02:26.715 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE=debian 2023-12-15T21:02:26.716 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-12-15T21:02:26.716 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="20.04" 2023-12-15T21:02:26.716 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-15T21:02:26.716 INFO:teuthology.orchestra.run.smithi089.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-15T21:02:26.716 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-15T21:02:26.716 INFO:teuthology.orchestra.run.smithi089.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-15T21:02:26.716 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_CODENAME=focal 2023-12-15T21:02:26.716 INFO:teuthology.orchestra.run.smithi089.stdout:UBUNTU_CODENAME=focal 2023-12-15T21:02:26.716 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2023-12-15T21:02:26.738 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:02:26.841 INFO:teuthology.dispatcher.supervisor:Running job 7493094 2023-12-15T21:02:26.841 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_akupczyk@teuthology --archive /home/teuthworker/archive/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493094 --name akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi --description rados/upgrade/parallel/{0-random-distro$/{ubuntu_20.04} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} -- /home/teuthworker/archive/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493094/orig.config.yaml 2023-12-15T21:02:26.845 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493094 2023-12-15T21:02:26.846 INFO:teuthology.dispatcher.supervisor:Job PID: 935104 2023-12-15T21:02:26.846 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-15T21:04:26.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:06:26.913 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:08:26.989 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:10:27.064 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:12:27.133 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:14:27.197 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:16:27.284 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:18:27.360 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:20:27.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:22:27.534 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:24:27.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:26:27.692 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:28:27.760 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:30:27.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:32:27.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:34:27.980 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:36:28.048 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:38:28.121 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:40:28.186 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:42:28.252 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:44:28.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:46:28.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:48:28.480 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:50:28.552 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:52:28.618 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:54:28.692 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:56:28.768 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:58:28.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:00:28.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:02:28.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:04:29.033 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:06:29.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:08:29.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:10:29.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:12:29.326 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:14:29.389 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:16:29.460 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:18:29.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:20:29.594 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:22:29.754 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:24:29.917 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:26:29.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:28:30.069 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:30:30.138 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:32:30.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:34:30.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:36:30.365 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:38:30.436 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:40:30.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:42:30.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:44:30.658 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:46:30.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:48:30.812 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:50:30.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:52:30.949 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:54:31.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:56:31.076 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:58:31.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:00:31.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:02:31.269 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:04:31.342 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:06:31.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:08:31.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:10:31.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:12:31.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:14:31.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:16:31.765 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:18:31.838 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:20:31.914 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:22:31.980 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:24:32.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:26:32.142 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:28:32.214 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:30:32.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:32:32.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:34:32.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:36:32.578 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:38:32.649 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:40:32.720 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:42:32.785 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:44:32.857 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:46:33.038 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:48:33.193 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:50:33.322 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:52:33.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:54:33.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:56:33.537 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:58:33.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:00:33.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:02:33.762 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:04:33.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:06:33.906 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:08:33.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:10:34.050 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:12:34.108 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:14:34.176 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:16:34.243 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:18:34.314 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:20:34.390 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:22:34.458 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:24:34.534 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:26:34.621 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:28:34.714 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:30:34.792 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:32:34.874 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:34:34.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:36:35.020 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:38:35.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:40:35.166 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:42:35.240 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:44:35.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:46:35.373 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:48:35.457 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:50:35.529 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:52:35.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:54:35.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:56:35.757 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:58:35.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:00:35.902 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:02:35.980 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:04:36.046 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:06:36.118 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:08:36.192 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:10:36.268 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:12:36.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:14:36.434 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:16:36.510 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:18:36.584 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:20:36.648 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:22:36.716 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:24:36.789 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:26:36.860 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:28:36.934 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:30:37.005 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:32:37.082 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:34:37.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:36:37.222 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:38:37.296 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:40:37.360 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:42:37.427 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:44:37.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:46:37.569 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:48:37.634 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:50:37.706 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:52:37.772 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:54:37.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:56:37.894 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:58:37.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:00:38.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:02:38.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:04:38.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:06:38.234 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:08:38.302 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:10:38.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:12:38.450 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:14:38.524 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:16:38.592 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:18:38.657 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:20:38.721 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:22:38.781 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:24:38.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:26:38.922 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:28:38.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:30:39.050 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:32:39.128 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:34:39.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:36:39.288 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:38:39.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:40:39.424 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:42:39.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:44:39.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:46:39.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:48:39.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:50:39.777 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:52:39.857 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:54:40.024 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:56:40.098 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:58:40.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:00:40.242 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:02:40.309 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:04:40.373 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:06:40.433 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:08:40.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:10:40.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:12:40.625 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:14:40.690 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:16:40.780 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:18:40.845 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:20:40.908 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:22:40.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:24:41.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:26:41.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:28:41.193 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:30:41.265 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:32:41.340 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:34:41.414 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:36:41.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:38:41.553 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:40:41.625 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:42:41.694 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:44:41.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:46:41.840 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:48:41.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:50:41.970 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:52:42.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:54:42.114 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:56:42.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:58:42.270 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:00:42.342 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:02:42.410 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:04:42.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:06:42.542 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:08:42.616 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:10:42.698 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:12:42.758 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:14:42.822 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:16:42.892 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:18:42.958 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:20:43.030 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:22:43.088 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:24:43.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:26:43.246 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:28:43.320 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:30:43.392 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:32:43.461 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:34:43.544 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:36:43.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:38:43.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:40:43.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:42:43.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:44:43.954 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:46:44.025 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:48:44.093 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:50:44.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:52:44.232 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:54:44.305 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:56:44.381 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:58:44.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:00:44.544 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:02:44.610 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:04:44.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:06:44.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:08:44.816 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:10:44.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:12:44.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:14:45.037 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:16:45.105 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:18:45.176 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:20:45.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:22:45.309 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:24:45.373 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:26:45.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:28:45.504 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:30:45.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:32:45.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:34:45.710 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:36:45.784 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:38:45.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:40:45.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:42:45.989 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:44:46.062 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:46:46.136 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:48:46.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:50:46.274 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:52:46.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:54:46.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:56:46.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:58:46.562 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:00:46.637 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:02:46.704 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:04:46.778 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:06:46.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:08:46.909 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:10:46.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:12:47.058 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:14:47.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:16:47.208 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:18:47.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:20:47.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:22:47.417 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:24:47.490 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:26:47.576 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:28:47.648 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:30:47.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:32:47.790 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:34:47.864 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:36:47.938 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:38:48.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:40:48.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:42:48.180 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:44:48.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:46:48.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:48:48.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:50:48.476 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:52:48.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:54:48.642 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:56:48.718 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:58:48.800 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:00:48.873 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:02:48.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:04:49.025 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:06:49.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:08:49.176 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:10:49.248 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:12:49.333 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:14:49.413 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:16:49.490 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:18:49.565 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:20:49.628 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:22:49.705 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:24:49.781 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:26:49.861 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:28:49.940 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:30:50.021 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:32:50.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:34:50.176 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:36:50.252 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:38:50.328 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:40:50.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:42:50.493 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:44:50.572 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:46:50.649 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:48:50.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:50:50.806 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:52:50.890 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:54:50.964 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:56:51.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:58:51.098 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:00:51.168 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:02:51.246 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:04:51.322 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:06:51.406 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:08:51.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:10:51.552 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:12:51.625 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:14:51.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:16:51.826 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:18:51.917 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:20:52.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:22:52.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:24:52.181 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:26:52.266 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:28:52.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:30:52.438 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:32:52.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:34:52.604 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:36:52.704 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:38:52.784 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:40:52.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:42:52.992 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:44:53.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:46:53.158 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:48:53.250 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:50:53.329 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:52:53.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:54:53.493 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:56:53.576 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:58:53.658 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:00:53.757 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:02:53.842 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2023-12-16T09:02:54.054 INFO:teuthology.kill:Killing Pids: {935104} 2023-12-16T09:02:54.906 INFO:teuthology.task.internal:roles: ubuntu@smithi031.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a'] 2023-12-16T09:02:54.906 INFO:teuthology.task.internal:roles: ubuntu@smithi089.front.sepia.ceph.com - ['mon.b', 'mds.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b'] 2023-12-16T09:02:54.906 INFO:teuthology.misc:Compressing logs... 2023-12-16T09:02:54.906 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-12-16T09:02:54.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T09:02:55.045 DEBUG:teuthology.orchestra.run.smithi031:> true 2023-12-16T09:02:55.288 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-12-16T09:02:55.288 DEBUG:teuthology.orchestra.run.smithi031:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-16T09:02:55.336 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-12-16T09:02:55.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T09:02:55.452 DEBUG:teuthology.orchestra.run.smithi089:> true 2023-12-16T09:02:55.571 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-12-16T09:02:55.571 DEBUG:teuthology.orchestra.run.smithi089:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-16T09:02:55.645 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/lib/ceph/crash to /home/teuthworker/archive/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493094/remote/smithi031/crash 2023-12-16T09:02:55.646 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-16T09:02:55.669 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/lib/ceph/crash to /home/teuthworker/archive/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493094/remote/smithi089/crash 2023-12-16T09:02:55.670 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-16T09:02:55.702 INFO:teuthology.misc:Compressing logs... 2023-12-16T09:02:55.703 DEBUG:teuthology.orchestra.run.smithi031:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-16T09:02:55.716 DEBUG:teuthology.orchestra.run.smithi089:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-16T09:02:55.742 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-16T09:02:55.754 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-16T09:02:55.762 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-16T09:02:55.762 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-16T09:02:55.763 INFO:teuthology.orchestra.run.smithi089.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 51.2% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-12-16T09:02:55.764 INFO:teuthology.orchestra.run.smithi031.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: /home/ubuntu/cephtest/archive/syslog/misc.log: 54.4% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-12-16T09:02:55.874 INFO:teuthology.orchestra.run.smithi089.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 89.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-12-16T09:02:55.963 INFO:teuthology.orchestra.run.smithi031.stderr: 92.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-12-16T09:02:55.965 DEBUG:teuthology.misc:Transferring archived files from smithi031:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493094/remote/smithi031/ 2023-12-16T09:02:55.965 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-16T09:02:56.055 DEBUG:teuthology.misc:Transferring archived files from smithi089:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493094/remote/smithi089/ 2023-12-16T09:02:56.055 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-16T09:02:56.095 INFO:teuthology.misc:Compressing logs... 2023-12-16T09:02:56.095 DEBUG:teuthology.orchestra.run.smithi031:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-16T09:02:56.097 DEBUG:teuthology.orchestra.run.smithi089:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-16T09:02:56.111 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-mon.a.log 2023-12-16T09:02:56.111 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-mds.a.log 2023-12-16T09:02:56.112 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-mgr.y.log 2023-12-16T09:02:56.112 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-mon.c.log 2023-12-16T09:02:56.113 INFO:teuthology.orchestra.run.smithi031.stderr: 67.0% -- replaced with /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-mds.a.log.gz 2023-12-16T09:02:56.113 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-osd.1.log 2023-12-16T09:02:56.114 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-osd.0.log 2023-12-16T09:02:56.115 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-osd.3.log 2023-12-16T09:02:56.115 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-volume.log 2023-12-16T09:02:56.115 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-osd.2.log 2023-12-16T09:02:56.116 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-osd.3.log: gzip /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-volume.log: -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-16T09:02:56.145 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-mon.b.log 2023-12-16T09:02:56.146 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-osd.5.log 2023-12-16T09:02:56.146 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-mgr.x.log 2023-12-16T09:02:56.147 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-mon.b.log: /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-osd.6.log 2023-12-16T09:02:56.147 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-mds.b.log 2023-12-16T09:02:56.148 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-osd.4.log 2023-12-16T09:02:56.148 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-osd.6.log: /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-mds.b.log: 80.1% -- replaced with /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-mds.b.log.gz 2023-12-16T09:02:56.148 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-volume.log 2023-12-16T09:02:56.149 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-osd.7.log 2023-12-16T09:02:56.149 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-16T09:02:56.160 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-osd.4.log: /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-osd.7.log: /var/log/ceph/cephadm.log: 88.6% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-16T09:02:56.182 INFO:teuthology.orchestra.run.smithi089.stderr: 91.4% -- replaced with /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-volume.log.gz 2023-12-16T09:02:56.275 INFO:teuthology.orchestra.run.smithi089.stderr: 93.4% -- replaced with /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-mgr.x.log.gz 2023-12-16T09:02:56.345 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-osd.2.log: /var/log/ceph/cephadm.log: 91.2% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-16T09:02:57.033 INFO:teuthology.orchestra.run.smithi031.stderr: 91.4% -- replaced with /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-volume.log.gz 2023-12-16T09:03:06.117 INFO:teuthology.orchestra.run.smithi089.stderr:gzip: /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-mon.b.log: file size changed while zipping 2023-12-16T09:03:06.117 INFO:teuthology.orchestra.run.smithi089.stderr: 93.1% -- replaced with /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-mon.b.log.gz 2023-12-16T09:03:07.391 INFO:teuthology.orchestra.run.smithi031.stderr:gzip: /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-mgr.y.log: file size changed while zipping 2023-12-16T09:03:07.391 INFO:teuthology.orchestra.run.smithi031.stderr: 90.4% -- replaced with /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-mgr.y.log.gz 2023-12-16T09:03:11.204 INFO:teuthology.orchestra.run.smithi031.stderr:gzip: /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-mon.c.log: file size changed while zipping 2023-12-16T09:03:11.204 INFO:teuthology.orchestra.run.smithi031.stderr: 93.0% -- replaced with /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-mon.c.log.gz 2023-12-16T09:03:28.525 INFO:teuthology.orchestra.run.smithi089.stderr:gzip: /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-osd.6.log: file size changed while zipping 2023-12-16T09:03:28.525 INFO:teuthology.orchestra.run.smithi089.stderr: 94.1% -- replaced with /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-osd.6.log.gz 2023-12-16T09:03:29.186 INFO:teuthology.orchestra.run.smithi089.stderr:gzip: /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-osd.4.log: file size changed while zipping 2023-12-16T09:03:29.187 INFO:teuthology.orchestra.run.smithi089.stderr: 93.9% -- replaced with /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-osd.4.log.gz 2023-12-16T09:03:30.780 INFO:teuthology.orchestra.run.smithi089.stderr:gzip: /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-osd.7.log: file size changed while zipping 2023-12-16T09:03:30.780 INFO:teuthology.orchestra.run.smithi089.stderr: 94.1% -- replaced with /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-osd.7.log.gz 2023-12-16T09:03:31.773 INFO:teuthology.orchestra.run.smithi089.stderr:gzip: /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-osd.5.log: file size changed while zipping 2023-12-16T09:03:31.774 INFO:teuthology.orchestra.run.smithi089.stderr: 94.1% -- replaced with /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-osd.5.log.gz 2023-12-16T09:03:41.330 INFO:teuthology.orchestra.run.smithi031.stderr:gzip: /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-mon.a.log: file size changed while zipping 2023-12-16T09:03:41.331 INFO:teuthology.orchestra.run.smithi031.stderr: 90.2% -- replaced with /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-mon.a.log.gz 2023-12-16T09:04:06.167 INFO:teuthology.orchestra.run.smithi031.stderr:gzip: /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-osd.2.log: file size changed while zipping 2023-12-16T09:04:06.167 INFO:teuthology.orchestra.run.smithi031.stderr: 93.6% -- replaced with /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-osd.2.log.gz 2023-12-16T09:04:07.496 INFO:teuthology.orchestra.run.smithi031.stderr:gzip: /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-osd.1.log: file size changed while zipping 2023-12-16T09:04:07.496 INFO:teuthology.orchestra.run.smithi031.stderr: 93.9% -- replaced with /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-osd.1.log.gz 2023-12-16T09:04:15.644 INFO:teuthology.orchestra.run.smithi031.stderr:gzip: /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-osd.3.log: file size changed while zipping 2023-12-16T09:04:15.644 INFO:teuthology.orchestra.run.smithi031.stderr: 94.4% -- replaced with /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-osd.3.log.gz 2023-12-16T09:04:16.989 INFO:teuthology.orchestra.run.smithi031.stderr:gzip: /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-osd.0.log: file size changed while zipping 2023-12-16T09:04:16.989 INFO:teuthology.orchestra.run.smithi031.stderr: 94.0% -- replaced with /var/log/ceph/d15f25da-9b8e-11ee-95a5-87774f69a715/ceph-osd.0.log.gz 2023-12-16T09:04:16.992 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/log/ceph to /home/teuthworker/archive/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493094/remote/smithi031/log 2023-12-16T09:04:16.993 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-16T09:04:43.184 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/log/ceph to /home/teuthworker/archive/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493094/remote/smithi089/log 2023-12-16T09:04:43.185 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-16T09:05:02.204 INFO:teuthology.kill:No teuthology processes running 2023-12-16T09:05:02.204 ERROR:teuthology.dispatcher.supervisor:Failed to kill job and unlock machines Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/dispatcher/supervisor.py", line 331, in run_with_watchdog kill.kill_job( File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/kill.py", line 89, in kill_job if kill_processes(run_name, [job_info.get('pid')]): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/kill.py", line 210, in kill_processes if survivors: UnboundLocalError: local variable 'survivors' referenced before assignment 2023-12-16T09:05:02.205 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:07:02.449 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:07:02.536 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2023-12-16T09:07:02.653 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-16T09:07:02.654 INFO:teuthology.nuke:Checking targets against current locks 2023-12-16T09:07:02.740 DEBUG:teuthology.nuke:shortname: smithi031 2023-12-16T09:07:02.740 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T09:07:02.774 DEBUG:teuthology.nuke:shortname: smithi089 2023-12-16T09:07:02.774 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T09:07:02.785 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493094', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-15 20:56:26.620237', 'locked_by': 'scheduled_akupczyk@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-12-16T09:07:02.831 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493094', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-15 20:56:26.621576', 'locked_by': 'scheduled_akupczyk@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-12-16T09:07:02.879 INFO:teuthology.orchestra.console.smithi031:Power off 2023-12-16T09:07:02.879 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T09:07:02.909 INFO:teuthology.orchestra.console.smithi089:Power off 2023-12-16T09:07:02.909 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T09:07:02.926 DEBUG:teuthology.orchestra.console.smithi031:power off output: Chassis Power Control: Down/Off 2023-12-16T09:07:02.926 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T09:07:02.954 DEBUG:teuthology.orchestra.console.smithi089:power off output: Chassis Power Control: Down/Off 2023-12-16T09:07:02.954 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T09:07:02.973 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-12-16T09:07:03.001 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2023-12-16T09:07:06.974 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T09:07:07.002 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T09:07:07.083 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-12-16T09:07:07.110 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2023-12-16T09:07:11.085 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T09:07:11.112 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T09:07:11.193 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2023-12-16T09:07:11.220 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2023-12-16T09:07:11.295 INFO:teuthology.orchestra.console.smithi031:Power off completed 2023-12-16T09:07:11.466 INFO:teuthology.lock.ops:unlocked: smithi031.front.sepia.ceph.com 2023-12-16T09:07:15.221 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T09:07:15.331 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off 2023-12-16T09:07:15.432 INFO:teuthology.orchestra.console.smithi089:Power off completed 2023-12-16T09:07:15.624 INFO:teuthology.lock.ops:unlocked: smithi089.front.sepia.ceph.com