2023-12-07T04:19:58.941 INFO:root:teuthology version: 0.0.1.dev214+gf2de108
2023-12-07T04:19:58.942 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T04:19:59.118 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f430b967d90>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f430ca53550>, signals=[15])
2023-12-07T04:19:59.119 INFO:teuthology.lock.ops:Start node 'smithi028.front.sepia.ceph.com' reimaging
2023-12-07T04:19:59.119 INFO:teuthology.lock.ops:Updating [smithi028.front.sepia.ceph.com]: reset os type and version on server
2023-12-07T04:19:59.119 INFO:teuthology.lock.ops:Updating smithi028.front.sepia.ceph.com on lock server
2023-12-07T04:19:59.144 INFO:teuthology.lock.ops:Start node 'smithi138.front.sepia.ceph.com' reimaging
2023-12-07T04:19:59.144 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: reset os type and version on server
2023-12-07T04:19:59.144 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server
2023-12-07T04:19:59.168 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging
2023-12-07T04:19:59.169 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server
2023-12-07T04:19:59.170 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server
2023-12-07T04:19:59.269 DEBUG:teuthology.provision.fog.smithi028:Requesting image smithi_centos_8.stream (ID 3)
2023-12-07T04:19:59.282 DEBUG:teuthology.provision.fog.smithi138:Requesting image smithi_centos_8.stream (ID 3)
2023-12-07T04:19:59.315 INFO:teuthology.provision.fog.smithi028:Scheduling deploy of centos 8.stream
2023-12-07T04:19:59.318 DEBUG:teuthology.provision.fog.smithi161:Requesting image smithi_centos_8.stream (ID 3)
2023-12-07T04:19:59.334 INFO:teuthology.provision.fog.smithi138:Scheduling deploy of centos 8.stream
2023-12-07T04:19:59.381 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of centos 8.stream
2023-12-07T04:19:59.605 INFO:teuthology.orchestra.console.smithi138:Power off
2023-12-07T04:19:59.605 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-07T04:19:59.618 INFO:teuthology.orchestra.console.smithi028:Power off
2023-12-07T04:19:59.618 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-07T04:19:59.631 DEBUG:teuthology.orchestra.console.smithi138:power off output: Chassis Power Control: Down/Off
2023-12-07T04:19:59.632 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T04:19:59.640 DEBUG:teuthology.orchestra.console.smithi028:power off output: Chassis Power Control: Down/Off
2023-12-07T04:19:59.641 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T04:19:59.653 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on
2023-12-07T04:19:59.666 INFO:teuthology.orchestra.console.smithi161:Power off
2023-12-07T04:19:59.666 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-07T04:19:59.675 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is on
2023-12-07T04:19:59.689 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off
2023-12-07T04:19:59.689 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T04:19:59.710 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on
2023-12-07T04:20:03.658 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T04:20:03.676 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T04:20:03.711 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T04:20:03.767 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on
2023-12-07T04:20:03.784 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is on
2023-12-07T04:20:03.820 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on
2023-12-07T04:20:07.771 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T04:20:07.785 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T04:20:07.822 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T04:20:07.882 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off
2023-12-07T04:20:07.894 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is on
2023-12-07T04:20:07.933 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off
2023-12-07T04:20:07.984 INFO:teuthology.orchestra.console.smithi138:Power off completed
2023-12-07T04:20:08.034 INFO:teuthology.orchestra.console.smithi161:Power off completed
2023-12-07T04:20:08.085 INFO:teuthology.orchestra.console.smithi138:Power on
2023-12-07T04:20:08.085 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-07T04:20:08.106 DEBUG:teuthology.orchestra.console.smithi138:power on output: Chassis Power Control: Up/On
2023-12-07T04:20:08.107 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T04:20:08.129 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off
2023-12-07T04:20:08.135 INFO:teuthology.orchestra.console.smithi161:Power on
2023-12-07T04:20:08.135 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-07T04:20:08.157 DEBUG:teuthology.orchestra.console.smithi161:power on output: Chassis Power Control: Up/On
2023-12-07T04:20:08.157 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T04:20:08.177 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off
2023-12-07T04:20:11.898 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T04:20:12.007 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is off
2023-12-07T04:20:12.107 INFO:teuthology.orchestra.console.smithi028:Power off completed
2023-12-07T04:20:12.130 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T04:20:12.179 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T04:20:12.208 INFO:teuthology.orchestra.console.smithi028:Power on
2023-12-07T04:20:12.209 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-07T04:20:12.231 DEBUG:teuthology.orchestra.console.smithi028:power on output: Chassis Power Control: Up/On
2023-12-07T04:20:12.231 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T04:20:12.239 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off
2023-12-07T04:20:12.252 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is off
2023-12-07T04:20:12.290 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off
2023-12-07T04:20:16.242 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T04:20:16.253 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T04:20:16.291 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T04:20:16.351 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on
2023-12-07T04:20:16.361 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is off
2023-12-07T04:20:16.400 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on
2023-12-07T04:20:16.452 INFO:teuthology.orchestra.console.smithi138:Power on completed
2023-12-07T04:20:16.501 INFO:teuthology.orchestra.console.smithi161:Power on completed
2023-12-07T04:20:16.553 INFO:teuthology.provision.fog.smithi138:Waiting for deploy to finish
2023-12-07T04:20:16.602 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish
2023-12-07T04:20:20.366 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T04:20:20.520 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is on
2023-12-07T04:20:20.621 INFO:teuthology.orchestra.console.smithi028:Power on completed
2023-12-07T04:20:20.722 INFO:teuthology.provision.fog.smithi028:Waiting for deploy to finish
2023-12-07T04:22:36.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T04:22:36.658 ERROR:teuthology.orchestra.connection:Error authenticating with smithi028.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-07T04:23:02.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T04:23:02.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T04:23:05.698 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-12-07T04:23:05.699 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138
2023-12-07T04:23:11.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T04:23:11.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T04:23:14.754 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-12-07T04:23:14.755 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138
2023-12-07T04:23:20.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T04:23:20.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T04:23:23.814 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-12-07T04:23:23.814 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138
2023-12-07T04:23:29.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T04:23:29.817 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T04:23:32.866 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-12-07T04:23:32.898 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138
2023-12-07T04:23:38.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T04:23:38.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T04:23:40.661 WARNING:teuthology.provision.fog.smithi028:timed out
2023-12-07T04:23:41.926 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-12-07T04:23:41.958 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138
2023-12-07T04:23:46.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T04:23:47.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T04:23:47.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T04:23:49.730 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28
2023-12-07T04:23:50.978 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-12-07T04:23:51.014 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138
2023-12-07T04:23:55.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T04:23:56.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T04:23:57.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T04:23:58.790 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28
2023-12-07T04:24:00.034 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-12-07T04:24:04.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T04:24:04.970 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-07T04:24:04.971 DEBUG:teuthology.orchestra.run.smithi028:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-07T04:24:06.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T04:24:09.090 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-12-07T04:24:15.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T04:24:20.211 INFO:teuthology.provision.fog.smithi028:Node is ready
2023-12-07T04:24:20.211 DEBUG:teuthology.orchestra.run.smithi028:> hostname
2023-12-07T04:24:20.238 INFO:teuthology.orchestra.run.smithi028.stdout:smithi028.front.sepia.ceph.com
2023-12-07T04:24:20.239 DEBUG:teuthology.orchestra.run.smithi028:> grep smithi028.front.sepia.ceph.com /etc/hosts
2023-12-07T04:24:20.300 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.15.28 smithi028.front.sepia.ceph.com smithi028
2023-12-07T04:24:20.301 DEBUG:teuthology.orchestra.run.smithi028:> sudo hostname smithi028
2023-12-07T04:24:20.429 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i -e 's/smithi028.front.sepia.ceph.com/smithi028/g' /etc/hosts
2023-12-07T04:24:20.462 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i -e 's/172.21.15.28/172.21.15.28/g' /etc/hosts
2023-12-07T04:24:20.535 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i -e 's/smithi028.front.sepia.ceph.com/smithi028/g' /etc/hostname
2023-12-07T04:24:20.607 DEBUG:teuthology.orchestra.run.smithi028:> sudo hostname smithi028
2023-12-07T04:24:20.677 DEBUG:teuthology.orchestra.run.smithi028:> cat /etc/os-release
2023-12-07T04:24:20.737 INFO:teuthology.orchestra.run.smithi028.stdout:NAME="CentOS Stream"
2023-12-07T04:24:20.738 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION="8"
2023-12-07T04:24:20.738 INFO:teuthology.orchestra.run.smithi028.stdout:ID="centos"
2023-12-07T04:24:20.738 INFO:teuthology.orchestra.run.smithi028.stdout:ID_LIKE="rhel fedora"
2023-12-07T04:24:20.738 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION_ID="8"
2023-12-07T04:24:20.738 INFO:teuthology.orchestra.run.smithi028.stdout:PLATFORM_ID="platform:el8"
2023-12-07T04:24:20.738 INFO:teuthology.orchestra.run.smithi028.stdout:PRETTY_NAME="CentOS Stream 8"
2023-12-07T04:24:20.738 INFO:teuthology.orchestra.run.smithi028.stdout:ANSI_COLOR="0;31"
2023-12-07T04:24:20.738 INFO:teuthology.orchestra.run.smithi028.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-12-07T04:24:20.739 INFO:teuthology.orchestra.run.smithi028.stdout:HOME_URL="https://centos.org/"
2023-12-07T04:24:20.739 INFO:teuthology.orchestra.run.smithi028.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-07T04:24:20.739 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-07T04:24:20.739 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-07T04:24:20.740 INFO:teuthology.provision.fog.smithi028:Deploy complete!
2023-12-07T04:24:20.741 DEBUG:teuthology.parallel:result is None
2023-12-07T04:24:33.634 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-12-07T04:24:39.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T04:24:42.690 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-12-07T04:24:48.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T04:24:49.676 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-07T04:24:49.677 DEBUG:teuthology.orchestra.run.smithi161:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-07T04:24:57.018 WARNING:teuthology.provision.fog.smithi138:timed out
2023-12-07T04:25:03.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T04:25:03.235 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-07T04:25:03.235 DEBUG:teuthology.orchestra.run.smithi138:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-07T04:25:03.491 INFO:teuthology.provision.fog.smithi138:Node is ready
2023-12-07T04:25:03.491 DEBUG:teuthology.orchestra.run.smithi138:> hostname
2023-12-07T04:25:03.510 INFO:teuthology.orchestra.run.smithi138.stdout:smithi138.front.sepia.ceph.com
2023-12-07T04:25:03.510 DEBUG:teuthology.orchestra.run.smithi138:> grep smithi138.front.sepia.ceph.com /etc/hosts
2023-12-07T04:25:03.569 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138 smithi138.front.sepia.ceph.com smithi138
2023-12-07T04:25:03.570 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname smithi138
2023-12-07T04:25:03.669 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/smithi138.front.sepia.ceph.com/smithi138/g' /etc/hosts
2023-12-07T04:25:03.699 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/172.21.15.138/172.21.15.138/g' /etc/hosts
2023-12-07T04:25:03.767 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/smithi138.front.sepia.ceph.com/smithi138/g' /etc/hostname
2023-12-07T04:25:03.835 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname smithi138
2023-12-07T04:25:03.902 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release
2023-12-07T04:25:03.960 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="CentOS Stream"
2023-12-07T04:25:03.960 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="8"
2023-12-07T04:25:03.960 INFO:teuthology.orchestra.run.smithi138.stdout:ID="centos"
2023-12-07T04:25:03.960 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="rhel fedora"
2023-12-07T04:25:03.960 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="8"
2023-12-07T04:25:03.960 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el8"
2023-12-07T04:25:03.961 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="CentOS Stream 8"
2023-12-07T04:25:03.961 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31"
2023-12-07T04:25:03.961 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-12-07T04:25:03.961 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://centos.org/"
2023-12-07T04:25:03.961 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-07T04:25:03.961 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-07T04:25:03.961 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-07T04:25:03.961 INFO:teuthology.provision.fog.smithi138:Deploy complete!
2023-12-07T04:25:03.962 DEBUG:teuthology.parallel:result is None
2023-12-07T04:25:14.487 INFO:teuthology.provision.fog.smithi161:Node is ready
2023-12-07T04:25:14.488 DEBUG:teuthology.orchestra.run.smithi161:> hostname
2023-12-07T04:25:14.513 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161.front.sepia.ceph.com
2023-12-07T04:25:14.513 DEBUG:teuthology.orchestra.run.smithi161:> grep smithi161.front.sepia.ceph.com /etc/hosts
2023-12-07T04:25:14.577 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161
2023-12-07T04:25:14.577 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161
2023-12-07T04:25:14.696 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hosts
2023-12-07T04:25:14.728 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/172.21.15.161/172.21.15.161/g' /etc/hosts
2023-12-07T04:25:14.798 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hostname
2023-12-07T04:25:14.871 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161
2023-12-07T04:25:14.940 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release
2023-12-07T04:25:14.999 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream"
2023-12-07T04:25:15.000 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8"
2023-12-07T04:25:15.000 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos"
2023-12-07T04:25:15.000 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora"
2023-12-07T04:25:15.001 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8"
2023-12-07T04:25:15.001 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8"
2023-12-07T04:25:15.001 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 8"
2023-12-07T04:25:15.001 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31"
2023-12-07T04:25:15.002 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-12-07T04:25:15.002 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/"
2023-12-07T04:25:15.002 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-07T04:25:15.002 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-07T04:25:15.003 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-07T04:25:15.003 INFO:teuthology.provision.fog.smithi161:Deploy complete!
2023-12-07T04:25:15.004 DEBUG:teuthology.parallel:result is None
2023-12-07T04:25:15.194 INFO:teuthology.lock.ops:Checking smithi028.front.sepia.ceph.com
2023-12-07T04:25:15.194 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-07T04:25:15.213 INFO:teuthology.lock.ops:Checking smithi138.front.sepia.ceph.com
2023-12-07T04:25:15.213 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-07T04:25:15.229 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com
2023-12-07T04:25:15.229 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-07T04:25:15.248 INFO:teuthology.lock.ops:Updating [smithi028.front.sepia.ceph.com]: set os type and version on server
2023-12-07T04:25:15.248 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com'
2023-12-07T04:25:15.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T04:25:15.318 DEBUG:teuthology.orchestra.run.smithi028:> true
2023-12-07T04:25:15.466 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi028.front.sepia.ceph.com'
2023-12-07T04:25:15.466 DEBUG:teuthology.orchestra.run.smithi028:> uname -m
2023-12-07T04:25:15.526 INFO:teuthology.orchestra.run.smithi028.stdout:x86_64
2023-12-07T04:25:15.527 DEBUG:teuthology.orchestra.run.smithi028:> cat /etc/os-release
2023-12-07T04:25:15.586 INFO:teuthology.orchestra.run.smithi028.stdout:NAME="CentOS Stream"
2023-12-07T04:25:15.587 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION="8"
2023-12-07T04:25:15.587 INFO:teuthology.orchestra.run.smithi028.stdout:ID="centos"
2023-12-07T04:25:15.587 INFO:teuthology.orchestra.run.smithi028.stdout:ID_LIKE="rhel fedora"
2023-12-07T04:25:15.587 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION_ID="8"
2023-12-07T04:25:15.587 INFO:teuthology.orchestra.run.smithi028.stdout:PLATFORM_ID="platform:el8"
2023-12-07T04:25:15.587 INFO:teuthology.orchestra.run.smithi028.stdout:PRETTY_NAME="CentOS Stream 8"
2023-12-07T04:25:15.587 INFO:teuthology.orchestra.run.smithi028.stdout:ANSI_COLOR="0;31"
2023-12-07T04:25:15.587 INFO:teuthology.orchestra.run.smithi028.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-12-07T04:25:15.587 INFO:teuthology.orchestra.run.smithi028.stdout:HOME_URL="https://centos.org/"
2023-12-07T04:25:15.587 INFO:teuthology.orchestra.run.smithi028.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-07T04:25:15.587 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-07T04:25:15.587 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-07T04:25:15.588 INFO:teuthology.lock.ops:Updating smithi028.front.sepia.ceph.com on lock server
2023-12-07T04:25:15.613 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: set os type and version on server
2023-12-07T04:25:15.613 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com'
2023-12-07T04:25:15.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T04:25:15.684 DEBUG:teuthology.orchestra.run.smithi138:> true
2023-12-07T04:25:15.823 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com'
2023-12-07T04:25:15.823 DEBUG:teuthology.orchestra.run.smithi138:> uname -m
2023-12-07T04:25:15.883 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64
2023-12-07T04:25:15.883 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release
2023-12-07T04:25:15.943 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="CentOS Stream"
2023-12-07T04:25:15.943 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="8"
2023-12-07T04:25:15.943 INFO:teuthology.orchestra.run.smithi138.stdout:ID="centos"
2023-12-07T04:25:15.943 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="rhel fedora"
2023-12-07T04:25:15.943 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="8"
2023-12-07T04:25:15.944 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el8"
2023-12-07T04:25:15.944 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="CentOS Stream 8"
2023-12-07T04:25:15.944 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31"
2023-12-07T04:25:15.944 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-12-07T04:25:15.944 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://centos.org/"
2023-12-07T04:25:15.944 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-07T04:25:15.944 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-07T04:25:15.944 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-07T04:25:15.945 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server
2023-12-07T04:25:15.963 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server
2023-12-07T04:25:15.964 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com'
2023-12-07T04:25:15.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T04:25:16.031 DEBUG:teuthology.orchestra.run.smithi161:> true
2023-12-07T04:25:16.102 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com'
2023-12-07T04:25:16.103 DEBUG:teuthology.orchestra.run.smithi161:> uname -m
2023-12-07T04:25:16.161 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64
2023-12-07T04:25:16.162 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release
2023-12-07T04:25:16.220 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream"
2023-12-07T04:25:16.220 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8"
2023-12-07T04:25:16.221 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos"
2023-12-07T04:25:16.221 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora"
2023-12-07T04:25:16.221 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8"
2023-12-07T04:25:16.221 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8"
2023-12-07T04:25:16.221 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 8"
2023-12-07T04:25:16.221 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31"
2023-12-07T04:25:16.221 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-12-07T04:25:16.221 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/"
2023-12-07T04:25:16.221 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-07T04:25:16.222 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-07T04:25:16.222 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-07T04:25:16.222 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server
2023-12-07T04:25:16.246 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T04:25:16.338 INFO:teuthology.dispatcher.supervisor:Running job 7481270
2023-12-07T04:25:16.339 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-07_01:25:59-rados-wip-yuri8-testing-2023-12-06-1425-distro-default-smithi/7481270 --name yuriw-2023-12-07_01:25:59-rados-wip-yuri8-testing-2023-12-06-1425-distro-default-smithi --description rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/connectivity task/test_rgw_multisite} -- /home/teuthworker/archive/yuriw-2023-12-07_01:25:59-rados-wip-yuri8-testing-2023-12-06-1425-distro-default-smithi/7481270/orig.config.yaml
2023-12-07T04:25:16.342 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-07_01:25:59-rados-wip-yuri8-testing-2023-12-06-1425-distro-default-smithi/7481270
2023-12-07T04:25:16.342 INFO:teuthology.dispatcher.supervisor:Job PID: 2571815
2023-12-07T04:25:16.342 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-12-07T04:27:16.344 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T04:29:16.422 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T04:31:16.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T04:33:16.562 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T04:35:16.630 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T04:37:16.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T04:39:16.765 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T04:41:16.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T04:43:16.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T04:45:16.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T04:47:17.045 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T04:49:17.116 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T04:51:17.181 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T04:53:17.254 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T04:55:17.320 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T04:57:17.384 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T04:59:17.456 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T05:01:17.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T05:03:17.606 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T05:05:17.682 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T05:07:17.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T05:09:17.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T05:11:17.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T05:13:17.968 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T05:15:18.064 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T05:17:18.128 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T05:19:18.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T05:21:18.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T05:23:18.323 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T05:25:18.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T05:27:18.454 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T05:29:18.522 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T05:31:18.589 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T05:33:18.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T05:35:18.720 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T05:37:18.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T05:39:18.856 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T05:41:18.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T05:43:18.997 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T05:45:19.064 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T05:47:19.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T05:49:19.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T05:51:19.265 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T05:53:19.334 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T05:55:19.408 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T05:57:19.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T05:59:19.533 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T06:01:19.599 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T06:03:19.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T06:05:19.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T06:07:19.817 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T06:09:19.885 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T06:11:19.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T06:13:20.029 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T06:15:20.121 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T06:17:20.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T06:19:20.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T06:21:20.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T06:23:20.486 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T06:25:20.554 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T06:27:20.620 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T06:29:20.694 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T06:31:20.761 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T06:33:20.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T06:35:20.888 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T06:37:20.954 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T06:39:21.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T06:41:21.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T06:43:21.158 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T06:45:21.233 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T06:47:21.298 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T06:49:21.365 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T06:51:21.459 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T06:53:21.526 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T06:55:21.593 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T06:57:21.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T06:59:21.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T07:01:22.005 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T07:03:22.072 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T07:05:22.149 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T07:07:22.206 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T07:09:22.276 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T07:11:22.332 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T07:13:22.401 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T07:15:22.468 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T07:17:22.562 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T07:19:22.636 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T07:21:22.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T07:23:22.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T07:25:22.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T07:27:22.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T07:29:22.966 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T07:31:23.050 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T07:33:23.110 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T07:35:23.184 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T07:37:23.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T07:39:23.330 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T07:41:23.402 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T07:43:23.462 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T07:45:23.529 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T07:47:23.594 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T07:49:23.666 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T07:51:23.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T07:53:23.822 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T07:55:23.900 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T07:57:23.982 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T07:59:24.066 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T08:01:24.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T08:03:24.252 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T08:05:24.326 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T08:07:24.416 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T08:09:24.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T08:11:24.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T08:13:24.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T08:15:24.754 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T08:17:24.837 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T08:19:24.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T08:21:24.989 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T08:23:25.088 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T08:25:25.170 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T08:27:25.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T08:29:25.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T08:31:25.416 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T08:33:25.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T08:35:25.552 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T08:37:25.620 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T08:39:25.686 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T08:41:25.762 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T08:43:25.852 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T08:45:25.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T08:47:25.990 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T08:49:26.070 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T08:51:26.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T08:53:26.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T08:55:26.305 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T08:57:26.378 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T08:59:26.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T09:01:26.528 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T09:03:26.622 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T09:05:26.708 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T09:07:26.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T09:09:26.866 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T09:11:26.951 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T09:13:27.026 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T09:15:27.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T09:17:27.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T09:19:27.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T09:21:27.350 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T09:23:27.408 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T09:25:27.488 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T09:27:27.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T09:29:27.636 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T09:31:27.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T09:33:27.808 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T09:35:27.876 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T09:37:27.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T09:39:28.029 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T09:41:28.120 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T09:43:28.194 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T09:45:28.262 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T09:47:28.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T09:49:28.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T09:51:28.488 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T09:53:28.548 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T09:55:28.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T09:57:28.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T09:59:28.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:01:28.837 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:03:28.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:05:28.986 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:07:29.058 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:09:29.134 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:11:29.240 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:13:29.314 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:15:29.382 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:17:29.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:19:29.514 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:21:29.582 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:23:29.653 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:25:29.732 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:27:29.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:29:29.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:31:29.949 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:33:30.024 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:35:30.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:37:30.170 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:39:30.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:41:30.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:43:30.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:45:30.480 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:47:30.545 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:49:30.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:51:30.686 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:53:30.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:55:30.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:57:30.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:59:30.953 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T11:01:31.029 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T11:03:31.102 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T11:05:31.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T11:07:31.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T11:09:31.321 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T11:11:31.388 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T11:13:31.458 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T11:15:31.526 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T11:17:31.590 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T11:19:31.669 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T11:21:31.732 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T11:23:31.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T11:25:31.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T11:27:31.937 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T11:29:32.006 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T11:31:32.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T11:33:32.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T11:35:32.224 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T11:37:32.433 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T11:39:32.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T11:41:32.558 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T11:43:32.634 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T11:45:32.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T11:47:32.774 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T11:49:32.854 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T11:51:32.926 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T11:53:32.993 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T11:55:33.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T11:57:33.132 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T11:59:33.197 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T12:01:33.269 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T12:03:33.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T12:05:33.414 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T12:07:33.496 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T12:09:33.569 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T12:11:33.640 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T12:13:33.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T12:15:33.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T12:17:33.838 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T12:19:33.906 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T12:21:33.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T12:23:34.061 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T12:25:34.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T12:27:34.218 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T12:29:34.282 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T12:31:34.358 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T12:33:34.432 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T12:35:34.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T12:37:34.557 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T12:39:34.616 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T12:41:34.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T12:43:34.776 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T12:45:34.860 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T12:47:34.924 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T12:49:34.990 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T12:51:35.065 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T12:53:35.138 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T12:55:35.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T12:57:35.268 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T12:59:35.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T13:01:35.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T13:03:35.486 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T13:05:35.560 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T13:07:35.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T13:09:35.692 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T13:11:35.757 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T13:13:35.822 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T13:15:35.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T13:17:35.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T13:19:36.030 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T13:21:36.105 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T13:23:36.178 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T13:25:36.262 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T13:27:36.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T13:29:36.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T13:31:36.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T13:33:36.572 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T13:35:36.630 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T13:37:36.730 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T13:39:36.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T13:41:36.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T13:43:36.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T13:45:37.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T13:47:37.104 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T13:49:37.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T13:51:37.244 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T13:53:37.312 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T13:55:37.390 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T13:57:37.453 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T13:59:37.522 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T14:01:37.596 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T14:03:37.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T14:05:37.738 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T14:07:37.800 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T14:09:37.877 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T14:11:37.951 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T14:13:38.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T14:15:38.084 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T14:17:38.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T14:19:38.233 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T14:21:38.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T14:23:38.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T14:25:38.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T14:27:38.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T14:29:38.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T14:31:38.670 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T14:33:38.745 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T14:35:38.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T14:37:38.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T14:39:38.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T14:41:39.034 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T14:43:39.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T14:45:39.200 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T14:47:39.272 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T14:49:39.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T14:51:39.421 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T14:53:39.500 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T14:55:39.574 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T14:57:39.638 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T14:59:39.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T15:01:39.789 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T15:03:39.858 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T15:05:39.942 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T15:07:40.016 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T15:09:40.084 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T15:11:40.158 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T15:13:40.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T15:15:40.305 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T15:17:40.376 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T15:19:40.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T15:21:40.541 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T15:23:40.610 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T15:25:40.680 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T15:27:40.758 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T15:29:40.830 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T15:31:40.904 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T15:33:40.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T15:35:41.089 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T15:37:41.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T15:39:41.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T15:41:41.288 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T15:43:41.362 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T15:45:41.429 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T15:47:41.485 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T15:49:41.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T15:51:41.624 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T15:53:41.698 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T15:55:41.762 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T15:57:41.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T15:59:41.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T16:01:41.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T16:03:42.054 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T16:05:42.133 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T16:07:42.205 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T16:09:42.269 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T16:11:42.332 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T16:13:42.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T16:15:42.486 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T16:17:42.585 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T16:19:42.878 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T16:21:42.945 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T16:23:43.008 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T16:25:43.073 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2023-12-07T16:25:43.193 INFO:teuthology.kill:Killing Pids: {2571815}
2023-12-07T16:25:43.932 INFO:teuthology.task.internal:roles: ubuntu@smithi028.front.sepia.ceph.com - ['host.a', 'mon.a', 'mgr.a', 'osd.0']
2023-12-07T16:25:43.932 INFO:teuthology.task.internal:roles: ubuntu@smithi138.front.sepia.ceph.com - ['host.b', 'mon.b', 'mgr.b', 'osd.1']
2023-12-07T16:25:43.932 INFO:teuthology.task.internal:roles: ubuntu@smithi161.front.sepia.ceph.com - ['host.c', 'mon.c', 'osd.2']
2023-12-07T16:25:43.933 INFO:teuthology.misc:Compressing logs...
2023-12-07T16:25:43.933 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com'
2023-12-07T16:25:43.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T16:25:44.006 DEBUG:teuthology.orchestra.run.smithi028:> true
2023-12-07T16:25:44.082 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi028.front.sepia.ceph.com'
2023-12-07T16:25:44.082 DEBUG:teuthology.orchestra.run.smithi028:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose --
2023-12-07T16:25:44.124 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com'
2023-12-07T16:25:44.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T16:25:44.197 DEBUG:teuthology.orchestra.run.smithi138:> true
2023-12-07T16:25:44.271 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com'
2023-12-07T16:25:44.271 DEBUG:teuthology.orchestra.run.smithi138:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose --
2023-12-07T16:25:44.314 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com'
2023-12-07T16:25:44.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T16:25:44.382 DEBUG:teuthology.orchestra.run.smithi161:> true
2023-12-07T16:25:44.454 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com'
2023-12-07T16:25:44.454 DEBUG:teuthology.orchestra.run.smithi161:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose --
2023-12-07T16:25:44.532 DEBUG:teuthology.misc:Transferring archived files from smithi028:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-07_01:25:59-rados-wip-yuri8-testing-2023-12-06-1425-distro-default-smithi/7481270/remote/smithi028/crash
2023-12-07T16:25:44.533 DEBUG:teuthology.orchestra.run.smithi028:> sudo tar c -f - -C /var/lib/ceph/crash -- .
2023-12-07T16:25:44.578 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-07_01:25:59-rados-wip-yuri8-testing-2023-12-06-1425-distro-default-smithi/7481270/remote/smithi138/crash
2023-12-07T16:25:44.582 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /var/lib/ceph/crash -- .
2023-12-07T16:25:44.627 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-07_01:25:59-rados-wip-yuri8-testing-2023-12-06-1425-distro-default-smithi/7481270/remote/smithi161/crash
2023-12-07T16:25:44.628 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /var/lib/ceph/crash -- .
2023-12-07T16:25:44.687 INFO:teuthology.misc:Compressing logs...
2023-12-07T16:25:44.687 DEBUG:teuthology.orchestra.run.smithi028:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose --
2023-12-07T16:25:44.690 DEBUG:teuthology.orchestra.run.smithi138:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose --
2023-12-07T16:25:44.692 DEBUG:teuthology.orchestra.run.smithi161:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose --
2023-12-07T16:25:44.719 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log
2023-12-07T16:25:44.719 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log
2023-12-07T16:25:44.720 INFO:teuthology.orchestra.run.smithi161.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log:	 82.2% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz
2023-12-07T16:25:44.720 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log
2023-12-07T16:25:44.721 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log
2023-12-07T16:25:44.721 INFO:teuthology.orchestra.run.smithi138.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log:	 82.3% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz
2023-12-07T16:25:44.723 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log
2023-12-07T16:25:44.723 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log
2023-12-07T16:25:44.724 INFO:teuthology.orchestra.run.smithi028.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log:	/home/ubuntu/cephtest/archive/syslog/misc.log:	 80.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz
2023-12-07T16:25:44.773 INFO:teuthology.orchestra.run.smithi161.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log:	 91.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz
2023-12-07T16:25:44.775 INFO:teuthology.orchestra.run.smithi138.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log:	 91.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz
2023-12-07T16:25:44.786 INFO:teuthology.orchestra.run.smithi028.stderr: 91.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz
2023-12-07T16:25:44.789 DEBUG:teuthology.misc:Transferring archived files from smithi028:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-07_01:25:59-rados-wip-yuri8-testing-2023-12-06-1425-distro-default-smithi/7481270/remote/smithi028/
2023-12-07T16:25:44.789 DEBUG:teuthology.orchestra.run.smithi028:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- .
2023-12-07T16:25:44.872 DEBUG:teuthology.misc:Transferring archived files from smithi138:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-07_01:25:59-rados-wip-yuri8-testing-2023-12-06-1425-distro-default-smithi/7481270/remote/smithi138/
2023-12-07T16:25:44.872 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- .
2023-12-07T16:25:44.912 DEBUG:teuthology.misc:Transferring archived files from smithi161:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-07_01:25:59-rados-wip-yuri8-testing-2023-12-06-1425-distro-default-smithi/7481270/remote/smithi161/
2023-12-07T16:25:44.912 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- .
2023-12-07T16:25:44.948 INFO:teuthology.misc:Compressing logs...
2023-12-07T16:25:44.949 DEBUG:teuthology.orchestra.run.smithi028:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose --
2023-12-07T16:25:44.951 DEBUG:teuthology.orchestra.run.smithi138:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose --
2023-12-07T16:25:44.954 DEBUG:teuthology.orchestra.run.smithi161:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose --
2023-12-07T16:25:44.979 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log
2023-12-07T16:25:44.980 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ff40de92-94ba-11ee-95a2-87774f69a715/ceph-volume.log
2023-12-07T16:25:44.981 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/cephadm.log:	gzip -5 --verbose -- /var/log/ceph/ff40de92-94ba-11ee-95a2-87774f69a715/ceph-mgr.b.log
2023-12-07T16:25:44.981 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ff40de92-94ba-11ee-95a2-87774f69a715/ceph-mon.b.log
2023-12-07T16:25:44.981 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ff40de92-94ba-11ee-95a2-87774f69a715/ceph-volume.log:	gzip -5 --verbose -- /var/log/ceph/ff40de92-94ba-11ee-95a2-87774f69a715/ceph-osd.1.log
2023-12-07T16:25:44.982 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ff40de92-94ba-11ee-95a2-87774f69a715/ceph-mgr.b.log:	/var/log/ceph/ff40de92-94ba-11ee-95a2-87774f69a715/ceph-mon.b.log:	/var/log/ceph/ff40de92-94ba-11ee-95a2-87774f69a715/ceph-osd.1.log:	 91.5% -- replaced with /var/log/ceph/cephadm.log.gz
2023-12-07T16:25:44.984 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log
2023-12-07T16:25:44.985 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ff40de92-94ba-11ee-95a2-87774f69a715/ceph-volume.log
2023-12-07T16:25:44.986 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ff40de92-94ba-11ee-95a2-87774f69a715/ceph-osd.0.log
2023-12-07T16:25:44.986 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/cephadm.log:	gzip -5 --verbose -- /var/log/ceph/ff40de92-94ba-11ee-95a2-87774f69a715/ceph-mgr.a.log
2023-12-07T16:25:44.986 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ff40de92-94ba-11ee-95a2-87774f69a715/ceph-volume.log:	/var/log/ceph/ff40de92-94ba-11ee-95a2-87774f69a715/ceph-osd.0.log:	gzip -5 --verbose -- /var/log/ceph/ff40de92-94ba-11ee-95a2-87774f69a715/ceph-mon.a.log
2023-12-07T16:25:44.988 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ff40de92-94ba-11ee-95a2-87774f69a715/ceph-mgr.a.log:	/var/log/ceph/ff40de92-94ba-11ee-95a2-87774f69a715/ceph-mon.a.log:	 91.3% -- replaced with /var/log/ceph/cephadm.log.gz
2023-12-07T16:25:44.994 INFO:teuthology.orchestra.run.smithi138.stderr: 91.8% -- replaced with /var/log/ceph/ff40de92-94ba-11ee-95a2-87774f69a715/ceph-volume.log.gz
2023-12-07T16:25:45.001 INFO:teuthology.orchestra.run.smithi028.stderr: 91.8% -- replaced with /var/log/ceph/ff40de92-94ba-11ee-95a2-87774f69a715/ceph-volume.log.gz
2023-12-07T16:25:45.011 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log
2023-12-07T16:25:45.012 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ff40de92-94ba-11ee-95a2-87774f69a715/ceph-volume.log
2023-12-07T16:25:45.012 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ff40de92-94ba-11ee-95a2-87774f69a715/ceph-osd.2.log
2023-12-07T16:25:45.012 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/cephadm.log:	gzip -5 --verbose -- /var/log/ceph/ff40de92-94ba-11ee-95a2-87774f69a715/ceph-mon.c.log
2023-12-07T16:25:45.014 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ff40de92-94ba-11ee-95a2-87774f69a715/ceph-volume.log:	/var/log/ceph/ff40de92-94ba-11ee-95a2-87774f69a715/ceph-osd.2.log:	/var/log/ceph/ff40de92-94ba-11ee-95a2-87774f69a715/ceph-mon.c.log:	 91.6% -- replaced with /var/log/ceph/cephadm.log.gz
2023-12-07T16:25:45.025 INFO:teuthology.orchestra.run.smithi161.stderr: 91.8% -- replaced with /var/log/ceph/ff40de92-94ba-11ee-95a2-87774f69a715/ceph-volume.log.gz
2023-12-07T16:25:45.063 INFO:teuthology.orchestra.run.smithi138.stderr: 94.5% -- replaced with /var/log/ceph/ff40de92-94ba-11ee-95a2-87774f69a715/ceph-mgr.b.log.gz
2023-12-07T16:25:50.678 INFO:teuthology.orchestra.run.smithi028.stderr:gzip: /var/log/ceph/ff40de92-94ba-11ee-95a2-87774f69a715/ceph-mgr.a.log: file size changed while zipping
2023-12-07T16:25:50.678 INFO:teuthology.orchestra.run.smithi028.stderr: 89.7% -- replaced with /var/log/ceph/ff40de92-94ba-11ee-95a2-87774f69a715/ceph-mgr.a.log.gz
2023-12-07T16:25:52.696 INFO:teuthology.orchestra.run.smithi138.stderr:gzip: /var/log/ceph/ff40de92-94ba-11ee-95a2-87774f69a715/ceph-mon.b.log: file size changed while zipping
2023-12-07T16:25:52.696 INFO:teuthology.orchestra.run.smithi138.stderr: 92.7% -- replaced with /var/log/ceph/ff40de92-94ba-11ee-95a2-87774f69a715/ceph-mon.b.log.gz
2023-12-07T16:25:52.942 INFO:teuthology.orchestra.run.smithi161.stderr:gzip: /var/log/ceph/ff40de92-94ba-11ee-95a2-87774f69a715/ceph-mon.c.log: file size changed while zipping
2023-12-07T16:25:52.942 INFO:teuthology.orchestra.run.smithi161.stderr: 92.6% -- replaced with /var/log/ceph/ff40de92-94ba-11ee-95a2-87774f69a715/ceph-mon.c.log.gz
2023-12-07T16:25:58.699 INFO:teuthology.orchestra.run.smithi138.stderr:gzip: /var/log/ceph/ff40de92-94ba-11ee-95a2-87774f69a715/ceph-osd.1.log: file size changed while zipping
2023-12-07T16:25:58.699 INFO:teuthology.orchestra.run.smithi138.stderr: 94.0% -- replaced with /var/log/ceph/ff40de92-94ba-11ee-95a2-87774f69a715/ceph-osd.1.log.gz
2023-12-07T16:26:01.711 INFO:teuthology.orchestra.run.smithi161.stderr:gzip: /var/log/ceph/ff40de92-94ba-11ee-95a2-87774f69a715/ceph-osd.2.log: file size changed while zipping
2023-12-07T16:26:01.711 INFO:teuthology.orchestra.run.smithi161.stderr: 94.2% -- replaced with /var/log/ceph/ff40de92-94ba-11ee-95a2-87774f69a715/ceph-osd.2.log.gz
2023-12-07T16:26:01.903 INFO:teuthology.orchestra.run.smithi028.stderr:gzip: /var/log/ceph/ff40de92-94ba-11ee-95a2-87774f69a715/ceph-osd.0.log: file size changed while zipping
2023-12-07T16:26:01.903 INFO:teuthology.orchestra.run.smithi028.stderr: 94.0% -- replaced with /var/log/ceph/ff40de92-94ba-11ee-95a2-87774f69a715/ceph-osd.0.log.gz
2023-12-07T16:26:14.275 INFO:teuthology.orchestra.run.smithi028.stderr:gzip: /var/log/ceph/ff40de92-94ba-11ee-95a2-87774f69a715/ceph-mon.a.log: file size changed while zipping
2023-12-07T16:26:14.275 INFO:teuthology.orchestra.run.smithi028.stderr: 91.8% -- replaced with /var/log/ceph/ff40de92-94ba-11ee-95a2-87774f69a715/ceph-mon.a.log.gz
2023-12-07T16:26:14.277 DEBUG:teuthology.misc:Transferring archived files from smithi028:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-07_01:25:59-rados-wip-yuri8-testing-2023-12-06-1425-distro-default-smithi/7481270/remote/smithi028/log
2023-12-07T16:26:14.279 DEBUG:teuthology.orchestra.run.smithi028:> sudo tar c -f - -C /var/log/ceph -- .
2023-12-07T16:26:21.542 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-07_01:25:59-rados-wip-yuri8-testing-2023-12-06-1425-distro-default-smithi/7481270/remote/smithi138/log
2023-12-07T16:26:21.543 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /var/log/ceph -- .
2023-12-07T16:26:24.651 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-07_01:25:59-rados-wip-yuri8-testing-2023-12-06-1425-distro-default-smithi/7481270/remote/smithi161/log
2023-12-07T16:26:24.652 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /var/log/ceph -- .
2023-12-07T16:26:28.119 INFO:teuthology.kill:No teuthology processes running
2023-12-07T16:26:28.119 ERROR:teuthology.dispatcher.supervisor:Failed to kill job and unlock machines
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/dispatcher/supervisor.py", line 331, in run_with_watchdog
    kill.kill_job(
  File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/kill.py", line 89, in kill_job
    if kill_processes(run_name, [job_info.get('pid')]):
  File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/kill.py", line 210, in kill_processes
    if survivors:
UnboundLocalError: local variable 'survivors' referenced before assignment
2023-12-07T16:26:28.120 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T16:28:28.197 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T16:28:28.302 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2023-12-07T16:28:28.409 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-12-07T16:28:28.409 INFO:teuthology.nuke:Checking targets against current locks
2023-12-07T16:28:28.460 DEBUG:teuthology.nuke:shortname: smithi028
2023-12-07T16:28:28.461 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-07T16:28:28.493 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi028.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-07_01:25:59-rados-wip-yuri8-testing-2023-12-06-1425-distro-default-smithi/7481270', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-07 04:19:58.086724', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEJ8eD0VG3LiTg9QVeUTtyJ3FQMkWH1MW+A7dEXP6GzaoOn9fdNTRuIeVyi/ESOsVqCTVbMkc+dJXNdgOJEk1J4='}
2023-12-07T16:28:28.494 DEBUG:teuthology.nuke:shortname: smithi138
2023-12-07T16:28:28.494 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-07T16:28:28.517 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi138.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-07_01:25:59-rados-wip-yuri8-testing-2023-12-06-1425-distro-default-smithi/7481270', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-07 04:19:58.088227', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM9GGuLl5m7k5R7z7sH4naAY9SxBAbSdrRw9/eoQvLtZZGzS+EogjjV6mF4YE+u0YlQQmPR/S//RTc8Qooht2GM='}
2023-12-07T16:28:28.522 DEBUG:teuthology.nuke:shortname: smithi161
2023-12-07T16:28:28.523 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-07T16:28:28.549 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-07_01:25:59-rados-wip-yuri8-testing-2023-12-06-1425-distro-default-smithi/7481270', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-07 04:19:58.089403', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKB7sW8pNC1WBAhfajz4YiXjrsIrlllDcNrQYK5lgsak8NicqIYOIGTIjED4lWOMTV/jre9sN7jfG9sEX6/DFIw='}
2023-12-07T16:28:28.559 INFO:teuthology.orchestra.console.smithi028:Power off
2023-12-07T16:28:28.559 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-07T16:28:28.590 DEBUG:teuthology.orchestra.console.smithi028:power off output: Chassis Power Control: Down/Off
2023-12-07T16:28:28.590 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T16:28:28.609 INFO:teuthology.orchestra.console.smithi138:Power off
2023-12-07T16:28:28.609 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-07T16:28:28.617 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is on
2023-12-07T16:28:28.629 DEBUG:teuthology.orchestra.console.smithi138:power off output: Chassis Power Control: Down/Off
2023-12-07T16:28:28.630 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T16:28:28.641 INFO:teuthology.orchestra.console.smithi161:Power off
2023-12-07T16:28:28.641 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-07T16:28:28.650 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on
2023-12-07T16:28:28.661 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off
2023-12-07T16:28:28.661 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T16:28:28.681 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on
2023-12-07T16:28:32.618 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T16:28:32.652 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T16:28:32.683 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T16:28:32.729 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is on
2023-12-07T16:28:32.761 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on
2023-12-07T16:28:32.793 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on
2023-12-07T16:28:36.730 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T16:28:36.761 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T16:28:36.794 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T16:28:36.838 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is off
2023-12-07T16:28:36.871 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on
2023-12-07T16:28:36.902 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off
2023-12-07T16:28:36.938 INFO:teuthology.orchestra.console.smithi028:Power off completed
2023-12-07T16:28:37.003 INFO:teuthology.orchestra.console.smithi161:Power off completed
2023-12-07T16:28:37.089 INFO:teuthology.lock.ops:unlocked: smithi028.front.sepia.ceph.com
2023-12-07T16:28:37.146 INFO:teuthology.lock.ops:unlocked: smithi161.front.sepia.ceph.com
2023-12-07T16:28:40.872 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T16:28:40.980 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off
2023-12-07T16:28:41.081 INFO:teuthology.orchestra.console.smithi138:Power off completed
2023-12-07T16:28:41.229 INFO:teuthology.lock.ops:unlocked: smithi138.front.sepia.ceph.com