2023-12-01T15:10:05.902 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-01T15:10:05.902 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:10:06.049 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f13fca80f70>, signals=[15]) 2023-12-01T15:10:06.049 INFO:teuthology.lock.ops:Start node 'smithi094.front.sepia.ceph.com' reimaging 2023-12-01T15:10:06.049 INFO:teuthology.lock.ops:Updating [smithi094.front.sepia.ceph.com]: reset os type and version on server 2023-12-01T15:10:06.050 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server 2023-12-01T15:10:06.069 INFO:teuthology.lock.ops:Start node 'smithi176.front.sepia.ceph.com' reimaging 2023-12-01T15:10:06.069 INFO:teuthology.lock.ops:Updating [smithi176.front.sepia.ceph.com]: reset os type and version on server 2023-12-01T15:10:06.069 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server 2023-12-01T15:10:06.181 DEBUG:teuthology.provision.fog.smithi094:Requesting image smithi_centos_8.stream (ID 3) 2023-12-01T15:10:06.200 DEBUG:teuthology.provision.fog.smithi176:Requesting image smithi_centos_8.stream (ID 3) 2023-12-01T15:10:06.222 INFO:teuthology.provision.fog.smithi094:Scheduling deploy of centos 8.stream 2023-12-01T15:10:06.244 INFO:teuthology.provision.fog.smithi176:Scheduling deploy of centos 8.stream 2023-12-01T15:10:06.474 INFO:teuthology.orchestra.console.smithi094:Power off 2023-12-01T15:10:06.474 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-01T15:10:06.489 INFO:teuthology.orchestra.console.smithi176:Power off 2023-12-01T15:10:06.490 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-01T15:10:06.497 DEBUG:teuthology.orchestra.console.smithi094:power off output: Chassis Power Control: Down/Off 2023-12-01T15:10:06.498 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T15:10:06.511 DEBUG:teuthology.orchestra.console.smithi176:power off output: Chassis Power Control: Down/Off 2023-12-01T15:10:06.511 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T15:10:06.520 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on 2023-12-01T15:10:06.533 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is on 2023-12-01T15:10:10.525 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T15:10:10.534 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T15:10:10.634 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on 2023-12-01T15:10:10.642 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is on 2023-12-01T15:10:14.641 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T15:10:14.647 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T15:10:14.749 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off 2023-12-01T15:10:14.755 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is on 2023-12-01T15:10:14.850 INFO:teuthology.orchestra.console.smithi094:Power off completed 2023-12-01T15:10:14.951 INFO:teuthology.orchestra.console.smithi094:Power on 2023-12-01T15:10:14.952 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-01T15:10:14.971 DEBUG:teuthology.orchestra.console.smithi094:power on output: Chassis Power Control: Up/On 2023-12-01T15:10:14.972 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T15:10:14.991 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off 2023-12-01T15:10:18.759 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T15:10:18.867 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is off 2023-12-01T15:10:18.968 INFO:teuthology.orchestra.console.smithi176:Power off completed 2023-12-01T15:10:18.992 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T15:10:19.068 INFO:teuthology.orchestra.console.smithi176:Power on 2023-12-01T15:10:19.069 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-01T15:10:19.088 DEBUG:teuthology.orchestra.console.smithi176:power on output: Chassis Power Control: Up/On 2023-12-01T15:10:19.089 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T15:10:19.099 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off 2023-12-01T15:10:19.110 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is off 2023-12-01T15:10:23.104 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T15:10:23.111 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T15:10:23.218 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is on 2023-12-01T15:10:23.319 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on 2023-12-01T15:10:23.319 INFO:teuthology.orchestra.console.smithi176:Power on completed 2023-12-01T15:10:23.420 INFO:teuthology.orchestra.console.smithi094:Power on completed 2023-12-01T15:10:23.420 INFO:teuthology.provision.fog.smithi176:Waiting for deploy to finish 2023-12-01T15:10:23.520 INFO:teuthology.provision.fog.smithi094:Waiting for deploy to finish 2023-12-01T15:13:10.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:13:10.450 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:13:13.445 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176 2023-12-01T15:13:13.506 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-12-01T15:13:19.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:13:19.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:13:22.530 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176 2023-12-01T15:13:22.562 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-12-01T15:13:28.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:13:28.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:13:31.586 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176 2023-12-01T15:13:31.622 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-12-01T15:13:37.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:13:37.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:13:40.674 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176 2023-12-01T15:13:40.675 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-12-01T15:13:46.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:13:46.685 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:13:49.762 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176 2023-12-01T15:13:49.762 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-12-01T15:13:55.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:13:55.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:13:58.818 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176 2023-12-01T15:13:58.818 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-12-01T15:14:04.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:14:04.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:14:10.914 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-12-01T15:14:16.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:14:20.002 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-12-01T15:14:26.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:14:29.094 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-12-01T15:14:35.101 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:14:35.800 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-01T15:14:35.800 DEBUG:teuthology.orchestra.run.smithi094:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-01T15:15:01.048 INFO:teuthology.provision.fog.smithi094:Node is ready 2023-12-01T15:15:01.048 DEBUG:teuthology.orchestra.run.smithi094:> hostname 2023-12-01T15:15:01.073 INFO:teuthology.orchestra.run.smithi094.stdout:smithi094.front.sepia.ceph.com 2023-12-01T15:15:01.073 DEBUG:teuthology.orchestra.run.smithi094:> grep smithi094.front.sepia.ceph.com /etc/hosts 2023-12-01T15:15:01.134 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.15.94 smithi094.front.sepia.ceph.com smithi094 2023-12-01T15:15:01.134 DEBUG:teuthology.orchestra.run.smithi094:> sudo hostname smithi094 2023-12-01T15:15:01.270 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i -e 's/smithi094.front.sepia.ceph.com/smithi094/g' /etc/hosts 2023-12-01T15:15:01.302 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i -e 's/172.21.15.94/172.21.15.94/g' /etc/hosts 2023-12-01T15:15:01.371 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i -e 's/smithi094.front.sepia.ceph.com/smithi094/g' /etc/hostname 2023-12-01T15:15:01.441 DEBUG:teuthology.orchestra.run.smithi094:> sudo hostname smithi094 2023-12-01T15:15:01.508 DEBUG:teuthology.orchestra.run.smithi094:> cat /etc/os-release 2023-12-01T15:15:01.568 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="CentOS Stream" 2023-12-01T15:15:01.568 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="8" 2023-12-01T15:15:01.568 INFO:teuthology.orchestra.run.smithi094.stdout:ID="centos" 2023-12-01T15:15:01.568 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE="rhel fedora" 2023-12-01T15:15:01.568 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="8" 2023-12-01T15:15:01.568 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM_ID="platform:el8" 2023-12-01T15:15:01.568 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-01T15:15:01.568 INFO:teuthology.orchestra.run.smithi094.stdout:ANSI_COLOR="0;31" 2023-12-01T15:15:01.568 INFO:teuthology.orchestra.run.smithi094.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-01T15:15:01.568 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://centos.org/" 2023-12-01T15:15:01.568 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-01T15:15:01.568 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-01T15:15:01.569 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-01T15:15:01.569 INFO:teuthology.provision.fog.smithi094:Deploy complete! 2023-12-01T15:15:01.570 DEBUG:teuthology.parallel:result is None 2023-12-01T15:15:04.825 WARNING:teuthology.provision.fog.smithi176:timed out 2023-12-01T15:15:10.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:15:11.084 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-01T15:15:11.084 DEBUG:teuthology.orchestra.run.smithi176:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-01T15:15:11.329 INFO:teuthology.provision.fog.smithi176:Node is ready 2023-12-01T15:15:11.330 DEBUG:teuthology.orchestra.run.smithi176:> hostname 2023-12-01T15:15:11.349 INFO:teuthology.orchestra.run.smithi176.stdout:smithi176.front.sepia.ceph.com 2023-12-01T15:15:11.349 DEBUG:teuthology.orchestra.run.smithi176:> grep smithi176.front.sepia.ceph.com /etc/hosts 2023-12-01T15:15:11.408 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.15.176 smithi176.front.sepia.ceph.com smithi176 2023-12-01T15:15:11.409 DEBUG:teuthology.orchestra.run.smithi176:> sudo hostname smithi176 2023-12-01T15:15:11.501 DEBUG:teuthology.orchestra.run.smithi176:> sudo sed -i -e 's/smithi176.front.sepia.ceph.com/smithi176/g' /etc/hosts 2023-12-01T15:15:11.531 DEBUG:teuthology.orchestra.run.smithi176:> sudo sed -i -e 's/172.21.15.176/172.21.15.176/g' /etc/hosts 2023-12-01T15:15:11.599 DEBUG:teuthology.orchestra.run.smithi176:> sudo sed -i -e 's/smithi176.front.sepia.ceph.com/smithi176/g' /etc/hostname 2023-12-01T15:15:11.667 DEBUG:teuthology.orchestra.run.smithi176:> sudo hostname smithi176 2023-12-01T15:15:11.734 DEBUG:teuthology.orchestra.run.smithi176:> cat /etc/os-release 2023-12-01T15:15:11.792 INFO:teuthology.orchestra.run.smithi176.stdout:NAME="CentOS Stream" 2023-12-01T15:15:11.792 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION="8" 2023-12-01T15:15:11.792 INFO:teuthology.orchestra.run.smithi176.stdout:ID="centos" 2023-12-01T15:15:11.792 INFO:teuthology.orchestra.run.smithi176.stdout:ID_LIKE="rhel fedora" 2023-12-01T15:15:11.792 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_ID="8" 2023-12-01T15:15:11.792 INFO:teuthology.orchestra.run.smithi176.stdout:PLATFORM_ID="platform:el8" 2023-12-01T15:15:11.792 INFO:teuthology.orchestra.run.smithi176.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-01T15:15:11.792 INFO:teuthology.orchestra.run.smithi176.stdout:ANSI_COLOR="0;31" 2023-12-01T15:15:11.792 INFO:teuthology.orchestra.run.smithi176.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-01T15:15:11.792 INFO:teuthology.orchestra.run.smithi176.stdout:HOME_URL="https://centos.org/" 2023-12-01T15:15:11.793 INFO:teuthology.orchestra.run.smithi176.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-01T15:15:11.793 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-01T15:15:11.793 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-01T15:15:11.793 INFO:teuthology.provision.fog.smithi176:Deploy complete! 2023-12-01T15:15:11.793 DEBUG:teuthology.parallel:result is None 2023-12-01T15:15:11.942 INFO:teuthology.lock.ops:Checking smithi094.front.sepia.ceph.com 2023-12-01T15:15:11.942 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-01T15:15:11.965 INFO:teuthology.lock.ops:Checking smithi176.front.sepia.ceph.com 2023-12-01T15:15:11.965 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-01T15:15:11.991 INFO:teuthology.lock.ops:Updating [smithi094.front.sepia.ceph.com]: set os type and version on server 2023-12-01T15:15:11.991 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2023-12-01T15:15:11.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:15:12.057 DEBUG:teuthology.orchestra.run.smithi094:> true 2023-12-01T15:15:12.188 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi094.front.sepia.ceph.com' 2023-12-01T15:15:12.189 DEBUG:teuthology.orchestra.run.smithi094:> uname -m 2023-12-01T15:15:12.247 INFO:teuthology.orchestra.run.smithi094.stdout:x86_64 2023-12-01T15:15:12.248 DEBUG:teuthology.orchestra.run.smithi094:> cat /etc/os-release 2023-12-01T15:15:12.306 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="CentOS Stream" 2023-12-01T15:15:12.306 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="8" 2023-12-01T15:15:12.306 INFO:teuthology.orchestra.run.smithi094.stdout:ID="centos" 2023-12-01T15:15:12.306 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE="rhel fedora" 2023-12-01T15:15:12.306 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="8" 2023-12-01T15:15:12.306 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM_ID="platform:el8" 2023-12-01T15:15:12.306 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-01T15:15:12.306 INFO:teuthology.orchestra.run.smithi094.stdout:ANSI_COLOR="0;31" 2023-12-01T15:15:12.307 INFO:teuthology.orchestra.run.smithi094.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-01T15:15:12.307 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://centos.org/" 2023-12-01T15:15:12.307 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-01T15:15:12.307 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-01T15:15:12.307 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-01T15:15:12.307 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server 2023-12-01T15:15:12.332 INFO:teuthology.lock.ops:Updating [smithi176.front.sepia.ceph.com]: set os type and version on server 2023-12-01T15:15:12.332 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2023-12-01T15:15:12.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:15:12.400 DEBUG:teuthology.orchestra.run.smithi176:> true 2023-12-01T15:15:12.468 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi176.front.sepia.ceph.com' 2023-12-01T15:15:12.468 DEBUG:teuthology.orchestra.run.smithi176:> uname -m 2023-12-01T15:15:12.526 INFO:teuthology.orchestra.run.smithi176.stdout:x86_64 2023-12-01T15:15:12.526 DEBUG:teuthology.orchestra.run.smithi176:> cat /etc/os-release 2023-12-01T15:15:12.584 INFO:teuthology.orchestra.run.smithi176.stdout:NAME="CentOS Stream" 2023-12-01T15:15:12.584 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION="8" 2023-12-01T15:15:12.584 INFO:teuthology.orchestra.run.smithi176.stdout:ID="centos" 2023-12-01T15:15:12.584 INFO:teuthology.orchestra.run.smithi176.stdout:ID_LIKE="rhel fedora" 2023-12-01T15:15:12.584 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_ID="8" 2023-12-01T15:15:12.584 INFO:teuthology.orchestra.run.smithi176.stdout:PLATFORM_ID="platform:el8" 2023-12-01T15:15:12.584 INFO:teuthology.orchestra.run.smithi176.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-01T15:15:12.584 INFO:teuthology.orchestra.run.smithi176.stdout:ANSI_COLOR="0;31" 2023-12-01T15:15:12.584 INFO:teuthology.orchestra.run.smithi176.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-01T15:15:12.584 INFO:teuthology.orchestra.run.smithi176.stdout:HOME_URL="https://centos.org/" 2023-12-01T15:15:12.584 INFO:teuthology.orchestra.run.smithi176.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-01T15:15:12.585 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-01T15:15:12.585 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-01T15:15:12.585 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server 2023-12-01T15:15:12.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:15:12.689 INFO:teuthology.dispatcher.supervisor:Running job 7473646 2023-12-01T15:15:12.689 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-01_15:08:59-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi/7473646 --name yuriw-2023-12-01_15:08:59-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi --description upgrade:reef-x/parallel/{0-random-distro$/{centos_8.stream_container_tools_crun} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} -- /home/teuthworker/archive/yuriw-2023-12-01_15:08:59-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi/7473646/orig.config.yaml 2023-12-01T15:15:12.692 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-01_15:08:59-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi/7473646 2023-12-01T15:15:12.692 INFO:teuthology.dispatcher.supervisor:Job PID: 837972 2023-12-01T15:15:12.692 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-01T15:17:12.793 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:19:12.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:21:13.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:23:13.408 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:25:13.582 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:27:13.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:29:13.916 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:31:14.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:33:14.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:35:14.427 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:37:14.595 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:39:14.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:41:14.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:43:15.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:45:15.249 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:47:15.418 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:49:15.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:51:15.742 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:53:15.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:55:16.074 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:57:16.243 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:59:16.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:01:16.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:03:16.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:05:16.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:07:17.066 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:09:17.240 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:11:17.410 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:13:17.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:15:17.744 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:17:17.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:19:18.072 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:21:18.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:23:18.399 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:25:18.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:27:18.756 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:29:18.921 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:31:19.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:33:19.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:35:19.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:37:19.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:39:19.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:41:19.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:43:20.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:45:20.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:47:20.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:49:20.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:51:20.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:53:20.933 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:55:21.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:57:21.288 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:59:21.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:01:21.621 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:03:21.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:05:21.948 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:07:22.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:09:22.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:11:22.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:13:22.636 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:15:22.800 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:17:23.002 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:19:23.162 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:21:23.329 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:23:23.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:25:23.665 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:27:23.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:29:23.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:31:24.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:33:24.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:35:24.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:37:24.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:39:24.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:41:25.002 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:43:25.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:45:25.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:47:25.509 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:49:25.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:51:25.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:53:25.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:55:26.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:57:26.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:59:26.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:01:26.645 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:03:26.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:05:26.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:07:27.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:09:27.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:11:27.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:13:27.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:15:27.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:17:27.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:19:28.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:21:28.321 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:23:28.488 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:25:28.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:27:28.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:29:28.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:31:29.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:33:29.328 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:35:29.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:37:29.665 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:39:29.838 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:41:30.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:43:30.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:45:30.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:47:30.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:49:30.648 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:51:30.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:53:30.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:55:31.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:57:31.342 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:59:31.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:01:31.676 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:03:31.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:05:32.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:07:32.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:09:32.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:11:32.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:13:32.688 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:15:32.846 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:17:33.009 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:19:33.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:21:33.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:23:33.492 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:25:33.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:27:33.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:29:34.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:31:34.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:33:34.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:35:34.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:37:34.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:39:34.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:41:34.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:43:35.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:45:35.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:47:35.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:49:35.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:51:35.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:53:35.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:55:36.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:57:36.273 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:59:36.520 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:01:36.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:03:36.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:05:37.022 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:07:37.188 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:09:37.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:11:37.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:13:37.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:15:37.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:17:38.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:19:38.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:21:38.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:23:38.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:25:38.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:27:38.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:29:39.009 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:31:39.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:33:39.341 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:35:39.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:37:39.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:39:39.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:41:40.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:43:40.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:45:40.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:47:40.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:49:40.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:51:40.862 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:53:41.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:55:41.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:57:41.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:59:41.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:01:41.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:03:41.820 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:05:41.980 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:07:42.150 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:09:42.312 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:11:42.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:13:42.631 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:15:42.801 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:17:42.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:19:43.136 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:21:43.304 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:23:43.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:25:43.858 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:27:44.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:29:44.180 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:31:44.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:33:44.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:35:44.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:37:44.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:39:45.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:41:45.176 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:43:45.353 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:45:45.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:47:45.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:49:45.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:51:46.008 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:53:46.177 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:55:46.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:57:46.513 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:59:46.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:01:46.840 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:03:47.004 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:05:47.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:07:47.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:09:47.520 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:11:47.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:13:47.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:15:48.012 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:17:48.168 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:19:48.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:21:48.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:23:48.664 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:25:48.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:27:48.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:29:49.162 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:31:49.323 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:33:49.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:35:49.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:37:49.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:39:50.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:41:50.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:43:50.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:45:50.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:47:50.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:49:51.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:51:51.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:53:51.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:55:51.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:57:51.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:59:51.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:01:52.056 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:03:52.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:05:52.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:07:52.558 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:09:52.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:11:52.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:13:53.059 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:15:53.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:17:53.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:19:53.552 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:21:53.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:23:53.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:25:54.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:27:54.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:29:54.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:31:54.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:33:54.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:35:54.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:37:55.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:39:55.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:41:55.396 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:43:55.572 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:45:55.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:47:55.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:49:56.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:51:56.233 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:53:56.399 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:55:56.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:57:56.730 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:59:56.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:01:57.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:03:57.239 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:05:57.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:07:57.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:09:57.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:11:57.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:13:58.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:15:58.260 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:17:58.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:19:58.606 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:21:58.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:23:58.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:25:59.164 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:27:59.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:29:59.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:31:59.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:33:59.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:35:59.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:38:00.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:40:00.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:42:00.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:44:00.657 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:46:00.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:48:00.997 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:50:01.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:52:01.326 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:54:01.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:56:01.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:58:01.816 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:00:01.996 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:02:02.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:04:02.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:06:02.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:08:02.676 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:10:02.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:12:03.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:14:03.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:16:03.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:18:03.521 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:20:03.686 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:22:03.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:24:04.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:26:04.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:28:04.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:30:04.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:32:04.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:34:04.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:36:05.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:38:05.234 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:40:05.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:42:05.592 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:44:05.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:46:05.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:48:06.096 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:50:06.237 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:52:06.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:54:06.560 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:56:06.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:58:06.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:00:07.103 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:02:07.272 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:04:07.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:06:07.605 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:08:07.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:10:07.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:12:08.106 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:14:08.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:16:08.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:18:08.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:20:08.769 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:22:08.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:24:09.058 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:26:09.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:28:09.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:30:09.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:32:09.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:34:09.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:36:10.059 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:38:10.229 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:40:10.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:42:10.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:44:10.736 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:46:10.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:48:11.065 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:50:11.230 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:52:11.399 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:54:11.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:56:11.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:58:11.900 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T03:00:12.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T03:02:12.243 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T03:04:12.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T03:06:12.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T03:08:12.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T03:10:12.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T03:12:13.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T03:14:13.228 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T03:16:13.395 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2023-12-02T03:16:13.484 INFO:teuthology.kill:Killing Pids: {837972} 2023-12-02T03:16:14.367 INFO:teuthology.task.internal:roles: ubuntu@smithi094.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a'] 2023-12-02T03:16:14.367 INFO:teuthology.task.internal:roles: ubuntu@smithi176.front.sepia.ceph.com - ['mon.b', 'mds.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b'] 2023-12-02T03:16:14.367 INFO:teuthology.misc:Compressing logs... 2023-12-02T03:16:14.368 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2023-12-02T03:16:14.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T03:16:14.456 DEBUG:teuthology.orchestra.run.smithi094:> true 2023-12-02T03:16:14.572 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi094.front.sepia.ceph.com' 2023-12-02T03:16:14.572 DEBUG:teuthology.orchestra.run.smithi094:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-02T03:16:14.615 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2023-12-02T03:16:14.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T03:16:14.688 DEBUG:teuthology.orchestra.run.smithi176:> true 2023-12-02T03:16:14.764 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi176.front.sepia.ceph.com' 2023-12-02T03:16:14.764 DEBUG:teuthology.orchestra.run.smithi176:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-02T03:16:14.844 DEBUG:teuthology.misc:Transferring archived files from smithi094:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-01_15:08:59-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi/7473646/remote/smithi094/crash 2023-12-02T03:16:14.846 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-02T03:16:14.902 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-01_15:08:59-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi/7473646/remote/smithi176/crash 2023-12-02T03:16:14.903 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-02T03:16:14.946 INFO:teuthology.misc:Compressing logs... 2023-12-02T03:16:14.946 DEBUG:teuthology.orchestra.run.smithi094:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-02T03:16:14.949 DEBUG:teuthology.orchestra.run.smithi176:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-02T03:16:14.985 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-02T03:16:14.991 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-02T03:16:14.992 INFO:teuthology.orchestra.run.smithi094.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 80.6% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-12-02T03:16:15.016 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-02T03:16:15.016 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-02T03:16:15.017 INFO:teuthology.orchestra.run.smithi176.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 82.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-12-02T03:16:15.080 INFO:teuthology.orchestra.run.smithi176.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 90.8% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-12-02T03:16:15.119 INFO:teuthology.orchestra.run.smithi094.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 92.6% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-12-02T03:16:15.120 DEBUG:teuthology.misc:Transferring archived files from smithi094:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-01_15:08:59-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi/7473646/remote/smithi094/ 2023-12-02T03:16:15.120 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-02T03:16:15.208 DEBUG:teuthology.misc:Transferring archived files from smithi176:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-01_15:08:59-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi/7473646/remote/smithi176/ 2023-12-02T03:16:15.209 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-02T03:16:15.252 INFO:teuthology.misc:Compressing logs... 2023-12-02T03:16:15.253 DEBUG:teuthology.orchestra.run.smithi094:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-02T03:16:15.255 DEBUG:teuthology.orchestra.run.smithi176:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-02T03:16:15.280 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-02T03:16:15.280 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-volume.log 2023-12-02T03:16:15.281 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-osd.2.log 2023-12-02T03:16:15.284 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-mgr.y.log 2023-12-02T03:16:15.284 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-osd.3.log 2023-12-02T03:16:15.284 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-osd.0.log 2023-12-02T03:16:15.284 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-mgr.y.log: /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-mds.a.log 2023-12-02T03:16:15.284 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-mon.a.log 2023-12-02T03:16:15.284 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-mon.c.log 2023-12-02T03:16:15.284 INFO:teuthology.orchestra.run.smithi094.stderr: 67.1% -- replaced with /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-mds.a.log.gz 2023-12-02T03:16:15.285 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-osd.1.log 2023-12-02T03:16:15.314 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-02T03:16:15.315 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-osd.6.log 2023-12-02T03:16:15.315 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-volume.log 2023-12-02T03:16:15.315 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-osd.7.log 2023-12-02T03:16:15.315 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-osd.6.log: /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-mgr.x.log 2023-12-02T03:16:15.315 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-mon.b.log 2023-12-02T03:16:15.315 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-mds.b.log 2023-12-02T03:16:15.323 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-mgr.x.log: /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-mon.b.log: /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-mds.b.log: 81.3% -- replaced with /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-mds.b.log.gz 2023-12-02T03:16:15.323 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-osd.4.log 2023-12-02T03:16:15.323 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-osd.4.log: 88.0% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-02T03:16:15.326 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-osd.5.log 2023-12-02T03:16:15.332 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-osd.5.log: 91.6% -- replaced with /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-volume.log.gz 2023-12-02T03:16:15.445 INFO:teuthology.orchestra.run.smithi176.stderr: 94.4% -- replaced with /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-mgr.x.log.gz 2023-12-02T03:16:15.496 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-mon.c.log: /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-osd.1.log: 91.6% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-02T03:16:16.512 INFO:teuthology.orchestra.run.smithi094.stderr: 91.6% -- replaced with /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-volume.log.gz 2023-12-02T03:16:24.659 INFO:teuthology.orchestra.run.smithi176.stderr:gzip: /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-mon.b.log: file size changed while zipping 2023-12-02T03:16:24.659 INFO:teuthology.orchestra.run.smithi176.stderr: 92.4% -- replaced with /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-mon.b.log.gz 2023-12-02T03:16:31.324 INFO:teuthology.orchestra.run.smithi094.stderr:gzip: /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-mgr.y.log: file size changed while zipping 2023-12-02T03:16:31.325 INFO:teuthology.orchestra.run.smithi094.stderr: 89.9% -- replaced with /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-mgr.y.log.gz 2023-12-02T03:16:37.066 INFO:teuthology.orchestra.run.smithi094.stderr:gzip: /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-mon.c.log: file size changed while zipping 2023-12-02T03:16:37.067 INFO:teuthology.orchestra.run.smithi094.stderr: 92.2% -- replaced with /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-mon.c.log.gz 2023-12-02T03:16:43.798 INFO:teuthology.orchestra.run.smithi176.stderr:gzip: /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-osd.4.log: file size changed while zipping 2023-12-02T03:16:43.798 INFO:teuthology.orchestra.run.smithi176.stderr: 93.9% -- replaced with /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-osd.4.log.gz 2023-12-02T03:16:45.010 INFO:teuthology.orchestra.run.smithi176.stderr:gzip: /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-osd.6.log: file size changed while zipping 2023-12-02T03:16:45.011 INFO:teuthology.orchestra.run.smithi176.stderr: 94.1% -- replaced with /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-osd.6.log.gz 2023-12-02T03:16:48.290 INFO:teuthology.orchestra.run.smithi094.stderr:gzip: /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-mon.a.log: file size changed while zipping 2023-12-02T03:16:48.290 INFO:teuthology.orchestra.run.smithi094.stderr: 90.2% -- replaced with /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-mon.a.log.gz 2023-12-02T03:16:51.490 INFO:teuthology.orchestra.run.smithi176.stderr:gzip: /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-osd.5.log: file size changed while zipping 2023-12-02T03:16:51.491 INFO:teuthology.orchestra.run.smithi176.stderr: 94.5% -- replaced with /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-osd.5.log.gz 2023-12-02T03:16:54.586 INFO:teuthology.orchestra.run.smithi176.stderr:gzip: /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-osd.7.log: file size changed while zipping 2023-12-02T03:16:54.587 INFO:teuthology.orchestra.run.smithi176.stderr: 94.2% -- replaced with /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-osd.7.log.gz 2023-12-02T03:16:59.982 INFO:teuthology.orchestra.run.smithi094.stderr:gzip: /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-osd.2.log: file size changed while zipping 2023-12-02T03:16:59.982 INFO:teuthology.orchestra.run.smithi094.stderr: 94.0% -- replaced with /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-osd.2.log.gz 2023-12-02T03:17:05.148 INFO:teuthology.orchestra.run.smithi094.stderr:gzip: /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-osd.1.log: file size changed while zipping 2023-12-02T03:17:05.148 INFO:teuthology.orchestra.run.smithi094.stderr: 94.3% -- replaced with /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-osd.1.log.gz 2023-12-02T03:17:08.066 INFO:teuthology.orchestra.run.smithi094.stderr:gzip: /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-osd.0.log: file size changed while zipping 2023-12-02T03:17:08.066 INFO:teuthology.orchestra.run.smithi094.stderr: 94.1% -- replaced with /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-osd.0.log.gz 2023-12-02T03:17:09.190 INFO:teuthology.orchestra.run.smithi094.stderr:gzip: /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-osd.3.log: file size changed while zipping 2023-12-02T03:17:09.190 INFO:teuthology.orchestra.run.smithi094.stderr: 94.5% -- replaced with /var/log/ceph/6214a0c8-905e-11ee-95a2-87774f69a715/ceph-osd.3.log.gz 2023-12-02T03:17:09.193 DEBUG:teuthology.misc:Transferring archived files from smithi094:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-01_15:08:59-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi/7473646/remote/smithi094/log 2023-12-02T03:17:09.194 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-02T03:17:36.326 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-01_15:08:59-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi/7473646/remote/smithi176/log 2023-12-02T03:17:36.327 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-02T03:17:56.468 INFO:teuthology.kill:No teuthology processes running 2023-12-02T03:17:56.468 ERROR:teuthology.dispatcher.supervisor:Failed to kill job and unlock machines Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/dispatcher/supervisor.py", line 331, in run_with_watchdog kill.kill_job( File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/kill.py", line 89, in kill_job if kill_processes(run_name, [job_info.get('pid')]): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/kill.py", line 210, in kill_processes if survivors: UnboundLocalError: local variable 'survivors' referenced before assignment 2023-12-02T03:17:56.469 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T03:19:56.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T03:19:56.749 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2023-12-02T03:19:56.869 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-02T03:19:56.869 INFO:teuthology.nuke:Checking targets against current locks 2023-12-02T03:19:56.920 DEBUG:teuthology.nuke:shortname: smithi094 2023-12-02T03:19:56.920 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-02T03:19:56.949 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi094.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-01_15:08:59-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi/7473646', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-01 15:10:05.109915', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEvSnwTKK3yFDO/xUI19LtX4u8EebtETEUmxm/G5Sz0oKR3/Yhel4BU1HAQgULTsUSROTjVo0cbCux5Ygoy1f10='} 2023-12-02T03:19:56.953 DEBUG:teuthology.nuke:shortname: smithi176 2023-12-02T03:19:56.953 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-02T03:19:56.977 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi176.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-01_15:08:59-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi/7473646', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-01 15:10:05.108117', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEOKXzsR6TfUb6kamd/3vDltsfXM+D3GzAvjuUYk2l35XFxuBCXAJMgvBtz7mCZrzuzSU5l6aD3id6tWs7111Rg='} 2023-12-02T03:19:57.008 INFO:teuthology.orchestra.console.smithi094:Power off 2023-12-02T03:19:57.008 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-02T03:19:57.030 DEBUG:teuthology.orchestra.console.smithi094:power off output: Chassis Power Control: Down/Off 2023-12-02T03:19:57.031 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T03:19:57.043 INFO:teuthology.orchestra.console.smithi176:Power off 2023-12-02T03:19:57.043 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-02T03:19:57.053 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on 2023-12-02T03:19:57.065 DEBUG:teuthology.orchestra.console.smithi176:power off output: Chassis Power Control: Down/Off 2023-12-02T03:19:57.065 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T03:19:57.091 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is on 2023-12-02T03:20:01.058 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T03:20:01.092 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T03:20:01.170 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on 2023-12-02T03:20:01.201 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is on 2023-12-02T03:20:05.174 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T03:20:05.201 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T03:20:05.287 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on 2023-12-02T03:20:05.311 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is off 2023-12-02T03:20:05.411 INFO:teuthology.orchestra.console.smithi176:Power off completed 2023-12-02T03:20:05.564 INFO:teuthology.lock.ops:unlocked: smithi176.front.sepia.ceph.com 2023-12-02T03:20:09.291 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T03:20:09.399 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off 2023-12-02T03:20:09.499 INFO:teuthology.orchestra.console.smithi094:Power off completed 2023-12-02T03:20:09.655 INFO:teuthology.lock.ops:unlocked: smithi094.front.sepia.ceph.com