2023-12-01T15:10:04.398 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-01T15:10:04.398 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:10:04.521 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f079d465550>, signals=[15]) 2023-12-01T15:10:04.521 INFO:teuthology.lock.ops:Start node 'smithi119.front.sepia.ceph.com' reimaging 2023-12-01T15:10:04.522 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: reset os type and version on server 2023-12-01T15:10:04.522 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2023-12-01T15:10:04.543 INFO:teuthology.lock.ops:Start node 'smithi183.front.sepia.ceph.com' reimaging 2023-12-01T15:10:04.543 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: reset os type and version on server 2023-12-01T15:10:04.543 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2023-12-01T15:10:04.637 DEBUG:teuthology.provision.fog.smithi119:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-01T15:10:04.669 DEBUG:teuthology.provision.fog.smithi183:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-01T15:10:04.679 INFO:teuthology.provision.fog.smithi119:Scheduling deploy of rhel 8.6 2023-12-01T15:10:04.714 INFO:teuthology.provision.fog.smithi183:Scheduling deploy of rhel 8.6 2023-12-01T15:10:04.889 INFO:teuthology.orchestra.console.smithi119:Power off 2023-12-01T15:10:04.889 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-01T15:10:04.908 DEBUG:teuthology.orchestra.console.smithi119:power off output: Chassis Power Control: Down/Off 2023-12-01T15:10:04.909 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T15:10:04.925 INFO:teuthology.orchestra.console.smithi183:Power off 2023-12-01T15:10:04.925 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-01T15:10:04.932 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off 2023-12-01T15:10:04.944 DEBUG:teuthology.orchestra.console.smithi183:power off output: Chassis Power Control: Down/Off 2023-12-01T15:10:04.945 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T15:10:04.965 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2023-12-01T15:10:05.034 INFO:teuthology.orchestra.console.smithi119:Power off completed 2023-12-01T15:10:05.066 INFO:teuthology.orchestra.console.smithi183:Power off completed 2023-12-01T15:10:05.135 INFO:teuthology.orchestra.console.smithi119:Power on 2023-12-01T15:10:05.135 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-01T15:10:05.154 DEBUG:teuthology.orchestra.console.smithi119:power on output: Chassis Power Control: Up/On 2023-12-01T15:10:05.155 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T15:10:05.167 INFO:teuthology.orchestra.console.smithi183:Power on 2023-12-01T15:10:05.167 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-01T15:10:05.174 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off 2023-12-01T15:10:05.186 DEBUG:teuthology.orchestra.console.smithi183:power on output: Chassis Power Control: Up/On 2023-12-01T15:10:05.186 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T15:10:05.204 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2023-12-01T15:10:09.179 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T15:10:09.206 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T15:10:09.287 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on 2023-12-01T15:10:09.314 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2023-12-01T15:10:09.387 INFO:teuthology.orchestra.console.smithi119:Power on completed 2023-12-01T15:10:09.415 INFO:teuthology.orchestra.console.smithi183:Power on completed 2023-12-01T15:10:09.489 INFO:teuthology.provision.fog.smithi119:Waiting for deploy to finish 2023-12-01T15:10:09.516 INFO:teuthology.provision.fog.smithi183:Waiting for deploy to finish 2023-12-01T15:12:56.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:12:56.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:12:59.362 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-12-01T15:12:59.362 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-12-01T15:13:05.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:13:05.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:13:08.418 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-12-01T15:13:08.419 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-12-01T15:13:14.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:13:14.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:13:17.506 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-12-01T15:13:17.507 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-12-01T15:13:23.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:13:23.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:13:26.594 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-12-01T15:13:26.594 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-12-01T15:13:32.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:13:32.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:13:35.655 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-12-01T15:13:35.655 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-12-01T15:13:41.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:13:41.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:13:44.742 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-12-01T15:13:44.742 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-12-01T15:13:50.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:13:50.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:14:09.122 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-12-01T15:14:09.122 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-12-01T15:14:15.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:14:15.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:14:18.178 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-12-01T15:14:18.178 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-12-01T15:14:24.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:14:24.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:14:24.518 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-01T15:14:24.519 DEBUG:teuthology.orchestra.run.smithi183:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-01T15:14:24.780 INFO:teuthology.provision.fog.smithi183:Node is ready 2023-12-01T15:14:24.780 DEBUG:teuthology.orchestra.run.smithi183:> hostname 2023-12-01T15:14:24.810 INFO:teuthology.orchestra.run.smithi183.stdout:smithi022 2023-12-01T15:14:24.811 DEBUG:teuthology.orchestra.run.smithi183:> grep smithi022 /etc/hosts 2023-12-01T15:14:24.867 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-12-01T15:14:24.868 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname smithi183 2023-12-01T15:14:24.979 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/smithi022/smithi183/g' /etc/hosts 2023-12-01T15:14:25.006 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/172.21.15.22/172.21.15.183/g' /etc/hosts 2023-12-01T15:14:25.072 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/smithi022/smithi183/g' /etc/hostname 2023-12-01T15:14:25.138 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname smithi183 2023-12-01T15:14:25.203 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release 2023-12-01T15:14:25.259 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="Red Hat Enterprise Linux" 2023-12-01T15:14:25.260 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="8.6 (Ootpa)" 2023-12-01T15:14:25.260 INFO:teuthology.orchestra.run.smithi183.stdout:ID="rhel" 2023-12-01T15:14:25.260 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="fedora" 2023-12-01T15:14:25.260 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="8.6" 2023-12-01T15:14:25.260 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el8" 2023-12-01T15:14:25.260 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-01T15:14:25.260 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31" 2023-12-01T15:14:25.260 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-01T15:14:25.260 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://www.redhat.com/" 2023-12-01T15:14:25.260 INFO:teuthology.orchestra.run.smithi183.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-01T15:14:25.260 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-01T15:14:25.261 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-01T15:14:25.261 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-01T15:14:25.261 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-01T15:14:25.261 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-01T15:14:25.261 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-01T15:14:25.261 INFO:teuthology.provision.fog.smithi183:Deploy complete! 2023-12-01T15:14:25.263 DEBUG:teuthology.parallel:result is None 2023-12-01T15:14:25.532 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-01T15:14:25.533 DEBUG:teuthology.orchestra.run.smithi119:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-01T15:14:25.803 INFO:teuthology.provision.fog.smithi119:Node is ready 2023-12-01T15:14:25.803 DEBUG:teuthology.orchestra.run.smithi119:> hostname 2023-12-01T15:14:25.828 INFO:teuthology.orchestra.run.smithi119.stdout:smithi022 2023-12-01T15:14:25.828 DEBUG:teuthology.orchestra.run.smithi119:> grep smithi022 /etc/hosts 2023-12-01T15:14:25.893 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-12-01T15:14:25.893 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119 2023-12-01T15:14:26.093 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi022/smithi119/g' /etc/hosts 2023-12-01T15:14:26.121 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/172.21.15.22/172.21.15.119/g' /etc/hosts 2023-12-01T15:14:26.186 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi022/smithi119/g' /etc/hostname 2023-12-01T15:14:26.252 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119 2023-12-01T15:14:26.319 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2023-12-01T15:14:26.375 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="Red Hat Enterprise Linux" 2023-12-01T15:14:26.376 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="8.6 (Ootpa)" 2023-12-01T15:14:26.376 INFO:teuthology.orchestra.run.smithi119.stdout:ID="rhel" 2023-12-01T15:14:26.376 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="fedora" 2023-12-01T15:14:26.376 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="8.6" 2023-12-01T15:14:26.376 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el8" 2023-12-01T15:14:26.376 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-01T15:14:26.376 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2023-12-01T15:14:26.376 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-01T15:14:26.376 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://www.redhat.com/" 2023-12-01T15:14:26.376 INFO:teuthology.orchestra.run.smithi119.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-01T15:14:26.376 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-01T15:14:26.377 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-01T15:14:26.377 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-01T15:14:26.377 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-01T15:14:26.377 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-01T15:14:26.377 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-01T15:14:26.377 INFO:teuthology.provision.fog.smithi119:Deploy complete! 2023-12-01T15:14:26.378 DEBUG:teuthology.parallel:result is None 2023-12-01T15:14:26.520 INFO:teuthology.lock.ops:Checking smithi119.front.sepia.ceph.com 2023-12-01T15:14:26.520 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-01T15:14:26.545 INFO:teuthology.lock.ops:Checking smithi183.front.sepia.ceph.com 2023-12-01T15:14:26.545 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-01T15:14:26.562 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: set os type and version on server 2023-12-01T15:14:26.562 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-12-01T15:14:26.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:14:26.627 DEBUG:teuthology.orchestra.run.smithi119:> true 2023-12-01T15:14:26.706 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-12-01T15:14:26.706 DEBUG:teuthology.orchestra.run.smithi119:> uname -m 2023-12-01T15:14:26.762 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64 2023-12-01T15:14:26.762 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2023-12-01T15:14:26.818 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="Red Hat Enterprise Linux" 2023-12-01T15:14:26.818 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="8.6 (Ootpa)" 2023-12-01T15:14:26.818 INFO:teuthology.orchestra.run.smithi119.stdout:ID="rhel" 2023-12-01T15:14:26.818 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="fedora" 2023-12-01T15:14:26.818 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="8.6" 2023-12-01T15:14:26.818 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el8" 2023-12-01T15:14:26.818 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-01T15:14:26.818 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2023-12-01T15:14:26.818 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-01T15:14:26.819 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://www.redhat.com/" 2023-12-01T15:14:26.819 INFO:teuthology.orchestra.run.smithi119.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-01T15:14:26.819 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-01T15:14:26.819 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-01T15:14:26.819 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-01T15:14:26.819 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-01T15:14:26.819 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-01T15:14:26.819 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-01T15:14:26.819 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2023-12-01T15:14:26.845 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: set os type and version on server 2023-12-01T15:14:26.845 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-12-01T15:14:26.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:14:26.911 DEBUG:teuthology.orchestra.run.smithi183:> true 2023-12-01T15:14:26.979 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-12-01T15:14:26.979 DEBUG:teuthology.orchestra.run.smithi183:> uname -m 2023-12-01T15:14:27.035 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64 2023-12-01T15:14:27.035 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release 2023-12-01T15:14:27.092 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="Red Hat Enterprise Linux" 2023-12-01T15:14:27.092 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="8.6 (Ootpa)" 2023-12-01T15:14:27.092 INFO:teuthology.orchestra.run.smithi183.stdout:ID="rhel" 2023-12-01T15:14:27.092 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="fedora" 2023-12-01T15:14:27.092 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="8.6" 2023-12-01T15:14:27.092 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el8" 2023-12-01T15:14:27.092 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-01T15:14:27.092 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31" 2023-12-01T15:14:27.092 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-01T15:14:27.092 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://www.redhat.com/" 2023-12-01T15:14:27.092 INFO:teuthology.orchestra.run.smithi183.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-01T15:14:27.093 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-01T15:14:27.093 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-12-01T15:14:27.093 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-01T15:14:27.093 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-01T15:14:27.093 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-01T15:14:27.093 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-01T15:14:27.093 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2023-12-01T15:14:27.120 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:14:27.210 INFO:teuthology.dispatcher.supervisor:Running job 7473642 2023-12-01T15:14:27.210 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-01_15:08:59-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi/7473642 --name yuriw-2023-12-01_15:08:59-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi --description upgrade:reef-x/parallel/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} -- /home/teuthworker/archive/yuriw-2023-12-01_15:08:59-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi/7473642/orig.config.yaml 2023-12-01T15:14:27.213 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-01_15:08:59-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi/7473642 2023-12-01T15:14:27.213 INFO:teuthology.dispatcher.supervisor:Job PID: 835809 2023-12-01T15:14:27.213 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-01T15:16:27.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:18:27.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:20:27.631 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:22:27.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:24:27.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:26:28.141 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:28:28.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:30:28.504 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:32:28.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:34:28.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:36:29.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:38:29.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:40:29.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:42:29.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:44:29.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:46:29.894 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:48:30.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:50:30.229 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:52:30.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:54:30.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:56:30.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:58:30.800 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:00:30.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:02:31.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:04:31.323 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:06:31.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:08:31.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:10:31.848 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:12:32.008 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:14:32.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:16:32.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:18:32.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:20:32.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:22:32.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:24:33.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:26:33.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:28:33.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:30:33.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:32:33.690 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:34:33.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:36:34.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:38:34.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:40:34.386 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:42:34.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:44:34.730 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:46:34.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:48:35.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:50:35.245 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:52:35.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:54:35.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:56:35.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:58:35.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:00:36.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:02:36.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:04:36.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:06:36.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:08:36.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:10:36.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:12:37.091 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:14:37.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:16:37.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:18:37.600 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:20:37.769 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:22:37.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:24:38.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:26:38.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:28:38.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:30:38.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:32:38.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:34:38.926 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:36:39.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:38:39.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:40:39.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:42:39.600 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:44:39.772 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:46:39.941 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:48:40.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:50:40.285 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:52:40.434 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:54:40.595 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:56:40.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:58:40.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:00:41.096 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:02:41.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:04:41.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:06:41.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:08:41.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:10:41.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:12:42.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:14:42.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:16:42.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:18:42.615 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:20:42.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:22:42.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:24:43.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:26:43.224 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:28:43.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:30:43.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:32:43.728 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:34:43.892 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:36:44.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:38:44.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:40:44.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:42:44.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:44:44.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:46:44.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:48:45.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:50:45.266 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:52:45.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:54:45.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:56:45.773 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:58:45.937 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:00:46.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:02:46.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:04:46.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:06:46.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:08:46.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:10:46.952 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:12:47.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:14:47.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:16:47.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:18:47.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:20:47.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:22:47.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:24:48.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:26:48.276 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:28:48.440 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:30:48.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:32:48.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:34:48.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:36:49.106 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:38:49.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:40:49.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:42:49.591 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:44:49.742 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:46:49.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:48:50.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:50:50.245 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:52:50.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:54:50.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:56:50.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:58:50.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:00:51.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:02:51.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:04:51.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:06:51.552 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:08:51.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:10:51.886 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:12:52.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:14:52.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:16:52.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:18:52.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:20:52.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:22:52.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:24:53.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:26:53.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:28:53.386 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:30:53.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:32:53.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:34:53.854 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:36:54.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:38:54.176 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:40:54.332 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:42:54.505 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:44:54.648 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:46:54.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:48:54.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:50:55.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:52:55.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:54:55.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:56:55.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:58:55.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:00:56.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:02:56.174 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:04:56.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:06:56.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:08:56.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:10:56.852 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:12:57.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:14:57.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:16:57.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:18:57.507 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:20:57.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:22:57.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:24:58.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:26:58.176 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:28:58.341 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:30:58.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:32:58.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:34:58.872 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:36:59.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:38:59.204 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:40:59.378 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:42:59.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:44:59.714 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:46:59.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:49:00.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:51:00.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:53:00.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:55:00.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:57:00.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:59:00.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:01:01.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:03:01.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:05:01.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:07:01.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:09:01.734 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:11:01.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:13:02.056 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:15:02.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:17:02.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:19:02.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:21:02.710 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:23:02.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:25:03.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:27:03.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:29:03.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:31:03.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:33:03.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:35:03.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:37:04.045 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:39:04.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:41:04.371 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:43:04.552 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:45:04.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:47:04.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:49:05.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:51:05.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:53:05.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:55:05.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:57:05.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:59:05.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:01:06.041 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:03:06.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:05:06.376 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:07:06.540 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:09:06.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:11:06.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:13:07.116 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:15:07.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:17:07.459 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:19:07.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:21:07.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:23:07.952 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:25:08.115 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:27:08.284 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:29:08.449 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:31:08.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:33:08.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:35:09.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:37:09.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:39:09.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:41:09.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:43:09.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:45:09.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:47:09.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:49:10.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:51:10.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:53:10.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:55:10.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:57:10.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:59:11.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:01:11.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:03:11.412 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:05:11.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:07:11.736 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:09:11.893 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:11:12.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:13:12.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:15:12.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:17:12.576 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:19:12.744 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:21:12.926 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:23:13.096 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:25:13.273 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:27:13.432 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:29:13.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:31:13.784 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:33:13.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:35:14.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:37:14.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:39:14.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:41:14.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:43:14.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:45:14.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:47:15.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:49:15.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:51:15.507 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:53:15.668 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:55:15.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:57:16.005 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:59:16.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:01:16.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:03:16.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:05:16.705 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:07:16.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:09:17.068 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:11:17.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:13:17.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:15:17.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:17:17.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:19:17.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:21:18.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:23:18.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:25:18.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:27:18.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:29:18.712 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:31:18.884 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:33:19.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:35:19.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:37:19.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:39:19.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:41:19.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:43:20.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:45:20.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:47:20.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:49:20.501 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:51:20.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:53:20.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:55:20.996 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:57:21.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:59:21.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:01:21.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:03:21.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:05:21.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:07:22.021 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:09:22.189 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:11:22.364 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:13:22.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:15:22.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:17:22.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:19:23.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:21:23.210 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:23:23.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:25:23.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:27:23.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:29:23.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:31:24.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:33:24.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:35:24.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:37:24.552 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:39:24.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:41:24.888 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:43:25.052 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:45:25.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:47:25.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:49:25.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:51:25.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:53:25.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:55:26.096 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:57:26.264 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:59:26.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T03:01:26.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T03:03:26.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T03:05:26.944 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T03:07:27.104 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T03:09:27.264 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T03:11:27.426 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T03:13:27.622 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T03:15:27.787 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2023-12-02T03:15:27.850 INFO:teuthology.kill:Killing Pids: {835809} 2023-12-02T03:15:28.733 INFO:teuthology.task.internal:roles: ubuntu@smithi119.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a'] 2023-12-02T03:15:28.734 INFO:teuthology.task.internal:roles: ubuntu@smithi183.front.sepia.ceph.com - ['mon.b', 'mds.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b'] 2023-12-02T03:15:28.734 INFO:teuthology.misc:Compressing logs... 2023-12-02T03:15:28.734 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-12-02T03:15:28.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T03:15:28.821 DEBUG:teuthology.orchestra.run.smithi119:> true 2023-12-02T03:15:28.880 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-12-02T03:15:28.880 DEBUG:teuthology.orchestra.run.smithi119:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-02T03:15:28.922 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-12-02T03:15:28.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T03:15:28.992 DEBUG:teuthology.orchestra.run.smithi183:> true 2023-12-02T03:15:29.068 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-12-02T03:15:29.068 DEBUG:teuthology.orchestra.run.smithi183:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-02T03:15:29.172 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-01_15:08:59-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi/7473642/remote/smithi119/crash 2023-12-02T03:15:29.173 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-02T03:15:29.226 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-01_15:08:59-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi/7473642/remote/smithi183/crash 2023-12-02T03:15:29.227 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-02T03:15:29.269 INFO:teuthology.misc:Compressing logs... 2023-12-02T03:15:29.270 DEBUG:teuthology.orchestra.run.smithi119:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-02T03:15:29.272 DEBUG:teuthology.orchestra.run.smithi183:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-02T03:15:29.304 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-02T03:15:29.304 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-02T03:15:29.311 INFO:teuthology.orchestra.run.smithi119.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: /home/ubuntu/cephtest/archive/syslog/misc.log: 77.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-12-02T03:15:29.340 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-02T03:15:29.340 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-02T03:15:29.341 INFO:teuthology.orchestra.run.smithi183.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: /home/ubuntu/cephtest/archive/syslog/misc.log: 79.2% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-12-02T03:15:29.404 INFO:teuthology.orchestra.run.smithi183.stderr: 90.8% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-12-02T03:15:29.435 INFO:teuthology.orchestra.run.smithi119.stderr: 92.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-12-02T03:15:29.437 DEBUG:teuthology.misc:Transferring archived files from smithi119:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-01_15:08:59-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi/7473642/remote/smithi119/ 2023-12-02T03:15:29.437 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-02T03:15:29.524 DEBUG:teuthology.misc:Transferring archived files from smithi183:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-01_15:08:59-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi/7473642/remote/smithi183/ 2023-12-02T03:15:29.525 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-02T03:15:29.564 INFO:teuthology.misc:Compressing logs... 2023-12-02T03:15:29.564 DEBUG:teuthology.orchestra.run.smithi119:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-02T03:15:29.566 DEBUG:teuthology.orchestra.run.smithi183:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-02T03:15:29.591 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-02T03:15:29.591 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-osd.2.log 2023-12-02T03:15:29.592 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-osd.0.log 2023-12-02T03:15:29.592 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/cephadm.log: 67.5% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-02T03:15:29.592 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-mds.a.log 2023-12-02T03:15:29.594 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-osd.2.log: /var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-osd.3.log 2023-12-02T03:15:29.594 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-mds.a.log: 14.0% -- replaced with /var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-mds.a.log.gz 2023-12-02T03:15:29.594 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-osd.1.log 2023-12-02T03:15:29.595 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-mon.c.log 2023-12-02T03:15:29.595 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-osd.3.log: /var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-volume.log 2023-12-02T03:15:29.598 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-mon.c.log: /var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-volume.log: 88.1% -- replaced with /var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-volume.log.gz 2023-12-02T03:15:29.598 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-mon.a.log 2023-12-02T03:15:29.603 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-mgr.y.log 2023-12-02T03:15:29.619 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-mgr.y.log: 93.1% -- replaced with /var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-osd.2.log.gz 2023-12-02T03:15:29.620 INFO:teuthology.orchestra.run.smithi119.stderr: 92.4% -- replaced with /var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-mon.c.log.gz 2023-12-02T03:15:29.625 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-02T03:15:29.626 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-osd.5.log 2023-12-02T03:15:29.627 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-osd.6.log 2023-12-02T03:15:29.627 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-osd.4.log 2023-12-02T03:15:29.627 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-osd.5.log: /var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-mgr.x.log 2023-12-02T03:15:29.627 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-volume.log 2023-12-02T03:15:29.627 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-osd.7.log 2023-12-02T03:15:29.628 INFO:teuthology.orchestra.run.smithi119.stderr: 89.1% -- replaced with /var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-mgr.y.log.gz 2023-12-02T03:15:29.633 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-volume.log: /var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-osd.7.log: 88.0% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-02T03:15:29.633 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-mon.b.log 2023-12-02T03:15:29.640 INFO:teuthology.orchestra.run.smithi119.stderr: 93.4% -- replaced with /var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-osd.1.log.gz 2023-12-02T03:15:29.640 INFO:teuthology.orchestra.run.smithi119.stderr: 93.7% -- replaced with /var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-osd.3.log.gz 2023-12-02T03:15:29.640 INFO:teuthology.orchestra.run.smithi119.stderr: 93.7% -- replaced with /var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-osd.0.log.gz 2023-12-02T03:15:29.641 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-mds.b.log 2023-12-02T03:15:29.641 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-mds.b.log: 80.5% -- replaced with /var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-mds.b.log.gz 2023-12-02T03:15:29.645 INFO:teuthology.orchestra.run.smithi183.stderr: 91.6% -- replaced with /var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-volume.log.gz 2023-12-02T03:15:29.650 INFO:teuthology.orchestra.run.smithi119.stderr: 90.3% -- replaced with /var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-mon.a.log.gz 2023-12-02T03:15:29.713 INFO:teuthology.orchestra.run.smithi183.stderr: 94.5% -- replaced with /var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-mgr.x.log.gz 2023-12-02T03:15:36.538 INFO:teuthology.orchestra.run.smithi183.stderr:gzip: /var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-mon.b.log: file size changed while zipping 2023-12-02T03:15:36.538 INFO:teuthology.orchestra.run.smithi183.stderr: 92.2% -- replaced with /var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-mon.b.log.gz 2023-12-02T03:15:59.108 INFO:teuthology.orchestra.run.smithi183.stderr:gzip: /var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-osd.4.log: file size changed while zipping 2023-12-02T03:15:59.109 INFO:teuthology.orchestra.run.smithi183.stderr: 93.9% -- replaced with /var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-osd.4.log.gz 2023-12-02T03:16:00.377 INFO:teuthology.orchestra.run.smithi183.stderr:gzip: /var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-osd.6.log: file size changed while zipping 2023-12-02T03:16:00.378 INFO:teuthology.orchestra.run.smithi183.stderr: 94.2% -- replaced with /var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-osd.6.log.gz 2023-12-02T03:16:03.599 INFO:teuthology.orchestra.run.smithi183.stderr:gzip: /var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-osd.5.log: file size changed while zipping 2023-12-02T03:16:03.600 INFO:teuthology.orchestra.run.smithi183.stderr: 94.2% -- replaced with /var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-osd.5.log.gz 2023-12-02T03:16:07.007 INFO:teuthology.orchestra.run.smithi183.stderr:gzip: /var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-osd.7.log: file size changed while zipping 2023-12-02T03:16:07.008 INFO:teuthology.orchestra.run.smithi183.stderr: 94.1% -- replaced with /var/log/ceph/f739cc42-905d-11ee-95a2-87774f69a715/ceph-osd.7.log.gz 2023-12-02T03:16:07.009 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-01_15:08:59-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi/7473642/remote/smithi119/log 2023-12-02T03:16:07.010 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-02T03:17:43.556 INFO:teuthology.orchestra.run.smithi119.stderr:tar: ./f739cc42-905d-11ee-95a2-87774f69a715/ceph-osd.2.log-20231202: File removed before we read it 2023-12-02T03:17:49.199 INFO:teuthology.orchestra.run.smithi119.stderr:tar: ./f739cc42-905d-11ee-95a2-87774f69a715/ceph-osd.1.log-20231202: File removed before we read it 2023-12-02T03:17:49.199 INFO:teuthology.orchestra.run.smithi119.stderr:tar: ./f739cc42-905d-11ee-95a2-87774f69a715/ceph-volume.log-20231202: File removed before we read it 2023-12-02T03:17:53.931 INFO:teuthology.orchestra.run.smithi119.stderr:tar: ./f739cc42-905d-11ee-95a2-87774f69a715: file changed as we read it 2023-12-02T03:17:54.400 INFO:teuthology.orchestra.run.smithi119.stderr:tar: .: file changed as we read it 2023-12-02T03:17:54.405 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-01_15:08:59-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi/7473642/remote/smithi183/log 2023-12-02T03:17:54.406 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-02T03:17:54.617 INFO:teuthology.orchestra.run.smithi183.stderr:tar: ./f739cc42-905d-11ee-95a2-87774f69a715/ceph-osd.5.log: file changed as we read it 2023-12-02T03:18:14.124 INFO:teuthology.kill:No teuthology processes running 2023-12-02T03:18:14.124 ERROR:teuthology.dispatcher.supervisor:Failed to kill job and unlock machines Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/dispatcher/supervisor.py", line 331, in run_with_watchdog kill.kill_job( File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/kill.py", line 89, in kill_job if kill_processes(run_name, [job_info.get('pid')]): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/kill.py", line 210, in kill_processes if survivors: UnboundLocalError: local variable 'survivors' referenced before assignment 2023-12-02T03:18:14.125 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T03:20:14.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T03:20:14.374 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2023-12-02T03:20:14.481 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-02T03:20:14.481 INFO:teuthology.nuke:Checking targets against current locks 2023-12-02T03:20:14.533 DEBUG:teuthology.nuke:shortname: smithi119 2023-12-02T03:20:14.534 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-02T03:20:14.563 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-01_15:08:59-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi/7473642', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-01 15:10:03.608588', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-02T03:20:14.568 DEBUG:teuthology.nuke:shortname: smithi183 2023-12-02T03:20:14.569 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-02T03:20:14.591 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi183.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-01_15:08:59-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi/7473642', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-01 15:10:03.610605', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-02T03:20:14.619 INFO:teuthology.orchestra.console.smithi119:Power off 2023-12-02T03:20:14.620 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-02T03:20:14.645 DEBUG:teuthology.orchestra.console.smithi119:power off output: Chassis Power Control: Down/Off 2023-12-02T03:20:14.645 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T03:20:14.663 INFO:teuthology.orchestra.console.smithi183:Power off 2023-12-02T03:20:14.664 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-02T03:20:14.673 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on 2023-12-02T03:20:14.688 DEBUG:teuthology.orchestra.console.smithi183:power off output: Chassis Power Control: Down/Off 2023-12-02T03:20:14.688 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T03:20:14.714 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2023-12-02T03:20:18.678 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T03:20:18.716 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T03:20:18.789 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on 2023-12-02T03:20:18.827 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2023-12-02T03:20:22.794 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T03:20:22.828 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T03:20:22.904 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off 2023-12-02T03:20:22.937 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2023-12-02T03:20:23.006 INFO:teuthology.orchestra.console.smithi119:Power off completed 2023-12-02T03:20:23.039 INFO:teuthology.orchestra.console.smithi183:Power off completed 2023-12-02T03:20:23.155 INFO:teuthology.lock.ops:unlocked: smithi119.front.sepia.ceph.com 2023-12-02T03:20:23.180 INFO:teuthology.lock.ops:unlocked: smithi183.front.sepia.ceph.com