2024-04-17T15:42:12.684 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-17T15:42:12.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T15:42:12.828 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa2e95a5c10>, signals=[15]) 2024-04-17T15:42:12.829 INFO:teuthology.lock.ops:Start node 'smithi178.front.sepia.ceph.com' reimaging 2024-04-17T15:42:12.829 INFO:teuthology.lock.ops:Updating [smithi178.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T15:42:12.829 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server 2024-04-17T15:42:12.848 INFO:teuthology.lock.ops:Start node 'smithi184.front.sepia.ceph.com' reimaging 2024-04-17T15:42:12.849 INFO:teuthology.lock.ops:Updating [smithi184.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T15:42:12.849 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2024-04-17T15:42:12.980 DEBUG:teuthology.provision.fog.smithi178:Requesting image smithi_rhel_8.6 (ID 5) 2024-04-17T15:42:12.985 DEBUG:teuthology.provision.fog.smithi184:Requesting image smithi_rhel_8.6 (ID 5) 2024-04-17T15:42:13.026 INFO:teuthology.provision.fog.smithi178:Scheduling deploy of rhel 8.6 2024-04-17T15:42:13.029 INFO:teuthology.provision.fog.smithi184:Scheduling deploy of rhel 8.6 2024-04-17T15:42:13.502 INFO:teuthology.orchestra.console.smithi178:Power off 2024-04-17T15:42:13.502 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T15:42:13.515 INFO:teuthology.orchestra.console.smithi184:Power off 2024-04-17T15:42:13.516 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T15:42:13.526 DEBUG:teuthology.orchestra.console.smithi178:power off output: Chassis Power Control: Down/Off 2024-04-17T15:42:13.526 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T15:42:13.538 DEBUG:teuthology.orchestra.console.smithi184:power off output: Chassis Power Control: Down/Off 2024-04-17T15:42:13.538 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T15:42:13.548 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on 2024-04-17T15:42:13.558 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2024-04-17T15:42:17.550 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T15:42:17.560 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T15:42:17.659 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on 2024-04-17T15:42:17.667 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2024-04-17T15:42:21.662 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T15:42:21.670 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T15:42:21.771 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off 2024-04-17T15:42:21.777 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off 2024-04-17T15:42:21.873 INFO:teuthology.orchestra.console.smithi178:Power off completed 2024-04-17T15:42:21.878 INFO:teuthology.orchestra.console.smithi184:Power off completed 2024-04-17T15:42:21.974 INFO:teuthology.orchestra.console.smithi178:Power on 2024-04-17T15:42:21.974 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T15:42:21.981 INFO:teuthology.orchestra.console.smithi184:Power on 2024-04-17T15:42:21.982 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T15:42:21.995 DEBUG:teuthology.orchestra.console.smithi178:power on output: Chassis Power Control: Up/On 2024-04-17T15:42:21.996 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T15:42:22.004 DEBUG:teuthology.orchestra.console.smithi184:power on output: Chassis Power Control: Up/On 2024-04-17T15:42:22.004 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T15:42:22.024 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off 2024-04-17T15:42:22.030 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off 2024-04-17T15:42:26.026 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T15:42:26.033 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T15:42:26.136 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off 2024-04-17T15:42:26.142 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off 2024-04-17T15:42:30.139 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T15:42:30.146 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T15:42:30.248 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on 2024-04-17T15:42:30.254 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2024-04-17T15:42:30.350 INFO:teuthology.orchestra.console.smithi178:Power on completed 2024-04-17T15:42:30.355 INFO:teuthology.orchestra.console.smithi184:Power on completed 2024-04-17T15:42:30.451 INFO:teuthology.provision.fog.smithi178:Waiting for deploy to finish 2024-04-17T15:42:30.456 INFO:teuthology.provision.fog.smithi184:Waiting for deploy to finish 2024-04-17T15:46:02.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T15:46:02.409 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T15:46:05.470 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2024-04-17T15:46:05.471 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-04-17T15:46:11.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T15:46:11.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T15:46:14.558 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2024-04-17T15:46:14.559 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-04-17T15:46:20.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T15:46:20.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T15:46:23.614 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2024-04-17T15:46:23.615 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-04-17T15:46:29.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T15:46:29.621 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T15:46:32.670 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2024-04-17T15:46:32.702 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-04-17T15:46:38.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T15:46:38.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T15:46:41.758 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2024-04-17T15:46:41.759 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-04-17T15:46:47.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T15:46:47.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T15:46:50.814 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2024-04-17T15:46:50.815 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-04-17T15:46:56.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T15:46:56.821 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T15:46:59.874 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-04-17T15:47:05.880 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T15:47:56.871 WARNING:teuthology.provision.fog.smithi184:timed out 2024-04-17T15:48:02.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T15:48:03.150 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T15:48:03.150 DEBUG:teuthology.orchestra.run.smithi184:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T15:48:03.414 INFO:teuthology.provision.fog.smithi184:Node is ready 2024-04-17T15:48:03.414 DEBUG:teuthology.orchestra.run.smithi184:> hostname 2024-04-17T15:48:03.434 INFO:teuthology.orchestra.run.smithi184.stdout:smithi184.front.sepia.ceph.com 2024-04-17T15:48:03.434 DEBUG:teuthology.orchestra.run.smithi184:> grep smithi184.front.sepia.ceph.com /etc/hosts 2024-04-17T15:48:03.494 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.15.184 smithi184.front.sepia.ceph.com smithi184 2024-04-17T15:48:03.495 DEBUG:teuthology.orchestra.run.smithi184:> sudo hostname smithi184 2024-04-17T15:48:03.609 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/smithi184.front.sepia.ceph.com/smithi184/g' /etc/hosts 2024-04-17T15:48:03.645 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/172.21.15.184/172.21.15.184/g' /etc/hosts 2024-04-17T15:48:03.720 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/smithi184.front.sepia.ceph.com/smithi184/g' /etc/hostname 2024-04-17T15:48:03.794 DEBUG:teuthology.orchestra.run.smithi184:> sudo hostname smithi184 2024-04-17T15:48:03.867 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2024-04-17T15:48:03.928 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="Red Hat Enterprise Linux" 2024-04-17T15:48:03.928 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="8.6 (Ootpa)" 2024-04-17T15:48:03.928 INFO:teuthology.orchestra.run.smithi184.stdout:ID="rhel" 2024-04-17T15:48:03.928 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE="fedora" 2024-04-17T15:48:03.928 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="8.6" 2024-04-17T15:48:03.928 INFO:teuthology.orchestra.run.smithi184.stdout:PLATFORM_ID="platform:el8" 2024-04-17T15:48:03.929 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-17T15:48:03.929 INFO:teuthology.orchestra.run.smithi184.stdout:ANSI_COLOR="0;31" 2024-04-17T15:48:03.929 INFO:teuthology.orchestra.run.smithi184.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-17T15:48:03.929 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://www.redhat.com/" 2024-04-17T15:48:03.929 INFO:teuthology.orchestra.run.smithi184.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-17T15:48:03.929 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T15:48:03.929 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-04-17T15:48:03.929 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-17T15:48:03.929 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-17T15:48:03.929 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-17T15:48:03.929 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-17T15:48:03.930 INFO:teuthology.provision.fog.smithi184:Deploy complete! 2024-04-17T15:48:03.932 DEBUG:teuthology.parallel:result is None 2024-04-17T15:48:05.884 WARNING:teuthology.provision.fog.smithi178:timed out 2024-04-17T15:48:11.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T15:48:12.141 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T15:48:12.141 DEBUG:teuthology.orchestra.run.smithi178:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T15:48:12.389 INFO:teuthology.provision.fog.smithi178:Node is ready 2024-04-17T15:48:12.389 DEBUG:teuthology.orchestra.run.smithi178:> hostname 2024-04-17T15:48:12.407 INFO:teuthology.orchestra.run.smithi178.stdout:smithi178.front.sepia.ceph.com 2024-04-17T15:48:12.407 DEBUG:teuthology.orchestra.run.smithi178:> grep smithi178.front.sepia.ceph.com /etc/hosts 2024-04-17T15:48:12.464 INFO:teuthology.orchestra.run.smithi178.stdout:172.21.15.178 smithi178.front.sepia.ceph.com smithi178 2024-04-17T15:48:12.465 DEBUG:teuthology.orchestra.run.smithi178:> sudo hostname smithi178 2024-04-17T15:48:12.584 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/smithi178.front.sepia.ceph.com/smithi178/g' /etc/hosts 2024-04-17T15:48:12.613 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/172.21.15.178/172.21.15.178/g' /etc/hosts 2024-04-17T15:48:12.680 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/smithi178.front.sepia.ceph.com/smithi178/g' /etc/hostname 2024-04-17T15:48:12.747 DEBUG:teuthology.orchestra.run.smithi178:> sudo hostname smithi178 2024-04-17T15:48:12.813 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release 2024-04-17T15:48:12.869 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="Red Hat Enterprise Linux" 2024-04-17T15:48:12.869 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="8.6 (Ootpa)" 2024-04-17T15:48:12.869 INFO:teuthology.orchestra.run.smithi178.stdout:ID="rhel" 2024-04-17T15:48:12.870 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE="fedora" 2024-04-17T15:48:12.870 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="8.6" 2024-04-17T15:48:12.870 INFO:teuthology.orchestra.run.smithi178.stdout:PLATFORM_ID="platform:el8" 2024-04-17T15:48:12.870 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-17T15:48:12.870 INFO:teuthology.orchestra.run.smithi178.stdout:ANSI_COLOR="0;31" 2024-04-17T15:48:12.870 INFO:teuthology.orchestra.run.smithi178.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-17T15:48:12.870 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://www.redhat.com/" 2024-04-17T15:48:12.870 INFO:teuthology.orchestra.run.smithi178.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-17T15:48:12.870 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T15:48:12.870 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-17T15:48:12.870 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-17T15:48:12.870 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-17T15:48:12.870 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-17T15:48:12.871 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-17T15:48:12.871 INFO:teuthology.provision.fog.smithi178:Deploy complete! 2024-04-17T15:48:12.871 DEBUG:teuthology.parallel:result is None 2024-04-17T15:48:13.025 INFO:teuthology.lock.ops:Checking smithi178.front.sepia.ceph.com 2024-04-17T15:48:13.026 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T15:48:13.054 INFO:teuthology.lock.ops:Checking smithi184.front.sepia.ceph.com 2024-04-17T15:48:13.054 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T15:48:13.080 INFO:teuthology.lock.ops:Updating [smithi178.front.sepia.ceph.com]: set os type and version on server 2024-04-17T15:48:13.081 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-04-17T15:48:13.081 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T15:48:13.173 DEBUG:teuthology.orchestra.run.smithi178:> true 2024-04-17T15:48:13.195 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-04-17T15:48:13.196 DEBUG:teuthology.orchestra.run.smithi178:> uname -m 2024-04-17T15:48:13.252 INFO:teuthology.orchestra.run.smithi178.stdout:x86_64 2024-04-17T15:48:13.252 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release 2024-04-17T15:48:13.309 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="Red Hat Enterprise Linux" 2024-04-17T15:48:13.310 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="8.6 (Ootpa)" 2024-04-17T15:48:13.310 INFO:teuthology.orchestra.run.smithi178.stdout:ID="rhel" 2024-04-17T15:48:13.311 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE="fedora" 2024-04-17T15:48:13.311 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="8.6" 2024-04-17T15:48:13.311 INFO:teuthology.orchestra.run.smithi178.stdout:PLATFORM_ID="platform:el8" 2024-04-17T15:48:13.311 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-17T15:48:13.311 INFO:teuthology.orchestra.run.smithi178.stdout:ANSI_COLOR="0;31" 2024-04-17T15:48:13.311 INFO:teuthology.orchestra.run.smithi178.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-17T15:48:13.311 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://www.redhat.com/" 2024-04-17T15:48:13.311 INFO:teuthology.orchestra.run.smithi178.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-17T15:48:13.311 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T15:48:13.311 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-17T15:48:13.311 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-17T15:48:13.311 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-17T15:48:13.311 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-17T15:48:13.311 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-17T15:48:13.312 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server 2024-04-17T15:48:13.338 INFO:teuthology.lock.ops:Updating [smithi184.front.sepia.ceph.com]: set os type and version on server 2024-04-17T15:48:13.338 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-04-17T15:48:13.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T15:48:13.415 DEBUG:teuthology.orchestra.run.smithi184:> true 2024-04-17T15:48:13.490 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-04-17T15:48:13.490 DEBUG:teuthology.orchestra.run.smithi184:> uname -m 2024-04-17T15:48:13.551 INFO:teuthology.orchestra.run.smithi184.stdout:x86_64 2024-04-17T15:48:13.551 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2024-04-17T15:48:13.611 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="Red Hat Enterprise Linux" 2024-04-17T15:48:13.611 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="8.6 (Ootpa)" 2024-04-17T15:48:13.611 INFO:teuthology.orchestra.run.smithi184.stdout:ID="rhel" 2024-04-17T15:48:13.612 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE="fedora" 2024-04-17T15:48:13.612 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="8.6" 2024-04-17T15:48:13.612 INFO:teuthology.orchestra.run.smithi184.stdout:PLATFORM_ID="platform:el8" 2024-04-17T15:48:13.612 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-17T15:48:13.612 INFO:teuthology.orchestra.run.smithi184.stdout:ANSI_COLOR="0;31" 2024-04-17T15:48:13.612 INFO:teuthology.orchestra.run.smithi184.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-17T15:48:13.612 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://www.redhat.com/" 2024-04-17T15:48:13.612 INFO:teuthology.orchestra.run.smithi184.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-17T15:48:13.612 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T15:48:13.612 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-04-17T15:48:13.612 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-17T15:48:13.613 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-17T15:48:13.613 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-17T15:48:13.613 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-17T15:48:13.613 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2024-04-17T15:48:13.638 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T15:48:13.735 INFO:teuthology.dispatcher.supervisor:Running job 7659706 2024-04-17T15:48:13.735 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-17_01:16:02-upgrade:quincy-x-reef-distro-default-smithi/7659706 --name teuthology-2024-04-17_01:16:02-upgrade:quincy-x-reef-distro-default-smithi --description upgrade:quincy-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} -- /home/teuthworker/archive/teuthology-2024-04-17_01:16:02-upgrade:quincy-x-reef-distro-default-smithi/7659706/orig.config.yaml 2024-04-17T15:48:13.738 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-17_01:16:02-upgrade:quincy-x-reef-distro-default-smithi/7659706 2024-04-17T15:48:13.739 INFO:teuthology.dispatcher.supervisor:Job PID: 1929567 2024-04-17T15:48:13.739 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-17T15:50:13.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T15:52:14.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T15:54:14.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T15:56:14.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T15:58:14.518 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T16:00:14.686 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T16:02:14.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T16:04:15.010 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T16:06:15.172 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T16:08:15.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T16:10:15.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T16:12:15.669 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T16:14:15.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T16:16:15.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T16:18:16.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T16:20:16.288 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T16:22:16.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T16:24:16.565 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T16:26:16.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T16:28:16.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T16:30:17.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T16:32:17.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T16:34:17.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T16:36:17.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T16:38:17.680 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T16:40:17.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T16:42:18.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T16:44:18.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T16:46:18.249 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T16:48:18.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T16:50:18.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T16:52:18.753 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T16:54:18.928 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T16:56:19.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T16:58:19.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T17:00:19.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T17:02:19.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T17:04:19.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T17:06:19.940 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T17:08:20.115 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T17:10:20.288 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T17:12:20.456 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T17:14:20.601 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T17:16:20.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T17:18:20.946 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T17:20:21.076 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T17:22:21.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T17:24:21.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T17:26:21.581 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T17:28:21.744 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T17:30:21.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T17:32:22.080 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T17:34:22.242 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T17:36:22.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T17:38:22.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T17:40:22.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T17:42:22.910 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T17:44:23.060 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T17:46:23.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T17:48:23.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T17:50:23.570 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T17:52:23.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T17:54:23.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T17:56:24.072 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T17:58:24.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T18:00:24.399 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T18:02:24.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T18:04:24.718 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T18:06:24.884 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T18:08:25.046 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T18:10:25.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T18:12:25.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T18:14:25.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T18:16:25.714 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T18:18:25.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T18:20:26.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T18:22:26.186 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T18:24:26.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T18:26:26.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T18:28:26.692 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T18:30:26.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T18:32:27.005 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T18:34:27.173 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T18:36:27.332 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T18:38:27.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T18:40:27.661 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T18:42:27.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T18:44:27.994 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T18:46:28.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T18:48:28.340 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T18:50:28.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T18:52:28.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T18:54:28.830 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T18:56:28.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T18:58:29.154 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T19:00:29.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T19:02:29.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T19:04:29.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T19:06:29.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T19:08:30.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T19:10:30.193 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T19:12:30.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T19:14:30.528 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T19:16:30.692 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T19:18:30.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T19:20:31.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T19:20:31.095 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2024-04-17T19:20:31.210 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi178 but it was locked by another job: /home/teuthworker/archive/pdonnell-2024-04-17_17:06:06-fs-wip-pdonnell-testing-20240417.021458-debug-distro-default-smithi/7660559 2024-04-17T19:20:31.210 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi184 but it was locked by another job: /home/teuthworker/archive/pdonnell-2024-04-17_17:06:06-fs-wip-pdonnell-testing-20240417.021458-debug-distro-default-smithi/7660548