2024-01-10T05:37:44.696 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-10T05:37:44.696 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-10T05:37:44.834 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6230ad5c10>, signals=[15]) 2024-01-10T05:37:44.834 INFO:teuthology.lock.ops:Start node 'smithi043.front.sepia.ceph.com' reimaging 2024-01-10T05:37:44.834 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: reset os type and version on server 2024-01-10T05:37:44.835 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2024-01-10T05:37:44.857 INFO:teuthology.lock.ops:Start node 'smithi077.front.sepia.ceph.com' reimaging 2024-01-10T05:37:44.857 INFO:teuthology.lock.ops:Updating [smithi077.front.sepia.ceph.com]: reset os type and version on server 2024-01-10T05:37:44.857 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2024-01-10T05:37:44.994 DEBUG:teuthology.provision.fog.smithi077:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-10T05:37:44.997 DEBUG:teuthology.provision.fog.smithi043:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-10T05:37:45.038 INFO:teuthology.provision.fog.smithi043:Scheduling deploy of rhel 8.6 2024-01-10T05:37:45.040 INFO:teuthology.provision.fog.smithi077:Scheduling deploy of rhel 8.6 2024-01-10T05:37:45.346 INFO:teuthology.orchestra.console.smithi043:Power off 2024-01-10T05:37:45.346 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-10T05:37:45.359 INFO:teuthology.orchestra.console.smithi077:Power off 2024-01-10T05:37:45.359 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-10T05:37:45.368 DEBUG:teuthology.orchestra.console.smithi043:power off output: Chassis Power Control: Down/Off 2024-01-10T05:37:45.369 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-10T05:37:45.380 DEBUG:teuthology.orchestra.console.smithi077:power off output: Chassis Power Control: Down/Off 2024-01-10T05:37:45.381 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-10T05:37:45.391 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is on 2024-01-10T05:37:45.401 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is on 2024-01-10T05:37:49.396 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-10T05:37:49.402 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-10T05:37:49.504 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is on 2024-01-10T05:37:49.509 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is on 2024-01-10T05:37:53.506 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-10T05:37:53.513 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-10T05:37:53.615 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off 2024-01-10T05:37:53.620 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is on 2024-01-10T05:37:53.717 INFO:teuthology.orchestra.console.smithi043:Power off completed 2024-01-10T05:37:53.817 INFO:teuthology.orchestra.console.smithi043:Power on 2024-01-10T05:37:53.817 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-10T05:37:53.838 DEBUG:teuthology.orchestra.console.smithi043:power on output: Chassis Power Control: Up/On 2024-01-10T05:37:53.839 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-10T05:37:53.860 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off 2024-01-10T05:37:57.624 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-10T05:37:57.733 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is off 2024-01-10T05:37:57.834 INFO:teuthology.orchestra.console.smithi077:Power off completed 2024-01-10T05:37:57.861 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-10T05:37:57.934 INFO:teuthology.orchestra.console.smithi077:Power on 2024-01-10T05:37:57.935 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-10T05:37:57.956 DEBUG:teuthology.orchestra.console.smithi077:power on output: Chassis Power Control: Up/On 2024-01-10T05:37:57.956 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-10T05:37:57.971 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off 2024-01-10T05:37:57.980 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is off 2024-01-10T05:38:01.973 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-10T05:38:01.981 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-10T05:38:02.082 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is on 2024-01-10T05:38:02.089 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is on 2024-01-10T05:38:02.183 INFO:teuthology.orchestra.console.smithi043:Power on completed 2024-01-10T05:38:02.190 INFO:teuthology.orchestra.console.smithi077:Power on completed 2024-01-10T05:38:02.284 INFO:teuthology.provision.fog.smithi043:Waiting for deploy to finish 2024-01-10T05:38:02.290 INFO:teuthology.provision.fog.smithi077:Waiting for deploy to finish 2024-01-10T05:40:33.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-10T05:40:48.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-10T05:40:51.644 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2024-01-10T05:40:57.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-10T05:41:00.704 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2024-01-10T05:41:06.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-10T05:41:06.752 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2024-01-10T05:41:09.788 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2024-01-10T05:41:12.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-10T05:41:15.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-10T05:41:15.836 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2024-01-10T05:41:18.844 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2024-01-10T05:41:21.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-10T05:41:24.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-10T05:41:24.892 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2024-01-10T05:41:30.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-10T05:41:33.952 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2024-01-10T05:41:39.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-10T05:42:24.893 WARNING:teuthology.provision.fog.smithi043:timed out 2024-01-10T05:42:30.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-10T05:42:31.146 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-10T05:42:31.146 DEBUG:teuthology.orchestra.run.smithi043:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-10T05:42:31.407 INFO:teuthology.provision.fog.smithi043:Node is ready 2024-01-10T05:42:31.407 DEBUG:teuthology.orchestra.run.smithi043:> hostname 2024-01-10T05:42:31.428 INFO:teuthology.orchestra.run.smithi043.stdout:smithi043.front.sepia.ceph.com 2024-01-10T05:42:31.428 DEBUG:teuthology.orchestra.run.smithi043:> grep smithi043.front.sepia.ceph.com /etc/hosts 2024-01-10T05:42:31.489 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43 smithi043.front.sepia.ceph.com smithi043 2024-01-10T05:42:31.490 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname smithi043 2024-01-10T05:42:31.608 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/smithi043.front.sepia.ceph.com/smithi043/g' /etc/hosts 2024-01-10T05:42:31.642 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/172.21.15.43/172.21.15.43/g' /etc/hosts 2024-01-10T05:42:31.717 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/smithi043.front.sepia.ceph.com/smithi043/g' /etc/hostname 2024-01-10T05:42:31.792 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname smithi043 2024-01-10T05:42:31.866 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release 2024-01-10T05:42:31.927 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="Red Hat Enterprise Linux" 2024-01-10T05:42:31.927 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="8.6 (Ootpa)" 2024-01-10T05:42:31.927 INFO:teuthology.orchestra.run.smithi043.stdout:ID="rhel" 2024-01-10T05:42:31.928 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="fedora" 2024-01-10T05:42:31.928 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="8.6" 2024-01-10T05:42:31.928 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el8" 2024-01-10T05:42:31.928 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-10T05:42:31.928 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31" 2024-01-10T05:42:31.928 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-10T05:42:31.928 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://www.redhat.com/" 2024-01-10T05:42:31.928 INFO:teuthology.orchestra.run.smithi043.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-10T05:42:31.928 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-10T05:42:31.928 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-01-10T05:42:31.928 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-10T05:42:31.928 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-10T05:42:31.928 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-10T05:42:31.928 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-10T05:42:31.929 INFO:teuthology.provision.fog.smithi043:Deploy complete! 2024-01-10T05:42:31.930 DEBUG:teuthology.parallel:result is None 2024-01-10T05:42:39.969 WARNING:teuthology.provision.fog.smithi077:timed out 2024-01-10T05:42:45.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-10T05:42:46.240 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-10T05:42:46.240 DEBUG:teuthology.orchestra.run.smithi077:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-10T05:42:46.496 INFO:teuthology.provision.fog.smithi077:Node is ready 2024-01-10T05:42:46.496 DEBUG:teuthology.orchestra.run.smithi077:> hostname 2024-01-10T05:42:46.513 INFO:teuthology.orchestra.run.smithi077.stdout:smithi077 2024-01-10T05:42:46.513 DEBUG:teuthology.orchestra.run.smithi077:> grep smithi077 /etc/hosts 2024-01-10T05:42:46.571 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77 smithi077.front.sepia.ceph.com smithi077 2024-01-10T05:42:46.571 DEBUG:teuthology.orchestra.run.smithi077:> sudo hostname smithi077 2024-01-10T05:42:46.703 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i -e 's/smithi077/smithi077/g' /etc/hosts 2024-01-10T05:42:46.732 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i -e 's/172.21.15.77/172.21.15.77/g' /etc/hosts 2024-01-10T05:42:46.800 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i -e 's/smithi077/smithi077/g' /etc/hostname 2024-01-10T05:42:46.867 DEBUG:teuthology.orchestra.run.smithi077:> sudo hostname smithi077 2024-01-10T05:42:46.934 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release 2024-01-10T05:42:46.991 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="Red Hat Enterprise Linux" 2024-01-10T05:42:46.991 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="8.6 (Ootpa)" 2024-01-10T05:42:46.991 INFO:teuthology.orchestra.run.smithi077.stdout:ID="rhel" 2024-01-10T05:42:46.991 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE="fedora" 2024-01-10T05:42:46.991 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="8.6" 2024-01-10T05:42:46.991 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM_ID="platform:el8" 2024-01-10T05:42:46.991 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-10T05:42:46.991 INFO:teuthology.orchestra.run.smithi077.stdout:ANSI_COLOR="0;31" 2024-01-10T05:42:46.991 INFO:teuthology.orchestra.run.smithi077.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-10T05:42:46.992 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://www.redhat.com/" 2024-01-10T05:42:46.992 INFO:teuthology.orchestra.run.smithi077.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-10T05:42:46.992 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-10T05:42:46.992 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-01-10T05:42:46.992 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-10T05:42:46.992 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-10T05:42:46.992 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-10T05:42:46.992 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-10T05:42:46.992 INFO:teuthology.provision.fog.smithi077:Deploy complete! 2024-01-10T05:42:46.993 DEBUG:teuthology.parallel:result is None 2024-01-10T05:42:47.141 INFO:teuthology.lock.ops:Checking smithi043.front.sepia.ceph.com 2024-01-10T05:42:47.142 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-10T05:42:47.165 INFO:teuthology.lock.ops:Checking smithi077.front.sepia.ceph.com 2024-01-10T05:42:47.165 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-10T05:42:47.182 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: set os type and version on server 2024-01-10T05:42:47.182 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-01-10T05:42:47.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-10T05:42:47.257 DEBUG:teuthology.orchestra.run.smithi043:> true 2024-01-10T05:42:47.400 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-01-10T05:42:47.401 DEBUG:teuthology.orchestra.run.smithi043:> uname -m 2024-01-10T05:42:47.461 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64 2024-01-10T05:42:47.462 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release 2024-01-10T05:42:47.522 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="Red Hat Enterprise Linux" 2024-01-10T05:42:47.522 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="8.6 (Ootpa)" 2024-01-10T05:42:47.523 INFO:teuthology.orchestra.run.smithi043.stdout:ID="rhel" 2024-01-10T05:42:47.523 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="fedora" 2024-01-10T05:42:47.523 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="8.6" 2024-01-10T05:42:47.523 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el8" 2024-01-10T05:42:47.523 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-10T05:42:47.523 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31" 2024-01-10T05:42:47.523 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-10T05:42:47.523 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://www.redhat.com/" 2024-01-10T05:42:47.523 INFO:teuthology.orchestra.run.smithi043.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-10T05:42:47.523 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-10T05:42:47.523 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-01-10T05:42:47.523 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-10T05:42:47.523 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-10T05:42:47.524 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-10T05:42:47.524 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-10T05:42:47.525 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2024-01-10T05:42:47.548 INFO:teuthology.lock.ops:Updating [smithi077.front.sepia.ceph.com]: set os type and version on server 2024-01-10T05:42:47.548 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-01-10T05:42:47.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-10T05:42:47.621 DEBUG:teuthology.orchestra.run.smithi077:> true 2024-01-10T05:42:47.688 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-01-10T05:42:47.688 DEBUG:teuthology.orchestra.run.smithi077:> uname -m 2024-01-10T05:42:47.745 INFO:teuthology.orchestra.run.smithi077.stdout:x86_64 2024-01-10T05:42:47.745 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release 2024-01-10T05:42:47.802 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="Red Hat Enterprise Linux" 2024-01-10T05:42:47.802 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="8.6 (Ootpa)" 2024-01-10T05:42:47.802 INFO:teuthology.orchestra.run.smithi077.stdout:ID="rhel" 2024-01-10T05:42:47.802 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE="fedora" 2024-01-10T05:42:47.802 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="8.6" 2024-01-10T05:42:47.802 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM_ID="platform:el8" 2024-01-10T05:42:47.802 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-10T05:42:47.802 INFO:teuthology.orchestra.run.smithi077.stdout:ANSI_COLOR="0;31" 2024-01-10T05:42:47.803 INFO:teuthology.orchestra.run.smithi077.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-10T05:42:47.803 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://www.redhat.com/" 2024-01-10T05:42:47.803 INFO:teuthology.orchestra.run.smithi077.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-10T05:42:47.803 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-10T05:42:47.803 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-01-10T05:42:47.803 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-10T05:42:47.803 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-10T05:42:47.803 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-10T05:42:47.803 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-10T05:42:47.803 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2024-01-10T05:42:47.825 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-10T05:42:47.908 INFO:teuthology.dispatcher.supervisor:Running job 7510390 2024-01-10T05:42:47.909 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-01-09_20:55:51-rados-quincy-distro-default-smithi/7510390 --name yuriw-2024-01-09_20:55:51-rados-quincy-distro-default-smithi --description rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/one workloads/rados_api_tests} -- /home/teuthworker/archive/yuriw-2024-01-09_20:55:51-rados-quincy-distro-default-smithi/7510390/orig.config.yaml 2024-01-10T05:42:47.912 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-01-09_20:55:51-rados-quincy-distro-default-smithi/7510390 2024-01-10T05:42:47.912 INFO:teuthology.dispatcher.supervisor:Job PID: 1064409 2024-01-10T05:42:47.912 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-10T05:44:48.009 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-10T05:46:48.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-10T05:48:48.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-10T05:50:48.521 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-10T05:52:48.680 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-10T05:54:48.841 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-10T05:56:49.004 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-10T05:58:49.170 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-10T06:00:49.317 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-10T06:02:49.484 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-10T06:04:49.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-10T06:06:49.818 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-10T06:08:49.981 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-10T06:10:50.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-10T06:12:50.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-10T06:14:50.484 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-10T06:16:50.656 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-10T06:18:50.828 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-10T06:20:50.992 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-10T06:22:51.160 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-10T06:24:51.324 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-10T06:24:51.389 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-10T06:24:51.555 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-10T06:24:51.555 INFO:teuthology.nuke:Checking targets against current locks 2024-01-10T06:24:51.605 DEBUG:teuthology.nuke:shortname: smithi043 2024-01-10T06:24:51.606 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-10T06:24:51.628 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi043.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-09_20:55:51-rados-quincy-distro-default-smithi/7510390', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-10 05:37:43.698441', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCAEO3CDxR2gPSN/CNgiI0ZT6WTmJMkvsT2UN7wFAJQs9l9aMLGcqcil/LImhVPzFN8lfsYwOXiuK1yIQVSGXxM='} 2024-01-10T06:24:51.631 DEBUG:teuthology.nuke:shortname: smithi077 2024-01-10T06:24:51.631 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-10T06:24:51.652 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi077.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-09_20:55:51-rados-quincy-distro-default-smithi/7510390', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-10 05:37:43.697096', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDedM8eDB3sHSCGZziJctQr/QBv2WEfQMMjYJnm2D1SHunIc8ePuyBVpwDNY6QmY+1iL/FNhCV5/I1EG9EUpwKM='} 2024-01-10T06:24:51.680 INFO:teuthology.orchestra.console.smithi043:Power off 2024-01-10T06:24:51.681 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-10T06:24:51.704 DEBUG:teuthology.orchestra.console.smithi043:power off output: Chassis Power Control: Down/Off 2024-01-10T06:24:51.704 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-10T06:24:51.717 INFO:teuthology.orchestra.console.smithi077:Power off 2024-01-10T06:24:51.717 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-10T06:24:51.724 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off 2024-01-10T06:24:51.741 DEBUG:teuthology.orchestra.console.smithi077:power off output: Chassis Power Control: Down/Off 2024-01-10T06:24:51.741 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-10T06:24:51.762 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is off 2024-01-10T06:24:51.825 INFO:teuthology.orchestra.console.smithi043:Power off completed 2024-01-10T06:24:51.863 INFO:teuthology.orchestra.console.smithi077:Power off completed 2024-01-10T06:24:51.979 INFO:teuthology.lock.ops:unlocked: smithi043.front.sepia.ceph.com 2024-01-10T06:24:52.012 INFO:teuthology.lock.ops:unlocked: smithi077.front.sepia.ceph.com