2024-01-13T06:35:48.694 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-13T06:35:48.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T06:35:48.852 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0cca7b3c10>, signals=[15]) 2024-01-13T06:35:48.852 INFO:teuthology.lock.ops:Start node 'smithi079.front.sepia.ceph.com' reimaging 2024-01-13T06:35:48.853 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: reset os type and version on server 2024-01-13T06:35:48.853 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2024-01-13T06:35:48.882 INFO:teuthology.lock.ops:Start node 'smithi173.front.sepia.ceph.com' reimaging 2024-01-13T06:35:48.882 INFO:teuthology.lock.ops:Updating [smithi173.front.sepia.ceph.com]: reset os type and version on server 2024-01-13T06:35:48.882 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2024-01-13T06:35:49.010 DEBUG:teuthology.provision.fog.smithi079:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-13T06:35:49.032 DEBUG:teuthology.provision.fog.smithi173:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-13T06:35:49.058 INFO:teuthology.provision.fog.smithi079:Scheduling deploy of rhel 8.6 2024-01-13T06:35:49.079 INFO:teuthology.provision.fog.smithi173:Scheduling deploy of rhel 8.6 2024-01-13T06:35:49.361 INFO:teuthology.orchestra.console.smithi079:Power off 2024-01-13T06:35:49.361 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-13T06:35:49.382 INFO:teuthology.orchestra.console.smithi173:Power off 2024-01-13T06:35:49.382 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-13T06:35:49.391 DEBUG:teuthology.orchestra.console.smithi079:power off output: Chassis Power Control: Down/Off 2024-01-13T06:35:49.391 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T06:35:49.406 DEBUG:teuthology.orchestra.console.smithi173:power off output: Chassis Power Control: Down/Off 2024-01-13T06:35:49.406 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T06:35:49.415 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2024-01-13T06:35:49.430 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off 2024-01-13T06:35:49.517 INFO:teuthology.orchestra.console.smithi079:Power off completed 2024-01-13T06:35:49.531 INFO:teuthology.orchestra.console.smithi173:Power off completed 2024-01-13T06:35:49.618 INFO:teuthology.orchestra.console.smithi079:Power on 2024-01-13T06:35:49.619 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-13T06:35:49.632 INFO:teuthology.orchestra.console.smithi173:Power on 2024-01-13T06:35:49.632 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-13T06:35:49.646 DEBUG:teuthology.orchestra.console.smithi079:power on output: Chassis Power Control: Up/On 2024-01-13T06:35:49.646 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T06:35:49.654 DEBUG:teuthology.orchestra.console.smithi173:power on output: Chassis Power Control: Up/On 2024-01-13T06:35:49.654 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T06:35:49.666 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2024-01-13T06:35:49.677 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off 2024-01-13T06:35:53.671 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T06:35:53.678 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T06:35:53.780 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2024-01-13T06:35:53.786 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2024-01-13T06:35:53.887 INFO:teuthology.orchestra.console.smithi173:Power on completed 2024-01-13T06:35:53.987 INFO:teuthology.provision.fog.smithi173:Waiting for deploy to finish 2024-01-13T06:35:57.784 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T06:35:57.892 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2024-01-13T06:35:57.992 INFO:teuthology.orchestra.console.smithi079:Power on completed 2024-01-13T06:35:58.093 INFO:teuthology.provision.fog.smithi079:Waiting for deploy to finish 2024-01-13T06:38:40.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T06:38:43.324 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-01-13T06:38:44.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T06:38:47.296 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-01-13T06:38:49.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T06:38:52.384 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-01-13T06:38:53.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T06:38:56.348 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-01-13T06:38:58.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T06:39:01.468 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-01-13T06:39:02.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T06:39:05.404 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-01-13T06:39:07.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T06:39:10.528 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-01-13T06:39:11.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T06:39:14.464 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-01-13T06:39:16.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T06:39:19.612 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-01-13T06:39:20.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T06:39:23.549 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-01-13T06:39:25.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T06:39:28.668 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-01-13T06:39:29.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T06:39:32.604 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-01-13T06:39:34.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T06:39:38.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T06:39:53.152 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-01-13T06:39:56.988 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-01-13T06:39:59.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T06:40:02.236 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-01-13T06:40:02.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T06:40:06.044 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-01-13T06:40:08.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T06:40:11.296 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-01-13T06:40:12.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T06:40:15.104 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-01-13T06:40:17.299 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T06:40:17.533 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-13T06:40:17.533 DEBUG:teuthology.orchestra.run.smithi173:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-13T06:40:21.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T06:40:21.452 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-13T06:40:21.452 DEBUG:teuthology.orchestra.run.smithi079:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-13T06:40:37.827 INFO:teuthology.provision.fog.smithi173:Node is ready 2024-01-13T06:40:37.828 DEBUG:teuthology.orchestra.run.smithi173:> hostname 2024-01-13T06:40:37.850 INFO:teuthology.orchestra.run.smithi173.stdout:smithi173.front.sepia.ceph.com 2024-01-13T06:40:37.850 DEBUG:teuthology.orchestra.run.smithi173:> grep smithi173.front.sepia.ceph.com /etc/hosts 2024-01-13T06:40:37.910 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.15.173 smithi173.front.sepia.ceph.com smithi173 2024-01-13T06:40:37.910 DEBUG:teuthology.orchestra.run.smithi173:> sudo hostname smithi173 2024-01-13T06:40:38.042 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/smithi173.front.sepia.ceph.com/smithi173/g' /etc/hosts 2024-01-13T06:40:38.072 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/172.21.15.173/172.21.15.173/g' /etc/hosts 2024-01-13T06:40:38.142 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/smithi173.front.sepia.ceph.com/smithi173/g' /etc/hostname 2024-01-13T06:40:38.211 DEBUG:teuthology.orchestra.run.smithi173:> sudo hostname smithi173 2024-01-13T06:40:38.279 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release 2024-01-13T06:40:38.336 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="Red Hat Enterprise Linux" 2024-01-13T06:40:38.336 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="8.6 (Ootpa)" 2024-01-13T06:40:38.336 INFO:teuthology.orchestra.run.smithi173.stdout:ID="rhel" 2024-01-13T06:40:38.336 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="fedora" 2024-01-13T06:40:38.337 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="8.6" 2024-01-13T06:40:38.337 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el8" 2024-01-13T06:40:38.337 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-13T06:40:38.337 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31" 2024-01-13T06:40:38.337 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-13T06:40:38.337 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://www.redhat.com/" 2024-01-13T06:40:38.337 INFO:teuthology.orchestra.run.smithi173.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-13T06:40:38.337 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-13T06:40:38.337 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-13T06:40:38.337 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-13T06:40:38.337 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-13T06:40:38.337 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-13T06:40:38.337 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-13T06:40:38.338 INFO:teuthology.provision.fog.smithi173:Deploy complete! 2024-01-13T06:40:38.340 DEBUG:teuthology.parallel:result is None 2024-01-13T06:40:41.879 INFO:teuthology.provision.fog.smithi079:Node is ready 2024-01-13T06:40:41.879 DEBUG:teuthology.orchestra.run.smithi079:> hostname 2024-01-13T06:40:41.901 INFO:teuthology.orchestra.run.smithi079.stdout:smithi079.front.sepia.ceph.com 2024-01-13T06:40:41.901 DEBUG:teuthology.orchestra.run.smithi079:> grep smithi079.front.sepia.ceph.com /etc/hosts 2024-01-13T06:40:41.960 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79 smithi079.front.sepia.ceph.com smithi079 2024-01-13T06:40:41.961 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079 2024-01-13T06:40:42.109 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079.front.sepia.ceph.com/smithi079/g' /etc/hosts 2024-01-13T06:40:42.140 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/172.21.15.79/172.21.15.79/g' /etc/hosts 2024-01-13T06:40:42.209 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079.front.sepia.ceph.com/smithi079/g' /etc/hostname 2024-01-13T06:40:42.280 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079 2024-01-13T06:40:42.348 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2024-01-13T06:40:42.406 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="Red Hat Enterprise Linux" 2024-01-13T06:40:42.406 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="8.6 (Ootpa)" 2024-01-13T06:40:42.406 INFO:teuthology.orchestra.run.smithi079.stdout:ID="rhel" 2024-01-13T06:40:42.406 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="fedora" 2024-01-13T06:40:42.406 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="8.6" 2024-01-13T06:40:42.406 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el8" 2024-01-13T06:40:42.406 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-13T06:40:42.406 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2024-01-13T06:40:42.406 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-13T06:40:42.407 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://www.redhat.com/" 2024-01-13T06:40:42.407 INFO:teuthology.orchestra.run.smithi079.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-13T06:40:42.407 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-13T06:40:42.407 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-01-13T06:40:42.407 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-13T06:40:42.407 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-13T06:40:42.407 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-13T06:40:42.407 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-13T06:40:42.407 INFO:teuthology.provision.fog.smithi079:Deploy complete! 2024-01-13T06:40:42.408 DEBUG:teuthology.parallel:result is None 2024-01-13T06:40:42.559 INFO:teuthology.lock.ops:Checking smithi079.front.sepia.ceph.com 2024-01-13T06:40:42.559 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-13T06:40:42.584 INFO:teuthology.lock.ops:Checking smithi173.front.sepia.ceph.com 2024-01-13T06:40:42.584 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-13T06:40:42.602 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: set os type and version on server 2024-01-13T06:40:42.602 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-01-13T06:40:42.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T06:40:42.676 DEBUG:teuthology.orchestra.run.smithi079:> true 2024-01-13T06:40:42.746 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-01-13T06:40:42.746 DEBUG:teuthology.orchestra.run.smithi079:> uname -m 2024-01-13T06:40:42.803 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2024-01-13T06:40:42.804 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2024-01-13T06:40:42.862 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="Red Hat Enterprise Linux" 2024-01-13T06:40:42.864 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="8.6 (Ootpa)" 2024-01-13T06:40:42.864 INFO:teuthology.orchestra.run.smithi079.stdout:ID="rhel" 2024-01-13T06:40:42.864 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="fedora" 2024-01-13T06:40:42.864 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="8.6" 2024-01-13T06:40:42.864 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el8" 2024-01-13T06:40:42.864 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-13T06:40:42.864 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2024-01-13T06:40:42.864 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-13T06:40:42.864 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://www.redhat.com/" 2024-01-13T06:40:42.864 INFO:teuthology.orchestra.run.smithi079.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-13T06:40:42.864 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-13T06:40:42.864 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-01-13T06:40:42.864 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-13T06:40:42.865 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-13T06:40:42.865 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-13T06:40:42.865 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-13T06:40:42.865 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2024-01-13T06:40:42.884 INFO:teuthology.lock.ops:Updating [smithi173.front.sepia.ceph.com]: set os type and version on server 2024-01-13T06:40:42.884 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-01-13T06:40:42.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T06:40:42.958 DEBUG:teuthology.orchestra.run.smithi173:> true 2024-01-13T06:40:43.028 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-01-13T06:40:43.028 DEBUG:teuthology.orchestra.run.smithi173:> uname -m 2024-01-13T06:40:43.086 INFO:teuthology.orchestra.run.smithi173.stdout:x86_64 2024-01-13T06:40:43.087 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release 2024-01-13T06:40:43.145 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="Red Hat Enterprise Linux" 2024-01-13T06:40:43.145 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="8.6 (Ootpa)" 2024-01-13T06:40:43.145 INFO:teuthology.orchestra.run.smithi173.stdout:ID="rhel" 2024-01-13T06:40:43.145 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="fedora" 2024-01-13T06:40:43.145 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="8.6" 2024-01-13T06:40:43.145 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el8" 2024-01-13T06:40:43.145 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-13T06:40:43.145 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31" 2024-01-13T06:40:43.145 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-13T06:40:43.145 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://www.redhat.com/" 2024-01-13T06:40:43.146 INFO:teuthology.orchestra.run.smithi173.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-13T06:40:43.146 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-13T06:40:43.146 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-13T06:40:43.146 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-13T06:40:43.146 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-13T06:40:43.146 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-13T06:40:43.146 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-13T06:40:43.146 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2024-01-13T06:40:43.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T06:40:43.269 INFO:teuthology.dispatcher.supervisor:Running job 7515486 2024-01-13T06:40:43.269 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-01-12_15:24:25-rados-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi/7515486 --name yuriw-2024-01-12_15:24:25-rados-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi --description rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps-readproxy} -- /home/teuthworker/archive/yuriw-2024-01-12_15:24:25-rados-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi/7515486/orig.config.yaml 2024-01-13T06:40:43.273 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-01-12_15:24:25-rados-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi/7515486 2024-01-13T06:40:43.273 INFO:teuthology.dispatcher.supervisor:Job PID: 3213993 2024-01-13T06:40:43.273 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-13T06:42:43.372 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T06:44:43.550 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T06:46:43.716 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T06:48:43.884 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T06:50:44.060 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T06:52:44.228 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T06:54:44.401 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T06:56:44.604 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T06:56:44.917 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-13T06:56:45.018 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-13T06:56:45.019 INFO:teuthology.nuke:Checking targets against current locks 2024-01-13T06:56:45.061 DEBUG:teuthology.nuke:shortname: smithi079 2024-01-13T06:56:45.061 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-13T06:56:45.085 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi079.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-12_15:24:25-rados-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi/7515486', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-13 06:35:47.651104', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNW3fwfaO1DkU2VmTJxRX6OUi1UU1KRZb0oboaiD8qGfuwLHemIvynjTp4DC6HxKoxdcrDLh9pXPYu9mccBX5EA='} 2024-01-13T06:56:45.088 DEBUG:teuthology.nuke:shortname: smithi173 2024-01-13T06:56:45.089 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-13T06:56:45.117 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi173.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-12_15:24:25-rados-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi/7515486', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-13 06:35:47.649107', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHs2uKUWz0J5yD097afEXZ9+fGq5vO2hqVG7jyUM3Vou/rQDuZOIdgY4fWp7iB9KM0vbpMt/s3GIRBfLeco2pdk='} 2024-01-13T06:56:45.135 INFO:teuthology.orchestra.console.smithi079:Power off 2024-01-13T06:56:45.135 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-13T06:56:45.158 DEBUG:teuthology.orchestra.console.smithi079:power off output: Chassis Power Control: Down/Off 2024-01-13T06:56:45.159 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T06:56:45.173 INFO:teuthology.orchestra.console.smithi173:Power off 2024-01-13T06:56:45.174 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-13T06:56:45.182 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2024-01-13T06:56:45.195 DEBUG:teuthology.orchestra.console.smithi173:power off output: Chassis Power Control: Down/Off 2024-01-13T06:56:45.195 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T06:56:45.216 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off 2024-01-13T06:56:45.284 INFO:teuthology.orchestra.console.smithi079:Power off completed 2024-01-13T06:56:45.317 INFO:teuthology.orchestra.console.smithi173:Power off completed 2024-01-13T06:56:45.438 INFO:teuthology.lock.ops:unlocked: smithi079.front.sepia.ceph.com 2024-01-13T06:56:45.462 INFO:teuthology.lock.ops:unlocked: smithi173.front.sepia.ceph.com