2024-01-19T19:30:08.713 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-19T19:30:08.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T19:30:08.850 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3879889c10>, signals=[15]) 2024-01-19T19:30:08.850 INFO:teuthology.lock.ops:Start node 'smithi112.front.sepia.ceph.com' reimaging 2024-01-19T19:30:08.850 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: reset os type and version on server 2024-01-19T19:30:08.850 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2024-01-19T19:30:08.874 INFO:teuthology.lock.ops:Start node 'smithi132.front.sepia.ceph.com' reimaging 2024-01-19T19:30:08.874 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: reset os type and version on server 2024-01-19T19:30:08.874 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2024-01-19T19:30:08.990 DEBUG:teuthology.provision.fog.smithi112:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-19T19:30:09.008 DEBUG:teuthology.provision.fog.smithi132:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-19T19:30:09.039 INFO:teuthology.provision.fog.smithi112:Scheduling deploy of rhel 8.6 2024-01-19T19:30:09.054 INFO:teuthology.provision.fog.smithi132:Scheduling deploy of rhel 8.6 2024-01-19T19:30:09.280 INFO:teuthology.orchestra.console.smithi112:Power off 2024-01-19T19:30:09.281 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-19T19:30:09.293 INFO:teuthology.orchestra.console.smithi132:Power off 2024-01-19T19:30:09.293 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-19T19:30:09.303 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off 2024-01-19T19:30:09.303 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T19:30:09.315 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off 2024-01-19T19:30:09.315 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T19:30:09.325 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2024-01-19T19:30:09.338 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2024-01-19T19:30:13.328 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T19:30:13.339 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T19:30:13.437 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2024-01-19T19:30:13.447 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2024-01-19T19:30:17.440 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T19:30:17.448 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T19:30:17.549 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2024-01-19T19:30:17.557 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2024-01-19T19:30:17.651 INFO:teuthology.orchestra.console.smithi112:Power off completed 2024-01-19T19:30:17.658 INFO:teuthology.orchestra.console.smithi132:Power off completed 2024-01-19T19:30:17.752 INFO:teuthology.orchestra.console.smithi112:Power on 2024-01-19T19:30:17.753 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-19T19:30:17.760 INFO:teuthology.orchestra.console.smithi132:Power on 2024-01-19T19:30:17.760 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-19T19:30:17.773 DEBUG:teuthology.orchestra.console.smithi112:power on output: Chassis Power Control: Up/On 2024-01-19T19:30:17.774 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T19:30:17.780 DEBUG:teuthology.orchestra.console.smithi132:power on output: Chassis Power Control: Up/On 2024-01-19T19:30:17.781 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T19:30:17.794 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2024-01-19T19:30:17.803 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2024-01-19T19:30:21.800 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T19:30:21.807 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T19:30:21.910 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2024-01-19T19:30:21.918 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2024-01-19T19:30:25.914 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T19:30:25.924 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T19:30:26.026 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2024-01-19T19:30:26.128 INFO:teuthology.orchestra.console.smithi112:Power on completed 2024-01-19T19:30:26.150 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2024-01-19T19:30:26.229 INFO:teuthology.provision.fog.smithi112:Waiting for deploy to finish 2024-01-19T19:30:26.251 INFO:teuthology.orchestra.console.smithi132:Power on completed 2024-01-19T19:30:26.352 INFO:teuthology.provision.fog.smithi132:Waiting for deploy to finish 2024-01-19T19:33:12.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T19:33:12.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T19:33:30.556 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-01-19T19:33:30.557 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-01-19T19:33:36.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T19:33:36.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T19:33:39.616 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-01-19T19:33:39.648 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-01-19T19:33:45.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T19:33:45.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T19:33:48.700 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-01-19T19:33:48.704 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-01-19T19:33:54.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T19:33:54.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T19:33:57.756 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-01-19T19:33:57.788 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-01-19T19:34:03.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T19:34:03.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T19:34:06.848 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-01-19T19:34:12.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T19:35:03.812 WARNING:teuthology.provision.fog.smithi132:timed out 2024-01-19T19:35:09.817 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T19:35:10.033 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-19T19:35:10.033 DEBUG:teuthology.orchestra.run.smithi132:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-19T19:35:10.328 INFO:teuthology.provision.fog.smithi132:Node is ready 2024-01-19T19:35:10.329 DEBUG:teuthology.orchestra.run.smithi132:> hostname 2024-01-19T19:35:10.346 INFO:teuthology.orchestra.run.smithi132.stdout:smithi132 2024-01-19T19:35:10.347 DEBUG:teuthology.orchestra.run.smithi132:> grep smithi132 /etc/hosts 2024-01-19T19:35:10.405 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.15.132 smithi132.front.sepia.ceph.com smithi132 2024-01-19T19:35:10.405 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132 2024-01-19T19:35:10.512 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132/smithi132/g' /etc/hosts 2024-01-19T19:35:10.543 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/172.21.15.132/172.21.15.132/g' /etc/hosts 2024-01-19T19:35:10.616 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132/smithi132/g' /etc/hostname 2024-01-19T19:35:10.687 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132 2024-01-19T19:35:10.758 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2024-01-19T19:35:10.819 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="Red Hat Enterprise Linux" 2024-01-19T19:35:10.819 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8.6 (Ootpa)" 2024-01-19T19:35:10.819 INFO:teuthology.orchestra.run.smithi132.stdout:ID="rhel" 2024-01-19T19:35:10.819 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="fedora" 2024-01-19T19:35:10.819 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8.6" 2024-01-19T19:35:10.819 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8" 2024-01-19T19:35:10.820 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-19T19:35:10.820 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2024-01-19T19:35:10.820 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-19T19:35:10.820 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://www.redhat.com/" 2024-01-19T19:35:10.820 INFO:teuthology.orchestra.run.smithi132.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-19T19:35:10.820 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-19T19:35:10.820 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-01-19T19:35:10.820 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-19T19:35:10.820 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-19T19:35:10.820 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-19T19:35:10.820 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-19T19:35:10.821 INFO:teuthology.provision.fog.smithi132:Deploy complete! 2024-01-19T19:35:10.822 DEBUG:teuthology.parallel:result is None 2024-01-19T19:35:12.856 WARNING:teuthology.provision.fog.smithi112:timed out 2024-01-19T19:35:18.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T19:35:19.141 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-19T19:35:19.141 DEBUG:teuthology.orchestra.run.smithi112:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-19T19:35:19.377 INFO:teuthology.provision.fog.smithi112:Node is ready 2024-01-19T19:35:19.377 DEBUG:teuthology.orchestra.run.smithi112:> hostname 2024-01-19T19:35:19.394 INFO:teuthology.orchestra.run.smithi112.stdout:smithi112 2024-01-19T19:35:19.395 DEBUG:teuthology.orchestra.run.smithi112:> grep smithi112 /etc/hosts 2024-01-19T19:35:19.452 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112 smithi112.front.sepia.ceph.com smithi112 2024-01-19T19:35:19.452 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112 2024-01-19T19:35:19.564 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112/smithi112/g' /etc/hosts 2024-01-19T19:35:19.592 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/172.21.15.112/172.21.15.112/g' /etc/hosts 2024-01-19T19:35:19.661 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112/smithi112/g' /etc/hostname 2024-01-19T19:35:19.729 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112 2024-01-19T19:35:19.795 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2024-01-19T19:35:19.852 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="Red Hat Enterprise Linux" 2024-01-19T19:35:19.853 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="8.6 (Ootpa)" 2024-01-19T19:35:19.853 INFO:teuthology.orchestra.run.smithi112.stdout:ID="rhel" 2024-01-19T19:35:19.853 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="fedora" 2024-01-19T19:35:19.853 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="8.6" 2024-01-19T19:35:19.853 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el8" 2024-01-19T19:35:19.853 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-19T19:35:19.853 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2024-01-19T19:35:19.853 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-19T19:35:19.853 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://www.redhat.com/" 2024-01-19T19:35:19.853 INFO:teuthology.orchestra.run.smithi112.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-19T19:35:19.853 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-19T19:35:19.853 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-01-19T19:35:19.854 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-19T19:35:19.854 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-19T19:35:19.854 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-19T19:35:19.854 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-19T19:35:19.854 INFO:teuthology.provision.fog.smithi112:Deploy complete! 2024-01-19T19:35:19.855 DEBUG:teuthology.parallel:result is None 2024-01-19T19:35:20.017 INFO:teuthology.lock.ops:Checking smithi112.front.sepia.ceph.com 2024-01-19T19:35:20.017 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-19T19:35:20.039 INFO:teuthology.lock.ops:Checking smithi132.front.sepia.ceph.com 2024-01-19T19:35:20.040 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-19T19:35:20.057 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: set os type and version on server 2024-01-19T19:35:20.058 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-01-19T19:35:20.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T19:35:20.130 DEBUG:teuthology.orchestra.run.smithi112:> true 2024-01-19T19:35:20.196 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-01-19T19:35:20.196 DEBUG:teuthology.orchestra.run.smithi112:> uname -m 2024-01-19T19:35:20.253 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2024-01-19T19:35:20.253 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2024-01-19T19:35:20.312 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="Red Hat Enterprise Linux" 2024-01-19T19:35:20.312 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="8.6 (Ootpa)" 2024-01-19T19:35:20.312 INFO:teuthology.orchestra.run.smithi112.stdout:ID="rhel" 2024-01-19T19:35:20.312 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="fedora" 2024-01-19T19:35:20.312 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="8.6" 2024-01-19T19:35:20.312 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el8" 2024-01-19T19:35:20.312 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-19T19:35:20.312 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2024-01-19T19:35:20.312 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-19T19:35:20.312 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://www.redhat.com/" 2024-01-19T19:35:20.312 INFO:teuthology.orchestra.run.smithi112.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-19T19:35:20.313 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-19T19:35:20.313 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-01-19T19:35:20.313 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-19T19:35:20.313 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-19T19:35:20.313 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-19T19:35:20.313 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-19T19:35:20.313 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2024-01-19T19:35:20.340 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: set os type and version on server 2024-01-19T19:35:20.340 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-01-19T19:35:20.341 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T19:35:20.412 DEBUG:teuthology.orchestra.run.smithi132:> true 2024-01-19T19:35:20.483 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-01-19T19:35:20.484 DEBUG:teuthology.orchestra.run.smithi132:> uname -m 2024-01-19T19:35:20.543 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64 2024-01-19T19:35:20.543 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2024-01-19T19:35:20.602 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="Red Hat Enterprise Linux" 2024-01-19T19:35:20.603 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8.6 (Ootpa)" 2024-01-19T19:35:20.603 INFO:teuthology.orchestra.run.smithi132.stdout:ID="rhel" 2024-01-19T19:35:20.603 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="fedora" 2024-01-19T19:35:20.603 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8.6" 2024-01-19T19:35:20.603 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8" 2024-01-19T19:35:20.603 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-19T19:35:20.603 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2024-01-19T19:35:20.603 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-19T19:35:20.603 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://www.redhat.com/" 2024-01-19T19:35:20.603 INFO:teuthology.orchestra.run.smithi132.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-19T19:35:20.603 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-19T19:35:20.603 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-01-19T19:35:20.604 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-19T19:35:20.604 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-19T19:35:20.604 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-19T19:35:20.604 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-19T19:35:20.604 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2024-01-19T19:35:20.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T19:35:20.715 INFO:teuthology.dispatcher.supervisor:Running job 7522235 2024-01-19T19:35:20.715 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522235 --name yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi --description fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/finisher_per_module}} -- /home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522235/orig.config.yaml 2024-01-19T19:35:20.718 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522235 2024-01-19T19:35:20.718 INFO:teuthology.dispatcher.supervisor:Job PID: 3484212 2024-01-19T19:35:20.718 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-19T19:37:20.816 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T19:39:20.990 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T19:41:21.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T19:43:21.240 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T19:45:21.413 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T19:45:21.482 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-19T19:45:21.583 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-19T19:45:21.583 INFO:teuthology.nuke:Checking targets against current locks 2024-01-19T19:45:21.632 DEBUG:teuthology.nuke:shortname: smithi112 2024-01-19T19:45:21.632 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-19T19:45:21.653 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522235', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-19 19:30:07.681737', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKi4QNXJjWnK1ocqE9l1q6/gzDIAtl4LaLNiCiVWkzNSb7q5+NGovUXrA3L5SkCkANuoNiSJNfr98LQ/GAg+WWI='} 2024-01-19T19:45:21.656 DEBUG:teuthology.nuke:shortname: smithi132 2024-01-19T19:45:21.657 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-19T19:45:21.674 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi132.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522235', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-19 19:30:07.683342', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEb2neKFiiibvcjrWjAQV1rbCizSm8cg+KNSfuXmTC19Gt8XGJms/YVg5nobhvQ0e2Bmr3x2oduTsi19+ZUnQrs='} 2024-01-19T19:45:21.694 INFO:teuthology.orchestra.console.smithi112:Power off 2024-01-19T19:45:21.694 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-19T19:45:21.719 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off 2024-01-19T19:45:21.719 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T19:45:21.731 INFO:teuthology.orchestra.console.smithi132:Power off 2024-01-19T19:45:21.732 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-19T19:45:21.739 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2024-01-19T19:45:21.753 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off 2024-01-19T19:45:21.753 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T19:45:21.774 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2024-01-19T19:45:21.841 INFO:teuthology.orchestra.console.smithi112:Power off completed 2024-01-19T19:45:21.875 INFO:teuthology.orchestra.console.smithi132:Power off completed 2024-01-19T19:45:21.997 INFO:teuthology.lock.ops:unlocked: smithi112.front.sepia.ceph.com 2024-01-19T19:45:22.013 INFO:teuthology.lock.ops:unlocked: smithi132.front.sepia.ceph.com