2023-12-16T17:22:36.935 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-16T17:22:36.936 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T17:22:37.102 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0da70e2940>, signals=[15]) 2023-12-16T17:22:37.102 INFO:teuthology.lock.ops:Start node 'smithi077.front.sepia.ceph.com' reimaging 2023-12-16T17:22:37.102 INFO:teuthology.lock.ops:Updating [smithi077.front.sepia.ceph.com]: reset os type and version on server 2023-12-16T17:22:37.102 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2023-12-16T17:22:37.128 INFO:teuthology.lock.ops:Start node 'smithi089.front.sepia.ceph.com' reimaging 2023-12-16T17:22:37.128 INFO:teuthology.lock.ops:Updating [smithi089.front.sepia.ceph.com]: reset os type and version on server 2023-12-16T17:22:37.128 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2023-12-16T17:22:37.257 DEBUG:teuthology.provision.fog.smithi077:Requesting image smithi_centos_9.stream (ID 10) 2023-12-16T17:22:37.262 DEBUG:teuthology.provision.fog.smithi089:Requesting image smithi_centos_9.stream (ID 10) 2023-12-16T17:22:37.301 INFO:teuthology.provision.fog.smithi077:Scheduling deploy of centos 9.stream 2023-12-16T17:22:37.306 INFO:teuthology.provision.fog.smithi089:Scheduling deploy of centos 9.stream 2023-12-16T17:22:37.565 INFO:teuthology.orchestra.console.smithi089:Power off 2023-12-16T17:22:37.565 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T17:22:37.583 INFO:teuthology.orchestra.console.smithi077:Power off 2023-12-16T17:22:37.583 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T17:22:37.591 DEBUG:teuthology.orchestra.console.smithi089:power off output: Chassis Power Control: Down/Off 2023-12-16T17:22:37.591 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T17:22:37.608 DEBUG:teuthology.orchestra.console.smithi077:power off output: Chassis Power Control: Down/Off 2023-12-16T17:22:37.609 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T17:22:37.617 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2023-12-16T17:22:37.637 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is on 2023-12-16T17:22:41.621 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T17:22:41.638 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T17:22:41.731 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2023-12-16T17:22:41.747 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is on 2023-12-16T17:22:45.733 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T17:22:45.748 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T17:22:45.845 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off 2023-12-16T17:22:45.861 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is on 2023-12-16T17:22:45.946 INFO:teuthology.orchestra.console.smithi089:Power off completed 2023-12-16T17:22:46.047 INFO:teuthology.orchestra.console.smithi089:Power on 2023-12-16T17:22:46.047 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-16T17:22:46.073 DEBUG:teuthology.orchestra.console.smithi089:power on output: Chassis Power Control: Up/On 2023-12-16T17:22:46.074 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T17:22:46.096 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off 2023-12-16T17:22:49.865 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T17:22:49.977 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is off 2023-12-16T17:22:50.078 INFO:teuthology.orchestra.console.smithi077:Power off completed 2023-12-16T17:22:50.096 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T17:22:50.179 INFO:teuthology.orchestra.console.smithi077:Power on 2023-12-16T17:22:50.179 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-16T17:22:50.200 DEBUG:teuthology.orchestra.console.smithi077:power on output: Chassis Power Control: Up/On 2023-12-16T17:22:50.200 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T17:22:50.209 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off 2023-12-16T17:22:50.221 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is off 2023-12-16T17:22:54.213 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T17:22:54.223 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T17:22:54.323 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2023-12-16T17:22:54.332 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is off 2023-12-16T17:22:54.424 INFO:teuthology.orchestra.console.smithi089:Power on completed 2023-12-16T17:22:54.525 INFO:teuthology.provision.fog.smithi089:Waiting for deploy to finish 2023-12-16T17:22:58.333 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T17:22:58.475 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is on 2023-12-16T17:22:58.576 INFO:teuthology.orchestra.console.smithi077:Power on completed 2023-12-16T17:22:58.676 INFO:teuthology.provision.fog.smithi077:Waiting for deploy to finish 2023-12-16T17:25:25.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T17:25:29.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T17:25:32.598 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-12-16T17:25:38.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T17:25:41.681 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-12-16T17:25:43.826 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-12-16T17:25:47.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T17:25:49.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T17:25:50.737 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-12-16T17:25:52.881 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-12-16T17:25:56.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T17:25:58.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T17:25:59.793 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-12-16T17:26:01.938 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-12-16T17:26:05.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T17:26:07.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T17:26:08.850 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-12-16T17:26:10.997 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-12-16T17:26:14.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T17:26:17.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T17:26:17.905 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-12-16T17:26:20.081 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-12-16T17:26:23.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T17:26:26.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T17:26:26.961 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-12-16T17:26:32.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T17:27:26.138 WARNING:teuthology.provision.fog.smithi089:timed out 2023-12-16T17:27:32.145 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T17:27:32.476 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-16T17:27:32.477 DEBUG:teuthology.orchestra.run.smithi089:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-16T17:27:32.785 INFO:teuthology.provision.fog.smithi089:Node is ready 2023-12-16T17:27:32.785 DEBUG:teuthology.orchestra.run.smithi089:> hostname 2023-12-16T17:27:32.800 INFO:teuthology.orchestra.run.smithi089.stdout:smithi089.front.sepia.ceph.com 2023-12-16T17:27:32.801 DEBUG:teuthology.orchestra.run.smithi089:> grep smithi089.front.sepia.ceph.com /etc/hosts 2023-12-16T17:27:32.855 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89 smithi089.front.sepia.ceph.com smithi089 2023-12-16T17:27:32.856 DEBUG:teuthology.orchestra.run.smithi089:> sudo hostname smithi089 2023-12-16T17:27:32.966 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i -e 's/smithi089.front.sepia.ceph.com/smithi089/g' /etc/hosts 2023-12-16T17:27:32.969 WARNING:teuthology.provision.fog.smithi077:timed out 2023-12-16T17:27:32.993 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i -e 's/172.21.15.89/172.21.15.89/g' /etc/hosts 2023-12-16T17:27:33.061 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i -e 's/smithi089.front.sepia.ceph.com/smithi089/g' /etc/hostname 2023-12-16T17:27:33.128 DEBUG:teuthology.orchestra.run.smithi089:> sudo hostname smithi089 2023-12-16T17:27:33.194 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2023-12-16T17:27:33.249 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="CentOS Stream" 2023-12-16T17:27:33.249 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="9" 2023-12-16T17:27:33.249 INFO:teuthology.orchestra.run.smithi089.stdout:ID="centos" 2023-12-16T17:27:33.249 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE="rhel fedora" 2023-12-16T17:27:33.249 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="9" 2023-12-16T17:27:33.249 INFO:teuthology.orchestra.run.smithi089.stdout:PLATFORM_ID="platform:el9" 2023-12-16T17:27:33.249 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-16T17:27:33.249 INFO:teuthology.orchestra.run.smithi089.stdout:ANSI_COLOR="0;31" 2023-12-16T17:27:33.250 INFO:teuthology.orchestra.run.smithi089.stdout:LOGO="fedora-logo-icon" 2023-12-16T17:27:33.250 INFO:teuthology.orchestra.run.smithi089.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-16T17:27:33.250 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://centos.org/" 2023-12-16T17:27:33.250 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-16T17:27:33.250 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-16T17:27:33.250 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-16T17:27:33.251 INFO:teuthology.provision.fog.smithi089:Deploy complete! 2023-12-16T17:27:33.252 DEBUG:teuthology.parallel:result is None 2023-12-16T17:27:38.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T17:27:39.183 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-16T17:27:39.183 DEBUG:teuthology.orchestra.run.smithi077:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-16T17:27:39.512 INFO:teuthology.provision.fog.smithi077:Node is ready 2023-12-16T17:27:39.512 DEBUG:teuthology.orchestra.run.smithi077:> hostname 2023-12-16T17:27:39.526 INFO:teuthology.orchestra.run.smithi077.stdout:smithi077.front.sepia.ceph.com 2023-12-16T17:27:39.527 DEBUG:teuthology.orchestra.run.smithi077:> grep smithi077.front.sepia.ceph.com /etc/hosts 2023-12-16T17:27:39.581 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77 smithi077.front.sepia.ceph.com smithi077 2023-12-16T17:27:39.582 DEBUG:teuthology.orchestra.run.smithi077:> sudo hostname smithi077 2023-12-16T17:27:39.682 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i -e 's/smithi077.front.sepia.ceph.com/smithi077/g' /etc/hosts 2023-12-16T17:27:39.710 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i -e 's/172.21.15.77/172.21.15.77/g' /etc/hosts 2023-12-16T17:27:39.777 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i -e 's/smithi077.front.sepia.ceph.com/smithi077/g' /etc/hostname 2023-12-16T17:27:39.844 DEBUG:teuthology.orchestra.run.smithi077:> sudo hostname smithi077 2023-12-16T17:27:39.910 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release 2023-12-16T17:27:39.965 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="CentOS Stream" 2023-12-16T17:27:39.965 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="9" 2023-12-16T17:27:39.965 INFO:teuthology.orchestra.run.smithi077.stdout:ID="centos" 2023-12-16T17:27:39.965 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE="rhel fedora" 2023-12-16T17:27:39.965 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="9" 2023-12-16T17:27:39.965 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM_ID="platform:el9" 2023-12-16T17:27:39.965 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-16T17:27:39.965 INFO:teuthology.orchestra.run.smithi077.stdout:ANSI_COLOR="0;31" 2023-12-16T17:27:39.965 INFO:teuthology.orchestra.run.smithi077.stdout:LOGO="fedora-logo-icon" 2023-12-16T17:27:39.965 INFO:teuthology.orchestra.run.smithi077.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-16T17:27:39.966 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://centos.org/" 2023-12-16T17:27:39.966 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-16T17:27:39.966 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-16T17:27:39.966 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-16T17:27:39.966 INFO:teuthology.provision.fog.smithi077:Deploy complete! 2023-12-16T17:27:39.967 DEBUG:teuthology.parallel:result is None 2023-12-16T17:27:40.165 INFO:teuthology.lock.ops:Checking smithi077.front.sepia.ceph.com 2023-12-16T17:27:40.166 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-16T17:27:40.186 INFO:teuthology.lock.ops:Checking smithi089.front.sepia.ceph.com 2023-12-16T17:27:40.186 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-16T17:27:40.204 INFO:teuthology.lock.ops:Updating [smithi077.front.sepia.ceph.com]: set os type and version on server 2023-12-16T17:27:40.204 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2023-12-16T17:27:40.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T17:27:40.286 DEBUG:teuthology.orchestra.run.smithi077:> true 2023-12-16T17:27:40.351 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi077.front.sepia.ceph.com' 2023-12-16T17:27:40.351 DEBUG:teuthology.orchestra.run.smithi077:> uname -m 2023-12-16T17:27:40.406 INFO:teuthology.orchestra.run.smithi077.stdout:x86_64 2023-12-16T17:27:40.406 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release 2023-12-16T17:27:40.459 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="CentOS Stream" 2023-12-16T17:27:40.459 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="9" 2023-12-16T17:27:40.459 INFO:teuthology.orchestra.run.smithi077.stdout:ID="centos" 2023-12-16T17:27:40.460 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE="rhel fedora" 2023-12-16T17:27:40.460 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="9" 2023-12-16T17:27:40.460 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM_ID="platform:el9" 2023-12-16T17:27:40.460 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-16T17:27:40.460 INFO:teuthology.orchestra.run.smithi077.stdout:ANSI_COLOR="0;31" 2023-12-16T17:27:40.460 INFO:teuthology.orchestra.run.smithi077.stdout:LOGO="fedora-logo-icon" 2023-12-16T17:27:40.460 INFO:teuthology.orchestra.run.smithi077.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-16T17:27:40.460 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://centos.org/" 2023-12-16T17:27:40.460 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-16T17:27:40.460 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-16T17:27:40.460 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-16T17:27:40.461 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2023-12-16T17:27:40.486 INFO:teuthology.lock.ops:Updating [smithi089.front.sepia.ceph.com]: set os type and version on server 2023-12-16T17:27:40.486 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-12-16T17:27:40.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T17:27:40.576 DEBUG:teuthology.orchestra.run.smithi089:> true 2023-12-16T17:27:40.645 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-12-16T17:27:40.645 DEBUG:teuthology.orchestra.run.smithi089:> uname -m 2023-12-16T17:27:40.704 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64 2023-12-16T17:27:40.705 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2023-12-16T17:27:40.764 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="CentOS Stream" 2023-12-16T17:27:40.765 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="9" 2023-12-16T17:27:40.765 INFO:teuthology.orchestra.run.smithi089.stdout:ID="centos" 2023-12-16T17:27:40.765 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE="rhel fedora" 2023-12-16T17:27:40.765 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="9" 2023-12-16T17:27:40.765 INFO:teuthology.orchestra.run.smithi089.stdout:PLATFORM_ID="platform:el9" 2023-12-16T17:27:40.765 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-16T17:27:40.765 INFO:teuthology.orchestra.run.smithi089.stdout:ANSI_COLOR="0;31" 2023-12-16T17:27:40.765 INFO:teuthology.orchestra.run.smithi089.stdout:LOGO="fedora-logo-icon" 2023-12-16T17:27:40.765 INFO:teuthology.orchestra.run.smithi089.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-16T17:27:40.765 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://centos.org/" 2023-12-16T17:27:40.765 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-16T17:27:40.765 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-16T17:27:40.765 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-16T17:27:40.766 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2023-12-16T17:27:40.786 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T17:27:40.883 INFO:teuthology.dispatcher.supervisor:Running job 7494461 2023-12-16T17:27:40.883 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494461 --name yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind} -- /home/teuthworker/archive/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494461/orig.config.yaml 2023-12-16T17:27:40.886 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494461 2023-12-16T17:27:40.887 INFO:teuthology.dispatcher.supervisor:Job PID: 290639 2023-12-16T17:27:40.887 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-16T17:29:40.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T17:31:41.154 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T17:33:41.330 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T17:35:41.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T17:37:41.642 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T17:39:41.814 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T17:41:41.982 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T17:43:42.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T17:45:42.306 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T17:47:42.490 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T17:49:42.658 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T17:51:42.826 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T17:53:42.990 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T17:55:43.166 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T17:57:43.334 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T17:59:43.506 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T18:01:43.674 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T18:03:43.842 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T18:05:44.006 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T18:07:44.174 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T18:09:44.341 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T18:11:44.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T18:13:44.674 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T18:15:44.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T18:17:44.994 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T18:19:45.162 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T18:21:45.322 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T18:23:45.494 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T18:25:45.666 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T18:27:45.840 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T18:29:46.018 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T18:31:46.194 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T18:33:46.318 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T18:35:46.538 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T18:37:46.706 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T18:39:46.874 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T18:41:47.046 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T18:43:47.214 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T18:45:47.462 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T18:47:47.630 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T18:49:47.794 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T18:51:47.954 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T18:53:48.126 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T18:55:48.294 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T18:57:48.458 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T18:59:48.626 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T19:01:48.790 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T19:03:48.950 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T19:05:49.128 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T19:07:49.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T19:09:49.404 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T19:11:49.574 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T19:13:49.734 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T19:15:49.890 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T19:17:50.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T19:17:50.132 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-16T19:17:50.314 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-16T19:17:50.314 INFO:teuthology.nuke:Checking targets against current locks 2023-12-16T19:17:50.365 DEBUG:teuthology.nuke:shortname: smithi077 2023-12-16T19:17:50.366 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T19:17:50.392 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi077.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494461', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 17:22:36.071764', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOo3j2r4ppAYTh6SiuD1nuGWFzKUYYk1kBV5K7d+BbCNNkJLema0dZBTjTp7YeJ62mPmGIQwL4Qt4AAGrZNu3oc='} 2023-12-16T19:17:50.395 DEBUG:teuthology.nuke:shortname: smithi089 2023-12-16T19:17:50.396 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T19:17:50.417 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494461', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 17:22:36.073237', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH5wD4fg6NwmXrOezQpUJg+HMeil+pcQvVPlH/gcK38BOLWBEu5dotlMCP/u95ec6yRY+suz3Pd/L+Ga2Xowt7E='} 2023-12-16T19:17:50.467 INFO:teuthology.orchestra.console.smithi077:Power off 2023-12-16T19:17:50.467 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T19:17:50.518 INFO:teuthology.orchestra.console.smithi089:Power off 2023-12-16T19:17:50.518 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T19:17:50.529 DEBUG:teuthology.orchestra.console.smithi077:power off output: Chassis Power Control: Down/Off 2023-12-16T19:17:50.530 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T19:17:50.559 DEBUG:teuthology.orchestra.console.smithi089:power off output: Chassis Power Control: Down/Off 2023-12-16T19:17:50.559 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T19:17:50.573 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is off 2023-12-16T19:17:50.585 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off 2023-12-16T19:17:50.674 INFO:teuthology.orchestra.console.smithi077:Power off completed 2023-12-16T19:17:50.686 INFO:teuthology.orchestra.console.smithi089:Power off completed 2023-12-16T19:17:50.830 INFO:teuthology.lock.ops:unlocked: smithi077.front.sepia.ceph.com 2023-12-16T19:17:50.838 INFO:teuthology.lock.ops:unlocked: smithi089.front.sepia.ceph.com