2023-11-22T08:15:28.976 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-22T08:15:28.977 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T08:15:29.126 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff26bac5670>, signals=[15]) 2023-11-22T08:15:29.127 INFO:teuthology.lock.ops:Start node 'smithi072.front.sepia.ceph.com' reimaging 2023-11-22T08:15:29.127 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: reset os type and version on server 2023-11-22T08:15:29.127 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2023-11-22T08:15:29.145 INFO:teuthology.lock.ops:Start node 'smithi076.front.sepia.ceph.com' reimaging 2023-11-22T08:15:29.145 INFO:teuthology.lock.ops:Updating [smithi076.front.sepia.ceph.com]: reset os type and version on server 2023-11-22T08:15:29.145 INFO:teuthology.lock.ops:Updating smithi076.front.sepia.ceph.com on lock server 2023-11-22T08:15:29.252 DEBUG:teuthology.provision.fog.smithi072:Requesting image smithi_centos_9.stream (ID 10) 2023-11-22T08:15:29.293 DEBUG:teuthology.provision.fog.smithi076:Requesting image smithi_centos_9.stream (ID 10) 2023-11-22T08:15:29.312 INFO:teuthology.provision.fog.smithi072:Scheduling deploy of centos 9.stream 2023-11-22T08:15:29.349 INFO:teuthology.provision.fog.smithi076:Scheduling deploy of centos 9.stream 2023-11-22T08:15:29.797 INFO:teuthology.orchestra.console.smithi072:Power off 2023-11-22T08:15:29.797 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-22T08:15:29.809 INFO:teuthology.orchestra.console.smithi076:Power off 2023-11-22T08:15:29.810 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-22T08:15:29.820 DEBUG:teuthology.orchestra.console.smithi072:power off output: Chassis Power Control: Down/Off 2023-11-22T08:15:29.820 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-22T08:15:29.831 DEBUG:teuthology.orchestra.console.smithi076:power off output: Chassis Power Control: Down/Off 2023-11-22T08:15:29.831 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-22T08:15:29.840 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-11-22T08:15:29.851 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is on 2023-11-22T08:15:33.842 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-22T08:15:33.852 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-22T08:15:33.951 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-11-22T08:15:33.960 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is on 2023-11-22T08:15:37.954 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-22T08:15:37.960 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-22T08:15:38.063 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-11-22T08:15:38.068 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is on 2023-11-22T08:15:42.066 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-22T08:15:42.072 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-22T08:15:42.175 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2023-11-22T08:15:42.180 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is off 2023-11-22T08:15:42.276 INFO:teuthology.orchestra.console.smithi072:Power off completed 2023-11-22T08:15:42.281 INFO:teuthology.orchestra.console.smithi076:Power off completed 2023-11-22T08:15:42.377 INFO:teuthology.orchestra.console.smithi072:Power on 2023-11-22T08:15:42.378 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-22T08:15:42.384 INFO:teuthology.orchestra.console.smithi076:Power on 2023-11-22T08:15:42.384 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-22T08:15:42.396 DEBUG:teuthology.orchestra.console.smithi072:power on output: Chassis Power Control: Up/On 2023-11-22T08:15:42.397 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-22T08:15:42.403 DEBUG:teuthology.orchestra.console.smithi076:power on output: Chassis Power Control: Up/On 2023-11-22T08:15:42.404 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-22T08:15:42.416 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2023-11-22T08:15:42.422 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is off 2023-11-22T08:15:46.421 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-22T08:15:46.427 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-22T08:15:46.530 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-11-22T08:15:46.535 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is on 2023-11-22T08:15:46.631 INFO:teuthology.orchestra.console.smithi072:Power on completed 2023-11-22T08:15:46.636 INFO:teuthology.orchestra.console.smithi076:Power on completed 2023-11-22T08:15:46.732 INFO:teuthology.provision.fog.smithi072:Waiting for deploy to finish 2023-11-22T08:15:46.736 INFO:teuthology.provision.fog.smithi076:Waiting for deploy to finish 2023-11-22T08:19:21.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-22T08:19:24.162 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-11-22T08:19:30.169 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-22T08:19:33.250 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-11-22T08:19:39.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-22T08:19:42.306 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-11-22T08:19:48.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-22T08:19:51.398 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-11-22T08:19:51.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-22T08:19:54.562 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2023-11-22T08:19:57.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-22T08:20:00.482 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-11-22T08:20:00.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-22T08:20:03.618 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2023-11-22T08:20:06.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-22T08:20:09.538 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-11-22T08:20:09.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-22T08:20:12.674 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2023-11-22T08:20:15.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-22T08:20:18.594 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-11-22T08:20:18.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-22T08:20:21.730 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2023-11-22T08:20:24.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-22T08:20:27.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-22T08:20:30.786 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2023-11-22T08:20:36.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-22T08:20:39.874 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2023-11-22T08:20:45.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-22T08:20:48.962 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2023-11-22T08:20:54.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-22T08:20:58.050 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2023-11-22T08:21:04.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-22T08:21:24.618 WARNING:teuthology.provision.fog.smithi072:timed out 2023-11-22T08:21:30.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-22T08:21:30.927 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-22T08:21:30.928 DEBUG:teuthology.orchestra.run.smithi072:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-22T08:21:31.288 INFO:teuthology.provision.fog.smithi072:Node is ready 2023-11-22T08:21:31.288 DEBUG:teuthology.orchestra.run.smithi072:> hostname 2023-11-22T08:21:31.302 INFO:teuthology.orchestra.run.smithi072.stdout:smithi072.front.sepia.ceph.com 2023-11-22T08:21:31.302 DEBUG:teuthology.orchestra.run.smithi072:> grep smithi072.front.sepia.ceph.com /etc/hosts 2023-11-22T08:21:31.357 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72 smithi072.front.sepia.ceph.com smithi072 2023-11-22T08:21:31.357 DEBUG:teuthology.orchestra.run.smithi072:> sudo hostname smithi072 2023-11-22T08:21:31.470 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/smithi072.front.sepia.ceph.com/smithi072/g' /etc/hosts 2023-11-22T08:21:31.497 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/172.21.15.72/172.21.15.72/g' /etc/hosts 2023-11-22T08:21:31.564 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/smithi072.front.sepia.ceph.com/smithi072/g' /etc/hostname 2023-11-22T08:21:31.631 DEBUG:teuthology.orchestra.run.smithi072:> sudo hostname smithi072 2023-11-22T08:21:31.696 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2023-11-22T08:21:31.751 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="CentOS Stream" 2023-11-22T08:21:31.751 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="9" 2023-11-22T08:21:31.751 INFO:teuthology.orchestra.run.smithi072.stdout:ID="centos" 2023-11-22T08:21:31.751 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="rhel fedora" 2023-11-22T08:21:31.751 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="9" 2023-11-22T08:21:31.751 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el9" 2023-11-22T08:21:31.751 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-22T08:21:31.751 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31" 2023-11-22T08:21:31.751 INFO:teuthology.orchestra.run.smithi072.stdout:LOGO="fedora-logo-icon" 2023-11-22T08:21:31.751 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-22T08:21:31.752 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://centos.org/" 2023-11-22T08:21:31.752 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-22T08:21:31.752 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-22T08:21:31.752 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-22T08:21:31.752 INFO:teuthology.provision.fog.smithi072:Deploy complete! 2023-11-22T08:21:31.753 DEBUG:teuthology.parallel:result is None 2023-11-22T08:22:04.089 WARNING:teuthology.provision.fog.smithi076:timed out 2023-11-22T08:22:10.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-22T08:22:10.344 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-22T08:22:10.345 DEBUG:teuthology.orchestra.run.smithi076:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-22T08:22:10.674 INFO:teuthology.provision.fog.smithi076:Node is ready 2023-11-22T08:22:10.674 DEBUG:teuthology.orchestra.run.smithi076:> hostname 2023-11-22T08:22:10.689 INFO:teuthology.orchestra.run.smithi076.stdout:smithi076.front.sepia.ceph.com 2023-11-22T08:22:10.689 DEBUG:teuthology.orchestra.run.smithi076:> grep smithi076.front.sepia.ceph.com /etc/hosts 2023-11-22T08:22:10.744 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76 smithi076.front.sepia.ceph.com smithi076 2023-11-22T08:22:10.744 DEBUG:teuthology.orchestra.run.smithi076:> sudo hostname smithi076 2023-11-22T08:22:10.846 DEBUG:teuthology.orchestra.run.smithi076:> sudo sed -i -e 's/smithi076.front.sepia.ceph.com/smithi076/g' /etc/hosts 2023-11-22T08:22:10.875 DEBUG:teuthology.orchestra.run.smithi076:> sudo sed -i -e 's/172.21.15.76/172.21.15.76/g' /etc/hosts 2023-11-22T08:22:10.943 DEBUG:teuthology.orchestra.run.smithi076:> sudo sed -i -e 's/smithi076.front.sepia.ceph.com/smithi076/g' /etc/hostname 2023-11-22T08:22:11.010 DEBUG:teuthology.orchestra.run.smithi076:> sudo hostname smithi076 2023-11-22T08:22:11.078 DEBUG:teuthology.orchestra.run.smithi076:> cat /etc/os-release 2023-11-22T08:22:11.133 INFO:teuthology.orchestra.run.smithi076.stdout:NAME="CentOS Stream" 2023-11-22T08:22:11.133 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION="9" 2023-11-22T08:22:11.133 INFO:teuthology.orchestra.run.smithi076.stdout:ID="centos" 2023-11-22T08:22:11.134 INFO:teuthology.orchestra.run.smithi076.stdout:ID_LIKE="rhel fedora" 2023-11-22T08:22:11.134 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION_ID="9" 2023-11-22T08:22:11.134 INFO:teuthology.orchestra.run.smithi076.stdout:PLATFORM_ID="platform:el9" 2023-11-22T08:22:11.134 INFO:teuthology.orchestra.run.smithi076.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-22T08:22:11.134 INFO:teuthology.orchestra.run.smithi076.stdout:ANSI_COLOR="0;31" 2023-11-22T08:22:11.134 INFO:teuthology.orchestra.run.smithi076.stdout:LOGO="fedora-logo-icon" 2023-11-22T08:22:11.134 INFO:teuthology.orchestra.run.smithi076.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-22T08:22:11.135 INFO:teuthology.orchestra.run.smithi076.stdout:HOME_URL="https://centos.org/" 2023-11-22T08:22:11.135 INFO:teuthology.orchestra.run.smithi076.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-22T08:22:11.135 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-22T08:22:11.135 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-22T08:22:11.135 INFO:teuthology.provision.fog.smithi076:Deploy complete! 2023-11-22T08:22:11.136 DEBUG:teuthology.parallel:result is None 2023-11-22T08:22:11.308 INFO:teuthology.lock.ops:Checking smithi072.front.sepia.ceph.com 2023-11-22T08:22:11.309 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-22T08:22:11.338 INFO:teuthology.lock.ops:Checking smithi076.front.sepia.ceph.com 2023-11-22T08:22:11.338 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-22T08:22:11.356 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: set os type and version on server 2023-11-22T08:22:11.356 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-11-22T08:22:11.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-22T08:22:11.437 DEBUG:teuthology.orchestra.run.smithi072:> true 2023-11-22T08:22:11.600 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-11-22T08:22:11.600 DEBUG:teuthology.orchestra.run.smithi072:> uname -m 2023-11-22T08:22:11.654 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64 2023-11-22T08:22:11.654 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2023-11-22T08:22:11.709 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="CentOS Stream" 2023-11-22T08:22:11.709 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="9" 2023-11-22T08:22:11.709 INFO:teuthology.orchestra.run.smithi072.stdout:ID="centos" 2023-11-22T08:22:11.710 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="rhel fedora" 2023-11-22T08:22:11.710 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="9" 2023-11-22T08:22:11.710 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el9" 2023-11-22T08:22:11.710 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-22T08:22:11.710 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31" 2023-11-22T08:22:11.710 INFO:teuthology.orchestra.run.smithi072.stdout:LOGO="fedora-logo-icon" 2023-11-22T08:22:11.710 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-22T08:22:11.710 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://centos.org/" 2023-11-22T08:22:11.710 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-22T08:22:11.710 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-22T08:22:11.711 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-22T08:22:11.711 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2023-11-22T08:22:11.730 INFO:teuthology.lock.ops:Updating [smithi076.front.sepia.ceph.com]: set os type and version on server 2023-11-22T08:22:11.730 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi076.front.sepia.ceph.com' 2023-11-22T08:22:11.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-22T08:22:11.812 DEBUG:teuthology.orchestra.run.smithi076:> true 2023-11-22T08:22:11.876 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi076.front.sepia.ceph.com' 2023-11-22T08:22:11.876 DEBUG:teuthology.orchestra.run.smithi076:> uname -m 2023-11-22T08:22:11.930 INFO:teuthology.orchestra.run.smithi076.stdout:x86_64 2023-11-22T08:22:11.931 DEBUG:teuthology.orchestra.run.smithi076:> cat /etc/os-release 2023-11-22T08:22:11.985 INFO:teuthology.orchestra.run.smithi076.stdout:NAME="CentOS Stream" 2023-11-22T08:22:11.985 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION="9" 2023-11-22T08:22:11.985 INFO:teuthology.orchestra.run.smithi076.stdout:ID="centos" 2023-11-22T08:22:11.985 INFO:teuthology.orchestra.run.smithi076.stdout:ID_LIKE="rhel fedora" 2023-11-22T08:22:11.985 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION_ID="9" 2023-11-22T08:22:11.985 INFO:teuthology.orchestra.run.smithi076.stdout:PLATFORM_ID="platform:el9" 2023-11-22T08:22:11.985 INFO:teuthology.orchestra.run.smithi076.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-22T08:22:11.985 INFO:teuthology.orchestra.run.smithi076.stdout:ANSI_COLOR="0;31" 2023-11-22T08:22:11.985 INFO:teuthology.orchestra.run.smithi076.stdout:LOGO="fedora-logo-icon" 2023-11-22T08:22:11.986 INFO:teuthology.orchestra.run.smithi076.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-22T08:22:11.986 INFO:teuthology.orchestra.run.smithi076.stdout:HOME_URL="https://centos.org/" 2023-11-22T08:22:11.986 INFO:teuthology.orchestra.run.smithi076.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-22T08:22:11.986 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-22T08:22:11.986 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-22T08:22:11.986 INFO:teuthology.lock.ops:Updating smithi076.front.sepia.ceph.com on lock server 2023-11-22T08:22:12.004 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T08:22:12.098 INFO:teuthology.dispatcher.supervisor:Running job 7464321 2023-11-22T08:22:12.098 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/bin/teuthology -v --owner scheduled_matan@teuthology --archive /home/teuthworker/archive/matan-2023-11-22_08:14:32-rados:verify-main-distro-default-smithi/7464321 --name matan-2023-11-22_08:14:32-rados:verify-main-distro-default-smithi --description rados:verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados tasks/mon_recovery validater/valgrind} -- /home/teuthworker/archive/matan-2023-11-22_08:14:32-rados:verify-main-distro-default-smithi/7464321/orig.config.yaml 2023-11-22T08:22:12.101 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/matan-2023-11-22_08:14:32-rados:verify-main-distro-default-smithi/7464321 2023-11-22T08:22:12.102 INFO:teuthology.dispatcher.supervisor:Job PID: 3340576 2023-11-22T08:22:12.102 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-22T08:24:12.202 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T08:26:12.378 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T08:28:12.550 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T08:30:12.738 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T08:32:12.916 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T08:34:13.103 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T08:36:13.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T08:38:13.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T08:40:13.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T08:42:13.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T08:44:13.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T08:46:14.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T08:48:14.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T08:50:14.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T08:52:14.536 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T08:54:14.704 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T08:56:14.868 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T08:58:15.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T09:00:15.177 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T09:02:15.358 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T09:04:15.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T09:06:15.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T09:08:15.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T09:10:16.037 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T09:12:16.206 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T09:14:16.360 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T09:16:16.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T09:18:16.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T09:20:16.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T09:22:17.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T09:24:17.192 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T09:26:17.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T09:28:17.512 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T09:30:17.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T09:32:17.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T09:34:18.025 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T09:36:18.186 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T09:38:18.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T09:40:18.490 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T09:42:18.670 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T09:44:18.820 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T09:46:18.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T09:48:19.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T09:50:19.232 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T09:52:19.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T09:54:19.506 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T09:56:19.680 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T09:58:19.844 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T10:00:20.018 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T10:02:20.184 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T10:04:20.357 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T10:06:20.521 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T10:08:20.710 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T10:10:20.873 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T10:12:21.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T10:14:21.194 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T10:16:21.358 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T10:18:21.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T10:20:21.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T10:22:21.844 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T10:24:21.932 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T10:26:22.046 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T10:28:22.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T10:30:22.386 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T10:32:22.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T10:34:22.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T10:36:22.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T10:38:23.034 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T10:40:23.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T10:42:23.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T10:44:23.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T10:46:23.658 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T10:48:23.797 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-22T10:48:23.873 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-11-22T10:48:24.023 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-22T10:48:24.024 INFO:teuthology.nuke:Checking targets against current locks 2023-11-22T10:48:24.068 DEBUG:teuthology.nuke:shortname: smithi072 2023-11-22T10:48:24.068 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-22T10:48:24.085 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-11-22_08:14:32-rados:verify-main-distro-default-smithi/7464321', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-22 08:15:28.196405', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLGLAd00jU84oghszdSF0U3qdVV3TAeD0t//sTsH/gd2sC8i8dBshjjyBPyquSHNXHUALg1+8qUCRu1AczlveRY='} 2023-11-22T10:48:24.091 DEBUG:teuthology.nuke:shortname: smithi076 2023-11-22T10:48:24.091 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-22T10:48:24.114 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi076.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-11-22_08:14:32-rados:verify-main-distro-default-smithi/7464321', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-22 08:15:28.193261', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHu/MSGQt9bm9SYAR+myxgdK8Z0zBe0ooy2ZO7D5riB3XJVnsD+3biCsUjCDqd7/fdsMaG4n/+7aCHwBitDjvwA='} 2023-11-22T10:48:24.126 INFO:teuthology.orchestra.console.smithi072:Power off 2023-11-22T10:48:24.126 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-22T10:48:24.146 DEBUG:teuthology.orchestra.console.smithi072:power off output: Chassis Power Control: Down/Off 2023-11-22T10:48:24.146 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-22T10:48:24.161 INFO:teuthology.orchestra.console.smithi076:Power off 2023-11-22T10:48:24.161 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-22T10:48:24.168 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2023-11-22T10:48:24.179 DEBUG:teuthology.orchestra.console.smithi076:power off output: Chassis Power Control: Down/Off 2023-11-22T10:48:24.179 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-22T10:48:24.204 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is off 2023-11-22T10:48:24.269 INFO:teuthology.orchestra.console.smithi072:Power off completed 2023-11-22T10:48:24.304 INFO:teuthology.orchestra.console.smithi076:Power off completed 2023-11-22T10:48:24.422 INFO:teuthology.lock.ops:unlocked: smithi072.front.sepia.ceph.com 2023-11-22T10:48:24.447 INFO:teuthology.lock.ops:unlocked: smithi076.front.sepia.ceph.com