2023-12-22T16:46:58.129 INFO:root:teuthology version: 0.0.1.dev226+g9680d2a 2023-12-22T16:46:58.130 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T16:46:58.262 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f54a1f02940>, signals=[15]) 2023-12-22T16:46:58.262 INFO:teuthology.lock.ops:Start node 'smithi079.front.sepia.ceph.com' reimaging 2023-12-22T16:46:58.262 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: reset os type and version on server 2023-12-22T16:46:58.262 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2023-12-22T16:46:58.283 INFO:teuthology.lock.ops:Start node 'smithi194.front.sepia.ceph.com' reimaging 2023-12-22T16:46:58.283 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: reset os type and version on server 2023-12-22T16:46:58.284 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2023-12-22T16:46:58.400 DEBUG:teuthology.provision.fog.smithi079:Requesting image smithi_centos_9.stream (ID 10) 2023-12-22T16:46:58.403 DEBUG:teuthology.provision.fog.smithi194:Requesting image smithi_centos_9.stream (ID 10) 2023-12-22T16:46:58.438 INFO:teuthology.provision.fog.smithi079:Scheduling deploy of centos 9.stream 2023-12-22T16:46:58.441 INFO:teuthology.provision.fog.smithi194:Scheduling deploy of centos 9.stream 2023-12-22T16:46:58.871 INFO:teuthology.orchestra.console.smithi079:Power off 2023-12-22T16:46:58.872 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-22T16:46:58.883 INFO:teuthology.orchestra.console.smithi194:Power off 2023-12-22T16:46:58.884 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-22T16:46:58.891 DEBUG:teuthology.orchestra.console.smithi079:power off output: Chassis Power Control: Down/Off 2023-12-22T16:46:58.892 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T16:46:58.905 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off 2023-12-22T16:46:58.905 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T16:46:58.912 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2023-12-22T16:46:58.925 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2023-12-22T16:46:59.013 INFO:teuthology.orchestra.console.smithi079:Power off completed 2023-12-22T16:46:59.026 INFO:teuthology.orchestra.console.smithi194:Power off completed 2023-12-22T16:46:59.114 INFO:teuthology.orchestra.console.smithi079:Power on 2023-12-22T16:46:59.114 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-22T16:46:59.126 INFO:teuthology.orchestra.console.smithi194:Power on 2023-12-22T16:46:59.127 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-22T16:46:59.135 DEBUG:teuthology.orchestra.console.smithi079:power on output: Chassis Power Control: Up/On 2023-12-22T16:46:59.135 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T16:46:59.147 DEBUG:teuthology.orchestra.console.smithi194:power on output: Chassis Power Control: Up/On 2023-12-22T16:46:59.147 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T16:46:59.155 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2023-12-22T16:46:59.167 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2023-12-22T16:47:03.157 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T16:47:03.169 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T16:47:03.266 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2023-12-22T16:47:03.276 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2023-12-22T16:47:07.269 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T16:47:07.277 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T16:47:07.385 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2023-12-22T16:47:07.438 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2023-12-22T16:47:07.486 INFO:teuthology.orchestra.console.smithi194:Power on completed 2023-12-22T16:47:07.539 INFO:teuthology.orchestra.console.smithi079:Power on completed 2023-12-22T16:47:07.587 INFO:teuthology.provision.fog.smithi194:Waiting for deploy to finish 2023-12-22T16:47:07.639 INFO:teuthology.provision.fog.smithi079:Waiting for deploy to finish 2023-12-22T16:50:10.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T16:50:13.334 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-12-22T16:50:19.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T16:50:22.417 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-12-22T16:50:28.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T16:50:31.474 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-12-22T16:50:37.481 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T16:50:40.561 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-12-22T16:50:46.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T16:50:49.649 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-12-22T16:50:55.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T16:50:58.706 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-12-22T16:51:04.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T16:52:04.722 WARNING:teuthology.provision.fog.smithi079:timed out 2023-12-22T16:52:10.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T16:52:10.999 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-22T16:52:10.999 DEBUG:teuthology.orchestra.run.smithi079:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-22T16:52:11.316 INFO:teuthology.provision.fog.smithi079:Node is ready 2023-12-22T16:52:11.316 DEBUG:teuthology.orchestra.run.smithi079:> hostname 2023-12-22T16:52:11.331 INFO:teuthology.orchestra.run.smithi079.stdout:smithi079.front.sepia.ceph.com 2023-12-22T16:52:11.331 DEBUG:teuthology.orchestra.run.smithi079:> grep smithi079.front.sepia.ceph.com /etc/hosts 2023-12-22T16:52:11.385 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79 smithi079.front.sepia.ceph.com smithi079 2023-12-22T16:52:11.386 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079 2023-12-22T16:52:11.503 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079.front.sepia.ceph.com/smithi079/g' /etc/hosts 2023-12-22T16:52:11.530 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/172.21.15.79/172.21.15.79/g' /etc/hosts 2023-12-22T16:52:11.596 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079.front.sepia.ceph.com/smithi079/g' /etc/hostname 2023-12-22T16:52:11.663 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079 2023-12-22T16:52:11.729 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2023-12-22T16:52:11.784 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="CentOS Stream" 2023-12-22T16:52:11.784 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="9" 2023-12-22T16:52:11.784 INFO:teuthology.orchestra.run.smithi079.stdout:ID="centos" 2023-12-22T16:52:11.784 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="rhel fedora" 2023-12-22T16:52:11.784 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="9" 2023-12-22T16:52:11.784 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el9" 2023-12-22T16:52:11.784 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-22T16:52:11.784 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2023-12-22T16:52:11.784 INFO:teuthology.orchestra.run.smithi079.stdout:LOGO="fedora-logo-icon" 2023-12-22T16:52:11.784 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-22T16:52:11.784 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://centos.org/" 2023-12-22T16:52:11.784 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-22T16:52:11.784 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-22T16:52:11.784 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-22T16:52:11.785 INFO:teuthology.provision.fog.smithi079:Deploy complete! 2023-12-22T16:52:11.786 DEBUG:teuthology.parallel:result is None 2023-12-22T16:53:11.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T16:53:14.838 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-12-22T16:53:20.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T16:53:23.889 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-12-22T16:53:29.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T16:53:32.948 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-12-22T16:53:38.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T16:53:42.033 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-12-22T16:53:48.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T16:53:51.089 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-12-22T16:53:57.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T16:54:00.145 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-12-22T16:54:06.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T16:54:09.201 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-12-22T16:54:15.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T16:54:33.746 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-12-22T16:54:39.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T16:54:42.802 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-12-22T16:54:48.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T16:54:51.861 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-12-22T16:54:57.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T16:54:58.084 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-22T16:54:58.084 DEBUG:teuthology.orchestra.run.smithi194:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-22T16:55:13.579 INFO:teuthology.provision.fog.smithi194:Node is ready 2023-12-22T16:55:13.580 DEBUG:teuthology.orchestra.run.smithi194:> hostname 2023-12-22T16:55:13.598 INFO:teuthology.orchestra.run.smithi194.stdout:smithi194.front.sepia.ceph.com 2023-12-22T16:55:13.598 DEBUG:teuthology.orchestra.run.smithi194:> grep smithi194.front.sepia.ceph.com /etc/hosts 2023-12-22T16:55:13.655 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.15.194 smithi194.front.sepia.ceph.com smithi194 2023-12-22T16:55:13.655 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194 2023-12-22T16:55:13.761 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi194.front.sepia.ceph.com/smithi194/g' /etc/hosts 2023-12-22T16:55:13.789 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/172.21.15.194/172.21.15.194/g' /etc/hosts 2023-12-22T16:55:13.858 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi194.front.sepia.ceph.com/smithi194/g' /etc/hostname 2023-12-22T16:55:13.926 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194 2023-12-22T16:55:13.993 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2023-12-22T16:55:14.047 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Stream" 2023-12-22T16:55:14.047 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="9" 2023-12-22T16:55:14.047 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos" 2023-12-22T16:55:14.047 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora" 2023-12-22T16:55:14.047 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="9" 2023-12-22T16:55:14.047 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el9" 2023-12-22T16:55:14.047 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-22T16:55:14.047 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2023-12-22T16:55:14.047 INFO:teuthology.orchestra.run.smithi194.stdout:LOGO="fedora-logo-icon" 2023-12-22T16:55:14.047 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-22T16:55:14.048 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://centos.org/" 2023-12-22T16:55:14.048 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-22T16:55:14.048 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-22T16:55:14.048 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-22T16:55:14.048 INFO:teuthology.provision.fog.smithi194:Deploy complete! 2023-12-22T16:55:14.048 DEBUG:teuthology.parallel:result is None 2023-12-22T16:55:14.213 INFO:teuthology.lock.ops:Checking smithi079.front.sepia.ceph.com 2023-12-22T16:55:14.214 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-22T16:55:14.240 INFO:teuthology.lock.ops:Checking smithi194.front.sepia.ceph.com 2023-12-22T16:55:14.240 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-22T16:55:14.258 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: set os type and version on server 2023-12-22T16:55:14.258 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-12-22T16:55:14.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T16:55:14.344 DEBUG:teuthology.orchestra.run.smithi079:> true 2023-12-22T16:55:14.511 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-12-22T16:55:14.511 DEBUG:teuthology.orchestra.run.smithi079:> uname -m 2023-12-22T16:55:14.566 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2023-12-22T16:55:14.566 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2023-12-22T16:55:14.620 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="CentOS Stream" 2023-12-22T16:55:14.621 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="9" 2023-12-22T16:55:14.621 INFO:teuthology.orchestra.run.smithi079.stdout:ID="centos" 2023-12-22T16:55:14.621 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="rhel fedora" 2023-12-22T16:55:14.621 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="9" 2023-12-22T16:55:14.621 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el9" 2023-12-22T16:55:14.621 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-22T16:55:14.621 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2023-12-22T16:55:14.621 INFO:teuthology.orchestra.run.smithi079.stdout:LOGO="fedora-logo-icon" 2023-12-22T16:55:14.621 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-22T16:55:14.621 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://centos.org/" 2023-12-22T16:55:14.621 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-22T16:55:14.621 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-22T16:55:14.621 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-22T16:55:14.622 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2023-12-22T16:55:14.640 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: set os type and version on server 2023-12-22T16:55:14.640 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2023-12-22T16:55:14.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T16:55:14.721 DEBUG:teuthology.orchestra.run.smithi194:> true 2023-12-22T16:55:14.788 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2023-12-22T16:55:14.788 DEBUG:teuthology.orchestra.run.smithi194:> uname -m 2023-12-22T16:55:14.843 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64 2023-12-22T16:55:14.843 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2023-12-22T16:55:14.898 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Stream" 2023-12-22T16:55:14.898 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="9" 2023-12-22T16:55:14.898 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos" 2023-12-22T16:55:14.898 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora" 2023-12-22T16:55:14.898 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="9" 2023-12-22T16:55:14.898 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el9" 2023-12-22T16:55:14.898 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-22T16:55:14.899 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2023-12-22T16:55:14.899 INFO:teuthology.orchestra.run.smithi194.stdout:LOGO="fedora-logo-icon" 2023-12-22T16:55:14.899 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-22T16:55:14.899 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://centos.org/" 2023-12-22T16:55:14.899 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-22T16:55:14.899 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-22T16:55:14.899 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-22T16:55:14.899 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2023-12-22T16:55:14.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T16:55:14.998 INFO:teuthology.dispatcher.supervisor:Running job 7499580 2023-12-22T16:55:14.998 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_9680d2aba1e76f64ade295c81599c97907457848/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-22_16:44:37-rados-wip-yuri-testing-2023-12-19-1112-distro-default-smithi/7499580 --name yuriw-2023-12-22_16:44:37-rados-wip-yuri-testing-2023-12-19-1112-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} -- /home/teuthworker/archive/yuriw-2023-12-22_16:44:37-rados-wip-yuri-testing-2023-12-19-1112-distro-default-smithi/7499580/orig.config.yaml 2023-12-22T16:55:15.001 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-22_16:44:37-rados-wip-yuri-testing-2023-12-19-1112-distro-default-smithi/7499580 2023-12-22T16:55:15.001 INFO:teuthology.dispatcher.supervisor:Job PID: 3528741 2023-12-22T16:55:15.001 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-22T16:57:15.102 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T16:59:15.266 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T17:01:15.433 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T17:03:15.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T17:05:15.794 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T17:07:15.960 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T17:09:16.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T17:11:16.228 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T17:13:16.398 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T17:15:16.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T17:17:16.702 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T17:19:16.858 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T17:21:16.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T17:23:17.142 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T17:25:17.290 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T17:27:17.417 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T17:29:17.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T17:31:17.726 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T17:33:17.922 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T17:35:18.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T17:37:18.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T17:39:18.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T17:41:18.536 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T17:43:18.710 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T17:45:18.869 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T17:47:19.036 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T17:49:19.249 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T17:51:19.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T17:53:19.782 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T17:55:19.941 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T17:57:20.134 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T17:59:20.269 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T18:01:20.413 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T18:03:20.532 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T18:05:20.654 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T18:07:20.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T18:09:21.029 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T18:11:21.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T18:13:21.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T18:15:21.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T18:17:21.682 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T18:19:21.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T18:21:21.949 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T18:23:22.210 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T18:25:22.392 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T18:27:22.548 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T18:29:22.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T18:31:22.870 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T18:33:23.014 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T18:35:23.126 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T18:37:23.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T18:39:23.462 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T18:41:23.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T18:43:23.906 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T18:45:24.142 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T18:47:24.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T18:49:24.472 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T18:51:24.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T18:53:25.038 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T18:55:25.141 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T18:57:25.313 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T18:59:25.399 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T18:59:25.472 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-22T18:59:25.569 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-22T18:59:25.569 INFO:teuthology.nuke:Checking targets against current locks 2023-12-22T18:59:25.621 DEBUG:teuthology.nuke:shortname: smithi079 2023-12-22T18:59:25.621 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-22T18:59:25.642 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi079.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-22_16:44:37-rados-wip-yuri-testing-2023-12-19-1112-distro-default-smithi/7499580', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-22 16:46:57.353309', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEwQVDY63NDVuN5cj9dsVX5F4oYWpR1hRGjvcdZOsR4X2JksqVroOs5ow1KMKwY2GjcMrR2k6bQ0NIkD1YDcoTg='} 2023-12-22T18:59:25.645 DEBUG:teuthology.nuke:shortname: smithi194 2023-12-22T18:59:25.646 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-22T18:59:25.665 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-22_16:44:37-rados-wip-yuri-testing-2023-12-19-1112-distro-default-smithi/7499580', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-22 16:46:57.351649', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKlAKW7WNZzWnL5MhNilaT54A3l7u8VotOBZqean+GNySABdWP90AyFI8H2GwmiK1Vi93TlNfaLlHSSJaqXGnGw='} 2023-12-22T18:59:25.699 INFO:teuthology.orchestra.console.smithi079:Power off 2023-12-22T18:59:25.700 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-22T18:59:25.723 DEBUG:teuthology.orchestra.console.smithi079:power off output: Chassis Power Control: Down/Off 2023-12-22T18:59:25.723 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T18:59:25.736 INFO:teuthology.orchestra.console.smithi194:Power off 2023-12-22T18:59:25.736 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-22T18:59:25.745 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2023-12-22T18:59:25.757 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off 2023-12-22T18:59:25.757 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T18:59:25.778 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2023-12-22T18:59:25.846 INFO:teuthology.orchestra.console.smithi079:Power off completed 2023-12-22T18:59:25.879 INFO:teuthology.orchestra.console.smithi194:Power off completed 2023-12-22T18:59:25.995 INFO:teuthology.lock.ops:unlocked: smithi079.front.sepia.ceph.com 2023-12-22T18:59:26.029 INFO:teuthology.lock.ops:unlocked: smithi194.front.sepia.ceph.com