2023-12-06T01:26:20.355 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-06T01:26:20.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-06T01:26:20.500 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f21c0e19550>, signals=[15]) 2023-12-06T01:26:20.500 INFO:teuthology.lock.ops:Start node 'smithi001.front.sepia.ceph.com' reimaging 2023-12-06T01:26:20.501 INFO:teuthology.lock.ops:Updating [smithi001.front.sepia.ceph.com]: reset os type and version on server 2023-12-06T01:26:20.501 INFO:teuthology.lock.ops:Updating smithi001.front.sepia.ceph.com on lock server 2023-12-06T01:26:20.525 INFO:teuthology.lock.ops:Start node 'smithi112.front.sepia.ceph.com' reimaging 2023-12-06T01:26:20.525 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: reset os type and version on server 2023-12-06T01:26:20.525 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2023-12-06T01:26:20.643 DEBUG:teuthology.provision.fog.smithi001:Requesting image smithi_centos_9.stream (ID 10) 2023-12-06T01:26:20.660 DEBUG:teuthology.provision.fog.smithi112:Requesting image smithi_centos_9.stream (ID 10) 2023-12-06T01:26:20.686 INFO:teuthology.provision.fog.smithi001:Scheduling deploy of centos 9.stream 2023-12-06T01:26:20.701 INFO:teuthology.provision.fog.smithi112:Scheduling deploy of centos 9.stream 2023-12-06T01:26:21.019 INFO:teuthology.orchestra.console.smithi001:Power off 2023-12-06T01:26:21.019 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-06T01:26:21.042 INFO:teuthology.orchestra.console.smithi112:Power off 2023-12-06T01:26:21.042 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-06T01:26:21.052 DEBUG:teuthology.orchestra.console.smithi001:power off output: Chassis Power Control: Down/Off 2023-12-06T01:26:21.052 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T01:26:21.069 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off 2023-12-06T01:26:21.070 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T01:26:21.080 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is off 2023-12-06T01:26:21.094 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2023-12-06T01:26:21.181 INFO:teuthology.orchestra.console.smithi001:Power off completed 2023-12-06T01:26:21.282 INFO:teuthology.orchestra.console.smithi001:Power on 2023-12-06T01:26:21.282 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-06T01:26:21.308 DEBUG:teuthology.orchestra.console.smithi001:power on output: Chassis Power Control: Up/On 2023-12-06T01:26:21.308 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T01:26:21.330 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is off 2023-12-06T01:26:25.098 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T01:26:25.208 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2023-12-06T01:26:25.331 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T01:26:25.442 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is on 2023-12-06T01:26:25.543 INFO:teuthology.orchestra.console.smithi001:Power on completed 2023-12-06T01:26:25.644 INFO:teuthology.provision.fog.smithi001:Waiting for deploy to finish 2023-12-06T01:26:29.210 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T01:26:29.324 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2023-12-06T01:26:29.424 INFO:teuthology.orchestra.console.smithi112:Power off completed 2023-12-06T01:26:29.525 INFO:teuthology.orchestra.console.smithi112:Power on 2023-12-06T01:26:29.525 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-06T01:26:29.548 DEBUG:teuthology.orchestra.console.smithi112:power on output: Chassis Power Control: Up/On 2023-12-06T01:26:29.549 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T01:26:29.570 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2023-12-06T01:26:33.574 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T01:26:33.683 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2023-12-06T01:26:37.686 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T01:26:37.803 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2023-12-06T01:26:37.904 INFO:teuthology.orchestra.console.smithi112:Power on completed 2023-12-06T01:26:38.005 INFO:teuthology.provision.fog.smithi112:Waiting for deploy to finish 2023-12-06T01:28:56.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T01:28:59.586 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1 2023-12-06T01:29:05.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T01:29:08.646 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1 2023-12-06T01:29:08.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T01:29:12.038 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-12-06T01:29:14.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T01:29:17.730 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1 2023-12-06T01:29:18.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T01:29:21.090 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-12-06T01:29:23.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T01:29:26.786 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1 2023-12-06T01:29:27.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T01:29:30.146 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-12-06T01:29:32.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T01:29:35.842 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1 2023-12-06T01:29:36.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T01:29:39.202 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-12-06T01:29:41.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T01:29:44.902 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1 2023-12-06T01:29:45.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T01:29:48.258 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-12-06T01:29:50.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T01:29:54.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T01:29:57.318 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-12-06T01:30:03.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T01:30:50.955 WARNING:teuthology.provision.fog.smithi001:timed out 2023-12-06T01:30:56.961 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T01:30:57.195 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-06T01:30:57.196 DEBUG:teuthology.orchestra.run.smithi001:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-06T01:30:57.533 INFO:teuthology.provision.fog.smithi001:Node is ready 2023-12-06T01:30:57.533 DEBUG:teuthology.orchestra.run.smithi001:> hostname 2023-12-06T01:30:57.549 INFO:teuthology.orchestra.run.smithi001.stdout:smithi001.front.sepia.ceph.com 2023-12-06T01:30:57.549 DEBUG:teuthology.orchestra.run.smithi001:> grep smithi001.front.sepia.ceph.com /etc/hosts 2023-12-06T01:30:57.605 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1 smithi001.front.sepia.ceph.com smithi001 2023-12-06T01:30:57.606 DEBUG:teuthology.orchestra.run.smithi001:> sudo hostname smithi001 2023-12-06T01:30:57.704 DEBUG:teuthology.orchestra.run.smithi001:> sudo sed -i -e 's/smithi001.front.sepia.ceph.com/smithi001/g' /etc/hosts 2023-12-06T01:30:57.737 DEBUG:teuthology.orchestra.run.smithi001:> sudo sed -i -e 's/172.21.15.1/172.21.15.1/g' /etc/hosts 2023-12-06T01:30:57.808 DEBUG:teuthology.orchestra.run.smithi001:> sudo sed -i -e 's/smithi001.front.sepia.ceph.com/smithi001/g' /etc/hostname 2023-12-06T01:30:57.878 DEBUG:teuthology.orchestra.run.smithi001:> sudo hostname smithi001 2023-12-06T01:30:57.948 DEBUG:teuthology.orchestra.run.smithi001:> cat /etc/os-release 2023-12-06T01:30:58.003 INFO:teuthology.orchestra.run.smithi001.stdout:NAME="CentOS Stream" 2023-12-06T01:30:58.003 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION="9" 2023-12-06T01:30:58.003 INFO:teuthology.orchestra.run.smithi001.stdout:ID="centos" 2023-12-06T01:30:58.003 INFO:teuthology.orchestra.run.smithi001.stdout:ID_LIKE="rhel fedora" 2023-12-06T01:30:58.003 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION_ID="9" 2023-12-06T01:30:58.003 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM_ID="platform:el9" 2023-12-06T01:30:58.003 INFO:teuthology.orchestra.run.smithi001.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-06T01:30:58.003 INFO:teuthology.orchestra.run.smithi001.stdout:ANSI_COLOR="0;31" 2023-12-06T01:30:58.003 INFO:teuthology.orchestra.run.smithi001.stdout:LOGO="fedora-logo-icon" 2023-12-06T01:30:58.004 INFO:teuthology.orchestra.run.smithi001.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-06T01:30:58.004 INFO:teuthology.orchestra.run.smithi001.stdout:HOME_URL="https://centos.org/" 2023-12-06T01:30:58.004 INFO:teuthology.orchestra.run.smithi001.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-06T01:30:58.004 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-06T01:30:58.004 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-06T01:30:58.005 INFO:teuthology.provision.fog.smithi001:Deploy complete! 2023-12-06T01:30:58.006 DEBUG:teuthology.parallel:result is None 2023-12-06T01:31:03.326 WARNING:teuthology.provision.fog.smithi112:timed out 2023-12-06T01:31:09.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T01:31:09.635 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-06T01:31:09.635 DEBUG:teuthology.orchestra.run.smithi112:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-06T01:31:09.951 INFO:teuthology.provision.fog.smithi112:Node is ready 2023-12-06T01:31:09.952 DEBUG:teuthology.orchestra.run.smithi112:> hostname 2023-12-06T01:31:09.965 INFO:teuthology.orchestra.run.smithi112.stdout:smithi112.front.sepia.ceph.com 2023-12-06T01:31:09.966 DEBUG:teuthology.orchestra.run.smithi112:> grep smithi112.front.sepia.ceph.com /etc/hosts 2023-12-06T01:31:10.021 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112 smithi112.front.sepia.ceph.com smithi112 2023-12-06T01:31:10.021 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112 2023-12-06T01:31:10.129 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hosts 2023-12-06T01:31:10.156 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/172.21.15.112/172.21.15.112/g' /etc/hosts 2023-12-06T01:31:10.223 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hostname 2023-12-06T01:31:10.290 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112 2023-12-06T01:31:10.356 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2023-12-06T01:31:10.410 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream" 2023-12-06T01:31:10.410 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="9" 2023-12-06T01:31:10.410 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos" 2023-12-06T01:31:10.410 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora" 2023-12-06T01:31:10.411 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="9" 2023-12-06T01:31:10.411 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el9" 2023-12-06T01:31:10.411 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-06T01:31:10.411 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2023-12-06T01:31:10.411 INFO:teuthology.orchestra.run.smithi112.stdout:LOGO="fedora-logo-icon" 2023-12-06T01:31:10.411 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-06T01:31:10.411 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/" 2023-12-06T01:31:10.411 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-06T01:31:10.411 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-06T01:31:10.411 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-06T01:31:10.411 INFO:teuthology.provision.fog.smithi112:Deploy complete! 2023-12-06T01:31:10.412 DEBUG:teuthology.parallel:result is None 2023-12-06T01:31:10.579 INFO:teuthology.lock.ops:Checking smithi001.front.sepia.ceph.com 2023-12-06T01:31:10.579 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-06T01:31:10.610 INFO:teuthology.lock.ops:Checking smithi112.front.sepia.ceph.com 2023-12-06T01:31:10.610 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-06T01:31:10.637 INFO:teuthology.lock.ops:Updating [smithi001.front.sepia.ceph.com]: set os type and version on server 2023-12-06T01:31:10.637 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2023-12-06T01:31:10.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T01:31:10.736 DEBUG:teuthology.orchestra.run.smithi001:> true 2023-12-06T01:31:10.920 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi001.front.sepia.ceph.com' 2023-12-06T01:31:10.920 DEBUG:teuthology.orchestra.run.smithi001:> uname -m 2023-12-06T01:31:10.975 INFO:teuthology.orchestra.run.smithi001.stdout:x86_64 2023-12-06T01:31:10.975 DEBUG:teuthology.orchestra.run.smithi001:> cat /etc/os-release 2023-12-06T01:31:11.032 INFO:teuthology.orchestra.run.smithi001.stdout:NAME="CentOS Stream" 2023-12-06T01:31:11.032 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION="9" 2023-12-06T01:31:11.033 INFO:teuthology.orchestra.run.smithi001.stdout:ID="centos" 2023-12-06T01:31:11.033 INFO:teuthology.orchestra.run.smithi001.stdout:ID_LIKE="rhel fedora" 2023-12-06T01:31:11.033 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION_ID="9" 2023-12-06T01:31:11.033 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM_ID="platform:el9" 2023-12-06T01:31:11.033 INFO:teuthology.orchestra.run.smithi001.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-06T01:31:11.033 INFO:teuthology.orchestra.run.smithi001.stdout:ANSI_COLOR="0;31" 2023-12-06T01:31:11.033 INFO:teuthology.orchestra.run.smithi001.stdout:LOGO="fedora-logo-icon" 2023-12-06T01:31:11.033 INFO:teuthology.orchestra.run.smithi001.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-06T01:31:11.033 INFO:teuthology.orchestra.run.smithi001.stdout:HOME_URL="https://centos.org/" 2023-12-06T01:31:11.033 INFO:teuthology.orchestra.run.smithi001.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-06T01:31:11.033 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-06T01:31:11.033 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-06T01:31:11.034 INFO:teuthology.lock.ops:Updating smithi001.front.sepia.ceph.com on lock server 2023-12-06T01:31:11.061 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: set os type and version on server 2023-12-06T01:31:11.061 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2023-12-06T01:31:11.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T01:31:11.143 DEBUG:teuthology.orchestra.run.smithi112:> true 2023-12-06T01:31:11.213 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2023-12-06T01:31:11.213 DEBUG:teuthology.orchestra.run.smithi112:> uname -m 2023-12-06T01:31:11.268 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2023-12-06T01:31:11.268 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2023-12-06T01:31:11.323 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream" 2023-12-06T01:31:11.323 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="9" 2023-12-06T01:31:11.323 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos" 2023-12-06T01:31:11.323 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora" 2023-12-06T01:31:11.323 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="9" 2023-12-06T01:31:11.323 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el9" 2023-12-06T01:31:11.323 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-06T01:31:11.323 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2023-12-06T01:31:11.323 INFO:teuthology.orchestra.run.smithi112.stdout:LOGO="fedora-logo-icon" 2023-12-06T01:31:11.323 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-06T01:31:11.323 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/" 2023-12-06T01:31:11.324 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-06T01:31:11.324 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-06T01:31:11.324 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-06T01:31:11.324 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2023-12-06T01:31:11.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-06T01:31:11.456 INFO:teuthology.dispatcher.supervisor:Running job 7479224 2023-12-06T01:31:11.456 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/bin/teuthology -v --owner scheduled_rraja@teuthology --archive /home/teuthworker/archive/rraja-2023-12-06_01:23:15-rbd:mirror-main-distro-default-smithi/7479224 --name rraja-2023-12-06_01:23:15-rbd:mirror-main-distro-default-smithi --description rbd:mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_latest} workloads/rbd-mirror-snapshot-workunit-compare-mirror-images-nbd} -- /home/teuthworker/archive/rraja-2023-12-06_01:23:15-rbd:mirror-main-distro-default-smithi/7479224/orig.config.yaml 2023-12-06T01:31:11.460 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rraja-2023-12-06_01:23:15-rbd:mirror-main-distro-default-smithi/7479224 2023-12-06T01:31:11.460 INFO:teuthology.dispatcher.supervisor:Job PID: 1139096 2023-12-06T01:31:11.460 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-06T01:33:11.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-06T01:35:11.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-06T01:37:11.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-06T01:39:12.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-06T01:41:12.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-06T01:43:12.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-06T01:45:12.578 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-06T01:47:12.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-06T01:49:12.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-06T01:51:13.078 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-06T01:53:13.243 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-06T01:55:13.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-06T01:57:13.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-06T01:59:13.764 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-06T02:01:13.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-06T02:03:14.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-06T02:05:14.293 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-06T02:07:14.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-06T02:09:14.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-06T02:09:14.727 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-06T02:09:14.904 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-06T02:09:14.905 INFO:teuthology.nuke:Checking targets against current locks 2023-12-06T02:09:14.954 DEBUG:teuthology.nuke:shortname: smithi001 2023-12-06T02:09:14.955 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-06T02:09:14.974 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi001.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rraja-2023-12-06_01:23:15-rbd:mirror-main-distro-default-smithi/7479224', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-06 01:26:19.521592', 'locked_by': 'scheduled_rraja@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOcanW0t0FClrRQWMuo4r+VV4RG0cH1QxXC+7aNAeKiHhUr0VnKbCZKHhNegaYbx9TZvmjVUkDVbvsMj8BnNl0o='} 2023-12-06T02:09:14.977 DEBUG:teuthology.nuke:shortname: smithi112 2023-12-06T02:09:14.977 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-06T02:09:15.001 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rraja-2023-12-06_01:23:15-rbd:mirror-main-distro-default-smithi/7479224', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-06 01:26:19.523176', 'locked_by': 'scheduled_rraja@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMmx81Wa84dKzxLmB7HC7imcd6jShi5+nEFB5ITDk/Kadj0yToa0CQz4MN+rijWDSRVnfvwd/T7F6KSW1k/Qbfs='} 2023-12-06T02:09:15.024 INFO:teuthology.orchestra.console.smithi001:Power off 2023-12-06T02:09:15.025 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-06T02:09:15.049 DEBUG:teuthology.orchestra.console.smithi001:power off output: Chassis Power Control: Down/Off 2023-12-06T02:09:15.049 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T02:09:15.064 INFO:teuthology.orchestra.console.smithi112:Power off 2023-12-06T02:09:15.065 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-06T02:09:15.074 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is off 2023-12-06T02:09:15.088 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off 2023-12-06T02:09:15.088 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T02:09:15.110 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2023-12-06T02:09:15.175 INFO:teuthology.orchestra.console.smithi001:Power off completed 2023-12-06T02:09:15.211 INFO:teuthology.orchestra.console.smithi112:Power off completed 2023-12-06T02:09:15.325 INFO:teuthology.lock.ops:unlocked: smithi001.front.sepia.ceph.com 2023-12-06T02:09:15.359 INFO:teuthology.lock.ops:unlocked: smithi112.front.sepia.ceph.com