2023-11-27T23:56:03.196 INFO:root:teuthology version: 0.0.1.dev209+g5ae09a5 2023-11-27T23:56:03.196 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-27T23:56:03.332 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fee05b58dc0>, signals=[15]) 2023-11-27T23:56:03.332 INFO:teuthology.lock.ops:Start node 'smithi118.front.sepia.ceph.com' reimaging 2023-11-27T23:56:03.332 INFO:teuthology.lock.ops:Updating [smithi118.front.sepia.ceph.com]: reset os type and version on server 2023-11-27T23:56:03.332 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2023-11-27T23:56:03.360 INFO:teuthology.lock.ops:Start node 'smithi174.front.sepia.ceph.com' reimaging 2023-11-27T23:56:03.360 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: reset os type and version on server 2023-11-27T23:56:03.361 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2023-11-27T23:56:03.492 DEBUG:teuthology.provision.fog.smithi118:Requesting image smithi_centos_9.stream (ID 10) 2023-11-27T23:56:03.498 DEBUG:teuthology.provision.fog.smithi174:Requesting image smithi_centos_9.stream (ID 10) 2023-11-27T23:56:03.545 INFO:teuthology.provision.fog.smithi118:Scheduling deploy of centos 9.stream 2023-11-27T23:56:03.548 INFO:teuthology.provision.fog.smithi174:Scheduling deploy of centos 9.stream 2023-11-27T23:56:03.786 INFO:teuthology.orchestra.console.smithi174:Power off 2023-11-27T23:56:03.786 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-27T23:56:03.800 INFO:teuthology.orchestra.console.smithi118:Power off 2023-11-27T23:56:03.801 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-27T23:56:03.810 DEBUG:teuthology.orchestra.console.smithi174:power off output: Chassis Power Control: Down/Off 2023-11-27T23:56:03.810 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T23:56:03.822 DEBUG:teuthology.orchestra.console.smithi118:power off output: Chassis Power Control: Down/Off 2023-11-27T23:56:03.822 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T23:56:03.832 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2023-11-27T23:56:03.849 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on 2023-11-27T23:56:07.834 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T23:56:07.850 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T23:56:07.944 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2023-11-27T23:56:07.961 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on 2023-11-27T23:56:11.949 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T23:56:11.962 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T23:56:12.058 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2023-11-27T23:56:12.071 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off 2023-11-27T23:56:12.171 INFO:teuthology.orchestra.console.smithi118:Power off completed 2023-11-27T23:56:12.272 INFO:teuthology.orchestra.console.smithi118:Power on 2023-11-27T23:56:12.272 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-27T23:56:12.293 DEBUG:teuthology.orchestra.console.smithi118:power on output: Chassis Power Control: Up/On 2023-11-27T23:56:12.295 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T23:56:12.315 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off 2023-11-27T23:56:16.062 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T23:56:16.170 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-11-27T23:56:16.271 INFO:teuthology.orchestra.console.smithi174:Power off completed 2023-11-27T23:56:16.315 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T23:56:16.372 INFO:teuthology.orchestra.console.smithi174:Power on 2023-11-27T23:56:16.372 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-27T23:56:16.393 DEBUG:teuthology.orchestra.console.smithi174:power on output: Chassis Power Control: Up/On 2023-11-27T23:56:16.394 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T23:56:16.414 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-11-27T23:56:16.425 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off 2023-11-27T23:56:20.418 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T23:56:20.426 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T23:56:20.528 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2023-11-27T23:56:20.535 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on 2023-11-27T23:56:20.630 INFO:teuthology.orchestra.console.smithi174:Power on completed 2023-11-27T23:56:20.636 INFO:teuthology.orchestra.console.smithi118:Power on completed 2023-11-27T23:56:20.731 INFO:teuthology.provision.fog.smithi174:Waiting for deploy to finish 2023-11-27T23:56:20.737 INFO:teuthology.provision.fog.smithi118:Waiting for deploy to finish 2023-11-27T23:58:51.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T23:58:54.626 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-11-27T23:59:00.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T23:59:03.682 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-11-27T23:59:09.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T23:59:12.739 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-11-27T23:59:18.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T23:59:21.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T23:59:21.794 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-11-27T23:59:24.770 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-11-27T23:59:27.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T23:59:30.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T23:59:30.850 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-11-27T23:59:33.826 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-11-27T23:59:36.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T23:59:39.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T23:59:39.906 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-11-27T23:59:42.886 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-11-27T23:59:45.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T23:59:48.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T23:59:48.962 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-11-27T23:59:51.970 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-11-27T23:59:54.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T23:59:57.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T00:00:01.026 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-11-28T00:00:07.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T00:00:10.082 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-11-28T00:00:13.410 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-11-28T00:00:16.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T00:00:19.138 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-11-28T00:00:19.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T00:00:22.466 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-11-28T00:00:25.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T00:00:28.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T00:00:31.526 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-11-28T00:00:37.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T00:00:37.919 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-28T00:00:37.920 DEBUG:teuthology.orchestra.run.smithi174:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-28T00:00:43.618 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-11-28T00:00:49.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T00:00:52.674 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-11-28T00:00:53.367 INFO:teuthology.provision.fog.smithi174:Node is ready 2023-11-28T00:00:53.368 DEBUG:teuthology.orchestra.run.smithi174:> hostname 2023-11-28T00:00:53.385 INFO:teuthology.orchestra.run.smithi174.stdout:smithi046 2023-11-28T00:00:53.386 DEBUG:teuthology.orchestra.run.smithi174:> grep smithi046 /etc/hosts 2023-11-28T00:00:53.443 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2023-11-28T00:00:53.443 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname smithi174 2023-11-28T00:00:53.584 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi046/smithi174/g' /etc/hosts 2023-11-28T00:00:53.617 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/172.21.15.46/172.21.15.174/g' /etc/hosts 2023-11-28T00:00:53.687 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi046/smithi174/g' /etc/hostname 2023-11-28T00:00:53.757 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname smithi174 2023-11-28T00:00:53.835 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2023-11-28T00:00:53.889 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="CentOS Stream" 2023-11-28T00:00:53.890 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="9" 2023-11-28T00:00:53.890 INFO:teuthology.orchestra.run.smithi174.stdout:ID="centos" 2023-11-28T00:00:53.890 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="rhel fedora" 2023-11-28T00:00:53.890 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="9" 2023-11-28T00:00:53.890 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el9" 2023-11-28T00:00:53.890 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-28T00:00:53.890 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31" 2023-11-28T00:00:53.890 INFO:teuthology.orchestra.run.smithi174.stdout:LOGO="fedora-logo-icon" 2023-11-28T00:00:53.890 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-28T00:00:53.890 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://centos.org/" 2023-11-28T00:00:53.890 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T00:00:53.891 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-28T00:00:53.891 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-28T00:00:53.891 INFO:teuthology.provision.fog.smithi174:Deploy complete! 2023-11-28T00:00:53.892 DEBUG:teuthology.parallel:result is None 2023-11-28T00:00:59.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T00:01:02.435 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-11-28T00:01:08.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T00:01:08.662 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-28T00:01:08.663 DEBUG:teuthology.orchestra.run.smithi118:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-28T00:01:24.070 INFO:teuthology.provision.fog.smithi118:Node is ready 2023-11-28T00:01:24.070 DEBUG:teuthology.orchestra.run.smithi118:> hostname 2023-11-28T00:01:24.088 INFO:teuthology.orchestra.run.smithi118.stdout:smithi046 2023-11-28T00:01:24.089 DEBUG:teuthology.orchestra.run.smithi118:> grep smithi046 /etc/hosts 2023-11-28T00:01:24.145 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2023-11-28T00:01:24.145 DEBUG:teuthology.orchestra.run.smithi118:> sudo hostname smithi118 2023-11-28T00:01:24.295 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/smithi046/smithi118/g' /etc/hosts 2023-11-28T00:01:24.326 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/172.21.15.46/172.21.15.118/g' /etc/hosts 2023-11-28T00:01:24.396 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/smithi046/smithi118/g' /etc/hostname 2023-11-28T00:01:24.465 DEBUG:teuthology.orchestra.run.smithi118:> sudo hostname smithi118 2023-11-28T00:01:24.533 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2023-11-28T00:01:24.587 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="CentOS Stream" 2023-11-28T00:01:24.587 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="9" 2023-11-28T00:01:24.588 INFO:teuthology.orchestra.run.smithi118.stdout:ID="centos" 2023-11-28T00:01:24.588 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="rhel fedora" 2023-11-28T00:01:24.588 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="9" 2023-11-28T00:01:24.588 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el9" 2023-11-28T00:01:24.588 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-28T00:01:24.588 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31" 2023-11-28T00:01:24.588 INFO:teuthology.orchestra.run.smithi118.stdout:LOGO="fedora-logo-icon" 2023-11-28T00:01:24.588 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-28T00:01:24.588 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://centos.org/" 2023-11-28T00:01:24.588 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T00:01:24.588 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-28T00:01:24.589 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-28T00:01:24.589 INFO:teuthology.provision.fog.smithi118:Deploy complete! 2023-11-28T00:01:24.589 DEBUG:teuthology.parallel:result is None 2023-11-28T00:01:24.784 INFO:teuthology.lock.ops:Checking smithi118.front.sepia.ceph.com 2023-11-28T00:01:24.785 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-28T00:01:24.805 INFO:teuthology.lock.ops:Checking smithi174.front.sepia.ceph.com 2023-11-28T00:01:24.805 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-28T00:01:24.822 INFO:teuthology.lock.ops:Updating [smithi118.front.sepia.ceph.com]: set os type and version on server 2023-11-28T00:01:24.823 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-11-28T00:01:24.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T00:01:24.905 DEBUG:teuthology.orchestra.run.smithi118:> true 2023-11-28T00:01:24.976 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-11-28T00:01:24.976 DEBUG:teuthology.orchestra.run.smithi118:> uname -m 2023-11-28T00:01:25.031 INFO:teuthology.orchestra.run.smithi118.stdout:x86_64 2023-11-28T00:01:25.031 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2023-11-28T00:01:25.086 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="CentOS Stream" 2023-11-28T00:01:25.086 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="9" 2023-11-28T00:01:25.086 INFO:teuthology.orchestra.run.smithi118.stdout:ID="centos" 2023-11-28T00:01:25.086 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="rhel fedora" 2023-11-28T00:01:25.086 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="9" 2023-11-28T00:01:25.086 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el9" 2023-11-28T00:01:25.086 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-28T00:01:25.087 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31" 2023-11-28T00:01:25.087 INFO:teuthology.orchestra.run.smithi118.stdout:LOGO="fedora-logo-icon" 2023-11-28T00:01:25.087 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-28T00:01:25.087 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://centos.org/" 2023-11-28T00:01:25.087 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T00:01:25.087 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-28T00:01:25.087 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-28T00:01:25.087 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2023-11-28T00:01:25.105 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: set os type and version on server 2023-11-28T00:01:25.105 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-11-28T00:01:25.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T00:01:25.189 DEBUG:teuthology.orchestra.run.smithi174:> true 2023-11-28T00:01:25.364 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-11-28T00:01:25.364 DEBUG:teuthology.orchestra.run.smithi174:> uname -m 2023-11-28T00:01:25.418 INFO:teuthology.orchestra.run.smithi174.stdout:x86_64 2023-11-28T00:01:25.419 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2023-11-28T00:01:25.472 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="CentOS Stream" 2023-11-28T00:01:25.472 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="9" 2023-11-28T00:01:25.472 INFO:teuthology.orchestra.run.smithi174.stdout:ID="centos" 2023-11-28T00:01:25.472 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="rhel fedora" 2023-11-28T00:01:25.472 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="9" 2023-11-28T00:01:25.473 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el9" 2023-11-28T00:01:25.473 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-28T00:01:25.473 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31" 2023-11-28T00:01:25.473 INFO:teuthology.orchestra.run.smithi174.stdout:LOGO="fedora-logo-icon" 2023-11-28T00:01:25.473 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-28T00:01:25.473 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://centos.org/" 2023-11-28T00:01:25.473 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T00:01:25.474 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-28T00:01:25.474 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-28T00:01:25.474 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2023-11-28T00:01:25.496 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T00:01:25.721 INFO:teuthology.dispatcher.supervisor:Running job 7469275 2023-11-28T00:01:25.722 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/virtualenv/bin/teuthology -v --owner scheduled_aemerson@teuthology --archive /home/teuthworker/archive/aemerson-2023-11-27_23:48:55-rbd-main-distro-default-smithi/7469275 --name aemerson-2023-11-27_23:48:55-rbd-main-distro-default-smithi --description rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} -- /home/teuthworker/archive/aemerson-2023-11-27_23:48:55-rbd-main-distro-default-smithi/7469275/orig.config.yaml 2023-11-28T00:01:25.724 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/aemerson-2023-11-27_23:48:55-rbd-main-distro-default-smithi/7469275 2023-11-28T00:01:25.724 INFO:teuthology.dispatcher.supervisor:Job PID: 556338 2023-11-28T00:01:25.725 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-28T00:03:25.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T00:05:25.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T00:07:28.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T00:09:29.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T00:11:29.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T00:13:29.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T00:15:29.646 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T00:17:29.816 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T00:19:29.989 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T00:19:30.048 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-11-28T00:19:30.157 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-28T00:19:30.157 INFO:teuthology.nuke:Checking targets against current locks 2023-11-28T00:19:30.198 DEBUG:teuthology.nuke:shortname: smithi118 2023-11-28T00:19:30.198 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T00:19:30.221 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/aemerson-2023-11-27_23:48:55-rbd-main-distro-default-smithi/7469275', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-27 23:56:02.376515', 'locked_by': 'scheduled_aemerson@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO2OlPHsVYednxK+Ph7fxaptknwQD3GlFbhPPv2e5yV9/FihdfuGLO8hq9BfGLCcXf3LYDfmhjQWAY836EXJd8Q='} 2023-11-28T00:19:30.224 DEBUG:teuthology.nuke:shortname: smithi174 2023-11-28T00:19:30.225 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T00:19:30.248 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi174.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/aemerson-2023-11-27_23:48:55-rbd-main-distro-default-smithi/7469275', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-27 23:56:02.374858', 'locked_by': 'scheduled_aemerson@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJeK82nYwyUjLIzxijTlehTu4ILIyGCKkbuc5okTwaUjlnofPEqUo9xrTZ3/VlbVGILViq6qbmxvDnayPBYSZvk='} 2023-11-28T00:19:30.273 INFO:teuthology.orchestra.console.smithi118:Power off 2023-11-28T00:19:30.274 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T00:19:30.294 DEBUG:teuthology.orchestra.console.smithi118:power off output: Chassis Power Control: Down/Off 2023-11-28T00:19:30.294 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T00:19:30.306 INFO:teuthology.orchestra.console.smithi174:Power off 2023-11-28T00:19:30.307 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T00:19:30.314 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off 2023-11-28T00:19:30.327 DEBUG:teuthology.orchestra.console.smithi174:power off output: Chassis Power Control: Down/Off 2023-11-28T00:19:30.327 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T00:19:30.348 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-11-28T00:19:30.416 INFO:teuthology.orchestra.console.smithi118:Power off completed 2023-11-28T00:19:30.448 INFO:teuthology.orchestra.console.smithi174:Power off completed 2023-11-28T00:19:30.573 INFO:teuthology.lock.ops:unlocked: smithi118.front.sepia.ceph.com 2023-11-28T00:19:30.597 INFO:teuthology.lock.ops:unlocked: smithi174.front.sepia.ceph.com