2023-11-27T23:59:24.831 INFO:root:teuthology version: 0.0.1.dev209+g5ae09a5 2023-11-27T23:59:24.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-27T23:59:24.980 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6c8d5afdc0>, signals=[15]) 2023-11-27T23:59:24.980 INFO:teuthology.lock.ops:Start node 'smithi052.front.sepia.ceph.com' reimaging 2023-11-27T23:59:24.981 INFO:teuthology.lock.ops:Updating [smithi052.front.sepia.ceph.com]: reset os type and version on server 2023-11-27T23:59:24.981 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server 2023-11-27T23:59:25.007 INFO:teuthology.lock.ops:Start node 'smithi115.front.sepia.ceph.com' reimaging 2023-11-27T23:59:25.007 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: reset os type and version on server 2023-11-27T23:59:25.007 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2023-11-27T23:59:25.126 DEBUG:teuthology.provision.fog.smithi052:Requesting image smithi_centos_9.stream (ID 10) 2023-11-27T23:59:25.203 DEBUG:teuthology.provision.fog.smithi115:Requesting image smithi_centos_9.stream (ID 10) 2023-11-27T23:59:25.252 INFO:teuthology.provision.fog.smithi052:Scheduling deploy of centos 9.stream 2023-11-27T23:59:25.260 INFO:teuthology.provision.fog.smithi115:Scheduling deploy of centos 9.stream 2023-11-27T23:59:25.490 INFO:teuthology.orchestra.console.smithi052:Power off 2023-11-27T23:59:25.490 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-27T23:59:25.505 INFO:teuthology.orchestra.console.smithi115:Power off 2023-11-27T23:59:25.505 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-27T23:59:25.514 DEBUG:teuthology.orchestra.console.smithi052:power off output: Chassis Power Control: Down/Off 2023-11-27T23:59:25.514 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T23:59:25.528 DEBUG:teuthology.orchestra.console.smithi115:power off output: Chassis Power Control: Down/Off 2023-11-27T23:59:25.528 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T23:59:25.537 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on 2023-11-27T23:59:25.550 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2023-11-27T23:59:25.651 INFO:teuthology.orchestra.console.smithi115:Power off completed 2023-11-27T23:59:25.751 INFO:teuthology.orchestra.console.smithi115:Power on 2023-11-27T23:59:25.751 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-27T23:59:25.775 DEBUG:teuthology.orchestra.console.smithi115:power on output: Chassis Power Control: Up/On 2023-11-27T23:59:25.775 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T23:59:25.798 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2023-11-27T23:59:29.542 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T23:59:29.651 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on 2023-11-27T23:59:29.798 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T23:59:29.907 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2023-11-27T23:59:33.654 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T23:59:33.762 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off 2023-11-27T23:59:33.865 INFO:teuthology.orchestra.console.smithi052:Power off completed 2023-11-27T23:59:33.908 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T23:59:33.966 INFO:teuthology.orchestra.console.smithi052:Power on 2023-11-27T23:59:33.967 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-27T23:59:33.990 DEBUG:teuthology.orchestra.console.smithi052:power on output: Chassis Power Control: Up/On 2023-11-27T23:59:33.990 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T23:59:34.012 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off 2023-11-27T23:59:34.016 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on 2023-11-27T23:59:34.116 INFO:teuthology.orchestra.console.smithi115:Power on completed 2023-11-27T23:59:34.217 INFO:teuthology.provision.fog.smithi115:Waiting for deploy to finish 2023-11-27T23:59:38.017 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T23:59:38.125 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off 2023-11-27T23:59:42.130 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T23:59:42.238 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on 2023-11-27T23:59:42.339 INFO:teuthology.orchestra.console.smithi052:Power on completed 2023-11-27T23:59:42.440 INFO:teuthology.provision.fog.smithi052:Waiting for deploy to finish 2023-11-28T00:01:58.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T00:02:01.158 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-11-28T00:02:07.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T00:02:10.242 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-11-28T00:02:16.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T00:02:19.298 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-11-28T00:02:20.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T00:02:23.074 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-11-28T00:02:25.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T00:02:28.354 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-11-28T00:02:29.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T00:02:32.130 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-11-28T00:02:34.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T00:02:37.414 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-11-28T00:02:38.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T00:02:41.186 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-11-28T00:02:43.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T00:02:46.498 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-11-28T00:02:47.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T00:02:50.242 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-11-28T00:02:52.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T00:02:56.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T00:02:59.298 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-11-28T00:03:05.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T00:03:09.542 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-11-28T00:03:15.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T00:03:52.539 WARNING:teuthology.provision.fog.smithi052:timed out 2023-11-28T00:03:58.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T00:03:58.796 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-28T00:03:58.797 DEBUG:teuthology.orchestra.run.smithi052:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-28T00:03:59.110 INFO:teuthology.provision.fog.smithi052:Node is ready 2023-11-28T00:03:59.111 DEBUG:teuthology.orchestra.run.smithi052:> hostname 2023-11-28T00:03:59.126 INFO:teuthology.orchestra.run.smithi052.stdout:smithi052.front.sepia.ceph.com 2023-11-28T00:03:59.126 DEBUG:teuthology.orchestra.run.smithi052:> grep smithi052.front.sepia.ceph.com /etc/hosts 2023-11-28T00:03:59.181 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52 smithi052.front.sepia.ceph.com smithi052 2023-11-28T00:03:59.182 DEBUG:teuthology.orchestra.run.smithi052:> sudo hostname smithi052 2023-11-28T00:03:59.276 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/smithi052.front.sepia.ceph.com/smithi052/g' /etc/hosts 2023-11-28T00:03:59.308 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/172.21.15.52/172.21.15.52/g' /etc/hosts 2023-11-28T00:03:59.379 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/smithi052.front.sepia.ceph.com/smithi052/g' /etc/hostname 2023-11-28T00:03:59.450 DEBUG:teuthology.orchestra.run.smithi052:> sudo hostname smithi052 2023-11-28T00:03:59.520 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release 2023-11-28T00:03:59.575 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="CentOS Stream" 2023-11-28T00:03:59.575 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="9" 2023-11-28T00:03:59.575 INFO:teuthology.orchestra.run.smithi052.stdout:ID="centos" 2023-11-28T00:03:59.575 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="rhel fedora" 2023-11-28T00:03:59.575 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="9" 2023-11-28T00:03:59.575 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el9" 2023-11-28T00:03:59.575 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-28T00:03:59.575 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31" 2023-11-28T00:03:59.575 INFO:teuthology.orchestra.run.smithi052.stdout:LOGO="fedora-logo-icon" 2023-11-28T00:03:59.576 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-28T00:03:59.576 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://centos.org/" 2023-11-28T00:03:59.576 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T00:03:59.576 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-28T00:03:59.576 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-28T00:03:59.577 INFO:teuthology.provision.fog.smithi052:Deploy complete! 2023-11-28T00:03:59.578 DEBUG:teuthology.parallel:result is None 2023-11-28T00:04:15.562 WARNING:teuthology.provision.fog.smithi115:timed out 2023-11-28T00:04:21.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T00:04:21.802 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-28T00:04:21.803 DEBUG:teuthology.orchestra.run.smithi115:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-28T00:04:22.119 INFO:teuthology.provision.fog.smithi115:Node is ready 2023-11-28T00:04:22.119 DEBUG:teuthology.orchestra.run.smithi115:> hostname 2023-11-28T00:04:22.134 INFO:teuthology.orchestra.run.smithi115.stdout:smithi115.front.sepia.ceph.com 2023-11-28T00:04:22.134 DEBUG:teuthology.orchestra.run.smithi115:> grep smithi115.front.sepia.ceph.com /etc/hosts 2023-11-28T00:04:22.189 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115 smithi115.front.sepia.ceph.com smithi115 2023-11-28T00:04:22.189 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115 2023-11-28T00:04:22.306 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi115.front.sepia.ceph.com/smithi115/g' /etc/hosts 2023-11-28T00:04:22.333 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/172.21.15.115/172.21.15.115/g' /etc/hosts 2023-11-28T00:04:22.402 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi115.front.sepia.ceph.com/smithi115/g' /etc/hostname 2023-11-28T00:04:22.469 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115 2023-11-28T00:04:22.537 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2023-11-28T00:04:22.594 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream" 2023-11-28T00:04:22.594 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="9" 2023-11-28T00:04:22.594 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos" 2023-11-28T00:04:22.594 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora" 2023-11-28T00:04:22.595 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="9" 2023-11-28T00:04:22.595 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el9" 2023-11-28T00:04:22.595 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-28T00:04:22.595 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2023-11-28T00:04:22.595 INFO:teuthology.orchestra.run.smithi115.stdout:LOGO="fedora-logo-icon" 2023-11-28T00:04:22.595 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-28T00:04:22.595 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/" 2023-11-28T00:04:22.595 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T00:04:22.595 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-28T00:04:22.595 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-28T00:04:22.595 INFO:teuthology.provision.fog.smithi115:Deploy complete! 2023-11-28T00:04:22.596 DEBUG:teuthology.parallel:result is None 2023-11-28T00:04:22.785 INFO:teuthology.lock.ops:Checking smithi052.front.sepia.ceph.com 2023-11-28T00:04:22.785 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-28T00:04:22.807 INFO:teuthology.lock.ops:Checking smithi115.front.sepia.ceph.com 2023-11-28T00:04:22.807 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-28T00:04:22.833 INFO:teuthology.lock.ops:Updating [smithi052.front.sepia.ceph.com]: set os type and version on server 2023-11-28T00:04:22.833 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2023-11-28T00:04:22.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T00:04:22.932 DEBUG:teuthology.orchestra.run.smithi052:> true 2023-11-28T00:04:23.123 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com' 2023-11-28T00:04:23.124 DEBUG:teuthology.orchestra.run.smithi052:> uname -m 2023-11-28T00:04:23.180 INFO:teuthology.orchestra.run.smithi052.stdout:x86_64 2023-11-28T00:04:23.180 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release 2023-11-28T00:04:23.236 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="CentOS Stream" 2023-11-28T00:04:23.236 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="9" 2023-11-28T00:04:23.237 INFO:teuthology.orchestra.run.smithi052.stdout:ID="centos" 2023-11-28T00:04:23.237 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="rhel fedora" 2023-11-28T00:04:23.237 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="9" 2023-11-28T00:04:23.237 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el9" 2023-11-28T00:04:23.237 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-28T00:04:23.237 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31" 2023-11-28T00:04:23.237 INFO:teuthology.orchestra.run.smithi052.stdout:LOGO="fedora-logo-icon" 2023-11-28T00:04:23.237 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-28T00:04:23.238 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://centos.org/" 2023-11-28T00:04:23.238 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T00:04:23.238 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-28T00:04:23.238 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-28T00:04:23.239 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server 2023-11-28T00:04:23.265 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: set os type and version on server 2023-11-28T00:04:23.265 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-11-28T00:04:23.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T00:04:23.348 DEBUG:teuthology.orchestra.run.smithi115:> true 2023-11-28T00:04:23.416 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-11-28T00:04:23.416 DEBUG:teuthology.orchestra.run.smithi115:> uname -m 2023-11-28T00:04:23.471 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64 2023-11-28T00:04:23.471 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2023-11-28T00:04:23.525 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream" 2023-11-28T00:04:23.525 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="9" 2023-11-28T00:04:23.525 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos" 2023-11-28T00:04:23.525 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora" 2023-11-28T00:04:23.525 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="9" 2023-11-28T00:04:23.525 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el9" 2023-11-28T00:04:23.525 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-28T00:04:23.525 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2023-11-28T00:04:23.525 INFO:teuthology.orchestra.run.smithi115.stdout:LOGO="fedora-logo-icon" 2023-11-28T00:04:23.526 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-28T00:04:23.526 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/" 2023-11-28T00:04:23.526 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T00:04:23.526 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-28T00:04:23.526 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-28T00:04:23.526 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2023-11-28T00:04:23.548 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T00:04:23.716 INFO:teuthology.dispatcher.supervisor:Running job 7469278 2023-11-28T00:04:23.716 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/virtualenv/bin/teuthology -v --owner scheduled_aemerson@teuthology --archive /home/teuthworker/archive/aemerson-2023-11-27_23:48:55-rbd-main-distro-default-smithi/7469278 --name aemerson-2023-11-27_23:48:55-rbd-main-distro-default-smithi --description rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_latest} workloads/rbd-mirror-journal-stress-workunit} -- /home/teuthworker/archive/aemerson-2023-11-27_23:48:55-rbd-main-distro-default-smithi/7469278/orig.config.yaml 2023-11-28T00:04:23.720 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/aemerson-2023-11-27_23:48:55-rbd-main-distro-default-smithi/7469278 2023-11-28T00:04:23.720 INFO:teuthology.dispatcher.supervisor:Job PID: 582434 2023-11-28T00:04:23.720 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-28T00:06:23.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T00:08:23.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T00:10:24.154 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T00:12:24.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T00:14:28.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T00:16:28.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T00:18:28.990 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T00:20:29.152 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T00:22:29.323 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T00:22:29.388 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-11-28T00:22:29.500 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-28T00:22:29.500 INFO:teuthology.nuke:Checking targets against current locks 2023-11-28T00:22:29.547 DEBUG:teuthology.nuke:shortname: smithi052 2023-11-28T00:22:29.547 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T00:22:29.564 DEBUG:teuthology.nuke:shortname: smithi115 2023-11-28T00:22:29.564 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T00:22:29.574 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi052.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/aemerson-2023-11-27_23:48:55-rbd-main-distro-default-smithi/7469278', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-27 23:59:23.960885', 'locked_by': 'scheduled_aemerson@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBPzZG7tf7s9KdGST8wsCfP6tv6NImcl257ZLm1HwJwSw4HLWgYJIL3fzw5hIWd5ORIkrf62FWPhaJGe6U6Cw8g='} 2023-11-28T00:22:29.583 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi115.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/aemerson-2023-11-27_23:48:55-rbd-main-distro-default-smithi/7469278', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-27 23:59:23.962353', 'locked_by': 'scheduled_aemerson@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDAtdjoQGxqY1ZTBTi5GWVlIcuG+F8oDXOlkJVSKYnFeBP4hYptSpgHbWs68XSAzm0IKWknKGSHqcu/in1GBzWg='} 2023-11-28T00:22:29.619 INFO:teuthology.orchestra.console.smithi052:Power off 2023-11-28T00:22:29.620 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T00:22:29.632 INFO:teuthology.orchestra.console.smithi115:Power off 2023-11-28T00:22:29.632 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T00:22:29.642 DEBUG:teuthology.orchestra.console.smithi052:power off output: Chassis Power Control: Down/Off 2023-11-28T00:22:29.643 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T00:22:29.653 DEBUG:teuthology.orchestra.console.smithi115:power off output: Chassis Power Control: Down/Off 2023-11-28T00:22:29.653 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T00:22:29.664 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off 2023-11-28T00:22:29.679 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2023-11-28T00:22:29.766 INFO:teuthology.orchestra.console.smithi052:Power off completed 2023-11-28T00:22:29.780 INFO:teuthology.orchestra.console.smithi115:Power off completed 2023-11-28T00:22:29.920 INFO:teuthology.lock.ops:unlocked: smithi052.front.sepia.ceph.com 2023-11-28T00:22:29.928 INFO:teuthology.lock.ops:unlocked: smithi115.front.sepia.ceph.com