2023-12-12T16:20:50.349 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-12T16:20:50.349 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T16:20:50.475 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3ec95dd940>, signals=[15]) 2023-12-12T16:20:50.475 INFO:teuthology.lock.ops:Start node 'smithi116.front.sepia.ceph.com' reimaging 2023-12-12T16:20:50.476 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: reset os type and version on server 2023-12-12T16:20:50.476 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2023-12-12T16:20:50.496 INFO:teuthology.lock.ops:Start node 'smithi142.front.sepia.ceph.com' reimaging 2023-12-12T16:20:50.496 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: reset os type and version on server 2023-12-12T16:20:50.496 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2023-12-12T16:20:50.613 DEBUG:teuthology.provision.fog.smithi116:Requesting image smithi_centos_9.stream (ID 10) 2023-12-12T16:20:50.644 DEBUG:teuthology.provision.fog.smithi142:Requesting image smithi_centos_9.stream (ID 10) 2023-12-12T16:20:50.669 INFO:teuthology.provision.fog.smithi116:Scheduling deploy of centos 9.stream 2023-12-12T16:20:50.695 INFO:teuthology.provision.fog.smithi142:Scheduling deploy of centos 9.stream 2023-12-12T16:20:51.432 INFO:teuthology.orchestra.console.smithi142:Power off 2023-12-12T16:20:51.433 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-12T16:20:51.445 INFO:teuthology.orchestra.console.smithi116:Power off 2023-12-12T16:20:51.445 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-12T16:20:51.454 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off 2023-12-12T16:20:51.455 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T16:20:51.466 DEBUG:teuthology.orchestra.console.smithi116:power off output: Chassis Power Control: Down/Off 2023-12-12T16:20:51.466 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T16:20:51.479 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2023-12-12T16:20:51.487 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2023-12-12T16:20:51.588 INFO:teuthology.orchestra.console.smithi116:Power off completed 2023-12-12T16:20:51.689 INFO:teuthology.orchestra.console.smithi116:Power on 2023-12-12T16:20:51.689 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-12T16:20:51.710 DEBUG:teuthology.orchestra.console.smithi116:power on output: Chassis Power Control: Up/On 2023-12-12T16:20:51.711 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T16:20:51.730 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2023-12-12T16:20:55.484 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T16:20:55.592 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2023-12-12T16:20:55.732 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T16:20:55.841 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on 2023-12-12T16:20:55.941 INFO:teuthology.orchestra.console.smithi116:Power on completed 2023-12-12T16:20:56.042 INFO:teuthology.provision.fog.smithi116:Waiting for deploy to finish 2023-12-12T16:20:59.594 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T16:20:59.703 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2023-12-12T16:20:59.803 INFO:teuthology.orchestra.console.smithi142:Power off completed 2023-12-12T16:20:59.904 INFO:teuthology.orchestra.console.smithi142:Power on 2023-12-12T16:20:59.904 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-12T16:20:59.923 DEBUG:teuthology.orchestra.console.smithi142:power on output: Chassis Power Control: Up/On 2023-12-12T16:20:59.924 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T16:20:59.943 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2023-12-12T16:21:03.948 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T16:21:04.056 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2023-12-12T16:21:08.059 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T16:21:08.167 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2023-12-12T16:21:08.268 INFO:teuthology.orchestra.console.smithi142:Power on completed 2023-12-12T16:21:08.368 INFO:teuthology.provision.fog.smithi142:Waiting for deploy to finish 2023-12-12T16:24:11.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T16:24:29.539 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-12-12T16:24:35.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T16:24:38.594 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-12-12T16:24:44.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T16:24:47.682 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-12-12T16:24:52.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T16:24:53.685 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T16:24:55.842 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-12-12T16:24:56.738 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-12-12T16:25:01.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T16:25:02.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T16:25:04.902 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-12-12T16:25:05.794 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-12-12T16:25:10.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T16:25:11.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T16:25:13.986 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-12-12T16:25:14.850 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-12-12T16:25:19.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T16:25:20.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T16:25:23.074 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-12-12T16:25:29.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T16:25:32.130 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-12-12T16:25:38.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T16:25:41.218 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-12-12T16:25:47.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T16:26:20.886 WARNING:teuthology.provision.fog.smithi116:timed out 2023-12-12T16:26:26.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T16:26:27.151 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-12T16:26:27.152 DEBUG:teuthology.orchestra.run.smithi116:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-12T16:26:27.455 INFO:teuthology.provision.fog.smithi116:Node is ready 2023-12-12T16:26:27.455 DEBUG:teuthology.orchestra.run.smithi116:> hostname 2023-12-12T16:26:27.468 INFO:teuthology.orchestra.run.smithi116.stdout:smithi116.front.sepia.ceph.com 2023-12-12T16:26:27.468 DEBUG:teuthology.orchestra.run.smithi116:> grep smithi116.front.sepia.ceph.com /etc/hosts 2023-12-12T16:26:27.525 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.15.116 smithi116.front.sepia.ceph.com smithi116 2023-12-12T16:26:27.525 DEBUG:teuthology.orchestra.run.smithi116:> sudo hostname smithi116 2023-12-12T16:26:27.632 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/smithi116.front.sepia.ceph.com/smithi116/g' /etc/hosts 2023-12-12T16:26:27.659 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/172.21.15.116/172.21.15.116/g' /etc/hosts 2023-12-12T16:26:27.728 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/smithi116.front.sepia.ceph.com/smithi116/g' /etc/hostname 2023-12-12T16:26:27.798 DEBUG:teuthology.orchestra.run.smithi116:> sudo hostname smithi116 2023-12-12T16:26:27.866 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2023-12-12T16:26:27.923 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="CentOS Stream" 2023-12-12T16:26:27.923 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="9" 2023-12-12T16:26:27.923 INFO:teuthology.orchestra.run.smithi116.stdout:ID="centos" 2023-12-12T16:26:27.923 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="rhel fedora" 2023-12-12T16:26:27.923 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="9" 2023-12-12T16:26:27.923 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el9" 2023-12-12T16:26:27.923 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-12T16:26:27.923 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2023-12-12T16:26:27.923 INFO:teuthology.orchestra.run.smithi116.stdout:LOGO="fedora-logo-icon" 2023-12-12T16:26:27.924 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-12T16:26:27.924 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://centos.org/" 2023-12-12T16:26:27.924 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-12T16:26:27.924 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-12T16:26:27.924 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-12T16:26:27.924 INFO:teuthology.provision.fog.smithi116:Deploy complete! 2023-12-12T16:26:27.926 DEBUG:teuthology.parallel:result is None 2023-12-12T16:26:47.229 WARNING:teuthology.provision.fog.smithi142:timed out 2023-12-12T16:26:53.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T16:26:53.547 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-12T16:26:53.547 DEBUG:teuthology.orchestra.run.smithi142:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-12T16:26:53.865 INFO:teuthology.provision.fog.smithi142:Node is ready 2023-12-12T16:26:53.865 DEBUG:teuthology.orchestra.run.smithi142:> hostname 2023-12-12T16:26:53.880 INFO:teuthology.orchestra.run.smithi142.stdout:smithi142.front.sepia.ceph.com 2023-12-12T16:26:53.880 DEBUG:teuthology.orchestra.run.smithi142:> grep smithi142.front.sepia.ceph.com /etc/hosts 2023-12-12T16:26:53.934 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142 smithi142.front.sepia.ceph.com smithi142 2023-12-12T16:26:53.934 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142 2023-12-12T16:26:54.043 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hosts 2023-12-12T16:26:54.070 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/172.21.15.142/172.21.15.142/g' /etc/hosts 2023-12-12T16:26:54.137 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hostname 2023-12-12T16:26:54.204 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142 2023-12-12T16:26:54.270 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2023-12-12T16:26:54.324 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream" 2023-12-12T16:26:54.324 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="9" 2023-12-12T16:26:54.324 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos" 2023-12-12T16:26:54.324 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora" 2023-12-12T16:26:54.324 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="9" 2023-12-12T16:26:54.325 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el9" 2023-12-12T16:26:54.325 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-12T16:26:54.325 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2023-12-12T16:26:54.325 INFO:teuthology.orchestra.run.smithi142.stdout:LOGO="fedora-logo-icon" 2023-12-12T16:26:54.325 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-12T16:26:54.325 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/" 2023-12-12T16:26:54.325 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-12T16:26:54.325 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-12T16:26:54.325 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-12T16:26:54.325 INFO:teuthology.provision.fog.smithi142:Deploy complete! 2023-12-12T16:26:54.326 DEBUG:teuthology.parallel:result is None 2023-12-12T16:26:54.490 INFO:teuthology.lock.ops:Checking smithi116.front.sepia.ceph.com 2023-12-12T16:26:54.490 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-12T16:26:54.517 INFO:teuthology.lock.ops:Checking smithi142.front.sepia.ceph.com 2023-12-12T16:26:54.517 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-12T16:26:54.542 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: set os type and version on server 2023-12-12T16:26:54.543 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-12-12T16:26:54.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T16:26:54.628 DEBUG:teuthology.orchestra.run.smithi116:> true 2023-12-12T16:26:54.792 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-12-12T16:26:54.793 DEBUG:teuthology.orchestra.run.smithi116:> uname -m 2023-12-12T16:26:54.847 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64 2023-12-12T16:26:54.847 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2023-12-12T16:26:54.901 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="CentOS Stream" 2023-12-12T16:26:54.901 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="9" 2023-12-12T16:26:54.901 INFO:teuthology.orchestra.run.smithi116.stdout:ID="centos" 2023-12-12T16:26:54.901 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="rhel fedora" 2023-12-12T16:26:54.901 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="9" 2023-12-12T16:26:54.901 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el9" 2023-12-12T16:26:54.901 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-12T16:26:54.901 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2023-12-12T16:26:54.902 INFO:teuthology.orchestra.run.smithi116.stdout:LOGO="fedora-logo-icon" 2023-12-12T16:26:54.902 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-12T16:26:54.902 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://centos.org/" 2023-12-12T16:26:54.902 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-12T16:26:54.902 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-12T16:26:54.902 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-12T16:26:54.902 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2023-12-12T16:26:54.925 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: set os type and version on server 2023-12-12T16:26:54.925 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-12-12T16:26:54.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T16:26:55.008 DEBUG:teuthology.orchestra.run.smithi142:> true 2023-12-12T16:26:55.072 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-12-12T16:26:55.072 DEBUG:teuthology.orchestra.run.smithi142:> uname -m 2023-12-12T16:26:55.126 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2023-12-12T16:26:55.126 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2023-12-12T16:26:55.180 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream" 2023-12-12T16:26:55.180 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="9" 2023-12-12T16:26:55.180 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos" 2023-12-12T16:26:55.180 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora" 2023-12-12T16:26:55.180 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="9" 2023-12-12T16:26:55.180 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el9" 2023-12-12T16:26:55.181 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-12T16:26:55.181 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2023-12-12T16:26:55.181 INFO:teuthology.orchestra.run.smithi142.stdout:LOGO="fedora-logo-icon" 2023-12-12T16:26:55.181 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-12T16:26:55.181 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/" 2023-12-12T16:26:55.181 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-12T16:26:55.181 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-12T16:26:55.181 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-12T16:26:55.182 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2023-12-12T16:26:55.200 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T16:26:55.289 INFO:teuthology.dispatcher.supervisor:Running job 7488687 2023-12-12T16:26:55.290 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-12_16:18:21-rados-wip-yuri-testing-2023-12-11-1524-distro-default-smithi/7488687 --name yuriw-2023-12-12_16:18:21-rados-wip-yuri-testing-2023-12-11-1524-distro-default-smithi --description rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/cache-pool-snaps} -- /home/teuthworker/archive/yuriw-2023-12-12_16:18:21-rados-wip-yuri-testing-2023-12-11-1524-distro-default-smithi/7488687/orig.config.yaml 2023-12-12T16:26:55.292 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-12_16:18:21-rados-wip-yuri-testing-2023-12-11-1524-distro-default-smithi/7488687 2023-12-12T16:26:55.293 INFO:teuthology.dispatcher.supervisor:Job PID: 2684046 2023-12-12T16:26:55.293 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-12T16:28:55.394 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T16:30:55.581 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T16:32:55.752 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T16:34:55.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T16:36:56.108 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T16:38:56.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T16:40:56.470 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T16:42:56.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T16:44:56.934 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T16:46:57.104 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T16:48:57.278 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T16:50:57.445 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T16:50:57.518 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-12T16:50:57.629 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-12T16:50:57.629 INFO:teuthology.nuke:Checking targets against current locks 2023-12-12T16:50:57.681 DEBUG:teuthology.nuke:shortname: smithi116 2023-12-12T16:50:57.682 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-12T16:50:57.705 DEBUG:teuthology.nuke:shortname: smithi142 2023-12-12T16:50:57.706 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-12T16:50:57.709 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi116.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-12_16:18:21-rados-wip-yuri-testing-2023-12-11-1524-distro-default-smithi/7488687', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-12 16:20:49.551642', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEwvfDwAAMCtSSoTpE1iiLteVS2QrffNxxh/hBHFDaZLggCxWCCMWOjtW0WOgLxfy2J71vgX/YDSVG82/HCyOoE='} 2023-12-12T16:50:57.730 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-12_16:18:21-rados-wip-yuri-testing-2023-12-11-1524-distro-default-smithi/7488687', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-12 16:20:49.553125', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGzr+HVbM+4wqEmp3U+cEyVIFM3aUsClAj+r5avYicoCEfOePc+Pfk57Wp4lTBcJbxFnMzOC5Z/IQCkfrG+Qfng='} 2023-12-12T16:50:57.759 INFO:teuthology.orchestra.console.smithi116:Power off 2023-12-12T16:50:57.760 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-12T16:50:57.781 DEBUG:teuthology.orchestra.console.smithi116:power off output: Chassis Power Control: Down/Off 2023-12-12T16:50:57.781 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T16:50:57.799 INFO:teuthology.orchestra.console.smithi142:Power off 2023-12-12T16:50:57.800 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-12T16:50:57.808 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2023-12-12T16:50:57.820 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off 2023-12-12T16:50:57.820 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T16:50:57.843 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2023-12-12T16:50:57.908 INFO:teuthology.orchestra.console.smithi116:Power off completed 2023-12-12T16:50:57.944 INFO:teuthology.orchestra.console.smithi142:Power off completed 2023-12-12T16:50:58.059 INFO:teuthology.lock.ops:unlocked: smithi116.front.sepia.ceph.com 2023-12-12T16:50:58.084 INFO:teuthology.lock.ops:unlocked: smithi142.front.sepia.ceph.com