2023-11-28T01:59:00.206 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-28T01:59:00.206 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T01:59:00.333 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fef54693670>, signals=[15]) 2023-11-28T01:59:00.333 INFO:teuthology.lock.ops:Start node 'smithi037.front.sepia.ceph.com' reimaging 2023-11-28T01:59:00.333 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: reset os type and version on server 2023-11-28T01:59:00.334 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2023-11-28T01:59:00.351 INFO:teuthology.lock.ops:Start node 'smithi140.front.sepia.ceph.com' reimaging 2023-11-28T01:59:00.351 INFO:teuthology.lock.ops:Updating [smithi140.front.sepia.ceph.com]: reset os type and version on server 2023-11-28T01:59:00.351 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server 2023-11-28T01:59:00.488 DEBUG:teuthology.provision.fog.smithi037:Requesting image smithi_centos_8.stream (ID 3) 2023-11-28T01:59:00.497 DEBUG:teuthology.provision.fog.smithi140:Requesting image smithi_centos_8.stream (ID 3) 2023-11-28T01:59:00.539 INFO:teuthology.provision.fog.smithi037:Scheduling deploy of centos 8.stream 2023-11-28T01:59:00.543 INFO:teuthology.provision.fog.smithi140:Scheduling deploy of centos 8.stream 2023-11-28T01:59:00.840 INFO:teuthology.orchestra.console.smithi140:Power off 2023-11-28T01:59:00.841 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T01:59:00.865 DEBUG:teuthology.orchestra.console.smithi140:power off output: Chassis Power Control: Down/Off 2023-11-28T01:59:00.866 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T01:59:00.884 INFO:teuthology.orchestra.console.smithi037:Power off 2023-11-28T01:59:00.884 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T01:59:00.901 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-11-28T01:59:00.908 DEBUG:teuthology.orchestra.console.smithi037:power off output: Chassis Power Control: Down/Off 2023-11-28T01:59:00.909 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T01:59:00.953 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2023-11-28T01:59:04.902 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T01:59:04.954 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T01:59:05.014 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-11-28T01:59:05.063 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2023-11-28T01:59:09.018 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T01:59:09.064 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T01:59:09.127 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-11-28T01:59:09.173 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off 2023-11-28T01:59:09.228 INFO:teuthology.orchestra.console.smithi140:Power off completed 2023-11-28T01:59:09.274 INFO:teuthology.orchestra.console.smithi037:Power off completed 2023-11-28T01:59:09.330 INFO:teuthology.orchestra.console.smithi140:Power on 2023-11-28T01:59:09.330 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-28T01:59:09.351 DEBUG:teuthology.orchestra.console.smithi140:power on output: Chassis Power Control: Up/On 2023-11-28T01:59:09.351 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T01:59:09.372 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-11-28T01:59:09.375 INFO:teuthology.orchestra.console.smithi037:Power on 2023-11-28T01:59:09.375 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-28T01:59:09.396 DEBUG:teuthology.orchestra.console.smithi037:power on output: Chassis Power Control: Up/On 2023-11-28T01:59:09.397 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T01:59:09.421 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off 2023-11-28T01:59:13.374 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T01:59:13.422 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T01:59:13.488 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-11-28T01:59:13.534 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off 2023-11-28T01:59:17.492 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T01:59:17.536 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T01:59:17.646 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2023-11-28T01:59:17.680 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-11-28T01:59:17.747 INFO:teuthology.orchestra.console.smithi037:Power on completed 2023-11-28T01:59:17.781 INFO:teuthology.orchestra.console.smithi140:Power on completed 2023-11-28T01:59:17.848 INFO:teuthology.provision.fog.smithi037:Waiting for deploy to finish 2023-11-28T01:59:17.882 INFO:teuthology.provision.fog.smithi140:Waiting for deploy to finish 2023-11-28T02:01:33.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T02:01:33.909 ERROR:teuthology.orchestra.connection:Error authenticating with smithi037.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-11-28T02:02:03.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T02:02:07.042 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-28T02:02:13.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T02:02:16.098 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-28T02:02:22.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T02:02:25.158 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-28T02:02:31.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T02:02:34.213 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-28T02:02:37.912 WARNING:teuthology.provision.fog.smithi037:timed out 2023-11-28T02:02:40.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T02:02:43.270 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-28T02:02:43.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T02:02:46.978 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-11-28T02:02:49.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T02:02:52.326 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-28T02:02:52.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T02:02:56.034 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-11-28T02:02:58.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T02:03:01.378 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-28T02:03:02.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T02:03:02.318 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-28T02:03:02.318 DEBUG:teuthology.orchestra.run.smithi037:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-28T02:03:07.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T02:03:17.554 INFO:teuthology.provision.fog.smithi037:Node is ready 2023-11-28T02:03:17.554 DEBUG:teuthology.orchestra.run.smithi037:> hostname 2023-11-28T02:03:17.619 INFO:teuthology.orchestra.run.smithi037.stdout:smithi037.front.sepia.ceph.com 2023-11-28T02:03:17.620 DEBUG:teuthology.orchestra.run.smithi037:> grep smithi037.front.sepia.ceph.com /etc/hosts 2023-11-28T02:03:17.681 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37 smithi037.front.sepia.ceph.com smithi037 2023-11-28T02:03:17.682 DEBUG:teuthology.orchestra.run.smithi037:> sudo hostname smithi037 2023-11-28T02:03:17.803 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/smithi037.front.sepia.ceph.com/smithi037/g' /etc/hosts 2023-11-28T02:03:17.837 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/172.21.15.37/172.21.15.37/g' /etc/hosts 2023-11-28T02:03:17.909 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/smithi037.front.sepia.ceph.com/smithi037/g' /etc/hostname 2023-11-28T02:03:17.980 DEBUG:teuthology.orchestra.run.smithi037:> sudo hostname smithi037 2023-11-28T02:03:18.051 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2023-11-28T02:03:18.110 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Stream" 2023-11-28T02:03:18.111 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="8" 2023-11-28T02:03:18.111 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos" 2023-11-28T02:03:18.111 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora" 2023-11-28T02:03:18.111 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="8" 2023-11-28T02:03:18.111 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el8" 2023-11-28T02:03:18.111 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-28T02:03:18.111 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2023-11-28T02:03:18.111 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-28T02:03:18.111 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://centos.org/" 2023-11-28T02:03:18.111 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T02:03:18.112 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-28T02:03:18.112 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-28T02:03:18.112 INFO:teuthology.provision.fog.smithi037:Deploy complete! 2023-11-28T02:03:18.113 DEBUG:teuthology.parallel:result is None 2023-11-28T02:04:07.383 WARNING:teuthology.provision.fog.smithi140:timed out 2023-11-28T02:04:13.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T02:04:13.635 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-28T02:04:13.635 DEBUG:teuthology.orchestra.run.smithi140:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-28T02:04:13.888 INFO:teuthology.provision.fog.smithi140:Node is ready 2023-11-28T02:04:13.889 DEBUG:teuthology.orchestra.run.smithi140:> hostname 2023-11-28T02:04:13.908 INFO:teuthology.orchestra.run.smithi140.stdout:smithi140.front.sepia.ceph.com 2023-11-28T02:04:13.908 DEBUG:teuthology.orchestra.run.smithi140:> grep smithi140.front.sepia.ceph.com /etc/hosts 2023-11-28T02:04:13.967 INFO:teuthology.orchestra.run.smithi140.stdout:172.21.15.140 smithi140.front.sepia.ceph.com smithi140 2023-11-28T02:04:13.967 DEBUG:teuthology.orchestra.run.smithi140:> sudo hostname smithi140 2023-11-28T02:04:14.077 DEBUG:teuthology.orchestra.run.smithi140:> sudo sed -i -e 's/smithi140.front.sepia.ceph.com/smithi140/g' /etc/hosts 2023-11-28T02:04:14.107 DEBUG:teuthology.orchestra.run.smithi140:> sudo sed -i -e 's/172.21.15.140/172.21.15.140/g' /etc/hosts 2023-11-28T02:04:14.178 DEBUG:teuthology.orchestra.run.smithi140:> sudo sed -i -e 's/smithi140.front.sepia.ceph.com/smithi140/g' /etc/hostname 2023-11-28T02:04:14.246 DEBUG:teuthology.orchestra.run.smithi140:> sudo hostname smithi140 2023-11-28T02:04:14.313 DEBUG:teuthology.orchestra.run.smithi140:> cat /etc/os-release 2023-11-28T02:04:14.372 INFO:teuthology.orchestra.run.smithi140.stdout:NAME="CentOS Stream" 2023-11-28T02:04:14.372 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION="8" 2023-11-28T02:04:14.372 INFO:teuthology.orchestra.run.smithi140.stdout:ID="centos" 2023-11-28T02:04:14.372 INFO:teuthology.orchestra.run.smithi140.stdout:ID_LIKE="rhel fedora" 2023-11-28T02:04:14.372 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION_ID="8" 2023-11-28T02:04:14.373 INFO:teuthology.orchestra.run.smithi140.stdout:PLATFORM_ID="platform:el8" 2023-11-28T02:04:14.373 INFO:teuthology.orchestra.run.smithi140.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-28T02:04:14.373 INFO:teuthology.orchestra.run.smithi140.stdout:ANSI_COLOR="0;31" 2023-11-28T02:04:14.373 INFO:teuthology.orchestra.run.smithi140.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-28T02:04:14.373 INFO:teuthology.orchestra.run.smithi140.stdout:HOME_URL="https://centos.org/" 2023-11-28T02:04:14.373 INFO:teuthology.orchestra.run.smithi140.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T02:04:14.373 INFO:teuthology.orchestra.run.smithi140.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-28T02:04:14.373 INFO:teuthology.orchestra.run.smithi140.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-28T02:04:14.374 INFO:teuthology.provision.fog.smithi140:Deploy complete! 2023-11-28T02:04:14.374 DEBUG:teuthology.parallel:result is None 2023-11-28T02:04:14.554 INFO:teuthology.lock.ops:Checking smithi037.front.sepia.ceph.com 2023-11-28T02:04:14.554 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-28T02:04:14.577 INFO:teuthology.lock.ops:Checking smithi140.front.sepia.ceph.com 2023-11-28T02:04:14.577 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-28T02:04:14.594 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: set os type and version on server 2023-11-28T02:04:14.594 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-11-28T02:04:14.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T02:04:14.663 DEBUG:teuthology.orchestra.run.smithi037:> true 2023-11-28T02:04:14.801 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-11-28T02:04:14.802 DEBUG:teuthology.orchestra.run.smithi037:> uname -m 2023-11-28T02:04:14.860 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2023-11-28T02:04:14.861 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2023-11-28T02:04:14.919 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Stream" 2023-11-28T02:04:14.919 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="8" 2023-11-28T02:04:14.920 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos" 2023-11-28T02:04:14.920 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora" 2023-11-28T02:04:14.920 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="8" 2023-11-28T02:04:14.920 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el8" 2023-11-28T02:04:14.920 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-28T02:04:14.920 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2023-11-28T02:04:14.920 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-28T02:04:14.920 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://centos.org/" 2023-11-28T02:04:14.920 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T02:04:14.920 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-28T02:04:14.920 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-28T02:04:14.921 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2023-11-28T02:04:14.943 INFO:teuthology.lock.ops:Updating [smithi140.front.sepia.ceph.com]: set os type and version on server 2023-11-28T02:04:14.944 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi140.front.sepia.ceph.com' 2023-11-28T02:04:14.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T02:04:15.012 DEBUG:teuthology.orchestra.run.smithi140:> true 2023-11-28T02:04:15.080 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi140.front.sepia.ceph.com' 2023-11-28T02:04:15.081 DEBUG:teuthology.orchestra.run.smithi140:> uname -m 2023-11-28T02:04:15.138 INFO:teuthology.orchestra.run.smithi140.stdout:x86_64 2023-11-28T02:04:15.139 DEBUG:teuthology.orchestra.run.smithi140:> cat /etc/os-release 2023-11-28T02:04:15.198 INFO:teuthology.orchestra.run.smithi140.stdout:NAME="CentOS Stream" 2023-11-28T02:04:15.198 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION="8" 2023-11-28T02:04:15.198 INFO:teuthology.orchestra.run.smithi140.stdout:ID="centos" 2023-11-28T02:04:15.198 INFO:teuthology.orchestra.run.smithi140.stdout:ID_LIKE="rhel fedora" 2023-11-28T02:04:15.198 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION_ID="8" 2023-11-28T02:04:15.198 INFO:teuthology.orchestra.run.smithi140.stdout:PLATFORM_ID="platform:el8" 2023-11-28T02:04:15.198 INFO:teuthology.orchestra.run.smithi140.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-28T02:04:15.198 INFO:teuthology.orchestra.run.smithi140.stdout:ANSI_COLOR="0;31" 2023-11-28T02:04:15.198 INFO:teuthology.orchestra.run.smithi140.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-28T02:04:15.199 INFO:teuthology.orchestra.run.smithi140.stdout:HOME_URL="https://centos.org/" 2023-11-28T02:04:15.199 INFO:teuthology.orchestra.run.smithi140.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T02:04:15.199 INFO:teuthology.orchestra.run.smithi140.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-28T02:04:15.199 INFO:teuthology.orchestra.run.smithi140.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-28T02:04:15.199 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server 2023-11-28T02:04:15.218 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T02:04:15.305 INFO:teuthology.dispatcher.supervisor:Running job 7468634 2023-11-28T02:04:15.305 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-11-27_22:36:18-rgw-wip-yuri-testing-2023-11-27-1028-pacific-distro-default-smithi/7468634 --name yuriw-2023-11-27_22:36:18-rgw-wip-yuri-testing-2023-11-27-1028-pacific-distro-default-smithi --description rgw/verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install bucket-check cls ragweed reshard s3tests-java s3tests versioning} validater/lockdep} -- /home/teuthworker/archive/yuriw-2023-11-27_22:36:18-rgw-wip-yuri-testing-2023-11-27-1028-pacific-distro-default-smithi/7468634/orig.config.yaml 2023-11-28T02:04:15.309 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-11-27_22:36:18-rgw-wip-yuri-testing-2023-11-27-1028-pacific-distro-default-smithi/7468634 2023-11-28T02:04:15.309 INFO:teuthology.dispatcher.supervisor:Job PID: 2572665 2023-11-28T02:04:15.309 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-28T02:06:15.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T02:08:15.384 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T02:10:15.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T02:12:15.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T02:14:15.584 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T02:16:15.660 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T02:18:15.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T02:20:15.809 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T02:22:15.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T02:24:15.962 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T02:26:16.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T02:28:16.128 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T02:30:16.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T02:32:16.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T02:34:16.348 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T02:36:16.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T02:38:16.504 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T02:40:16.581 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T02:42:16.650 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T02:42:16.722 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-11-28T02:42:16.881 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-28T02:42:16.881 INFO:teuthology.nuke:Checking targets against current locks 2023-11-28T02:42:16.929 DEBUG:teuthology.nuke:shortname: smithi037 2023-11-28T02:42:16.930 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T02:42:16.949 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-27_22:36:18-rgw-wip-yuri-testing-2023-11-27-1028-pacific-distro-default-smithi/7468634', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 01:58:59.349366', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMFcZcfLYTL3R2x/UieMw3LrRT718u/mSKEjGnsfLy/TxLbD6zM4SzV1+pCASmVc09RnP3VXGOcKhLe8jto/Q78='} 2023-11-28T02:42:16.953 DEBUG:teuthology.nuke:shortname: smithi140 2023-11-28T02:42:16.954 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T02:42:16.974 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi140.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-27_22:36:18-rgw-wip-yuri-testing-2023-11-27-1028-pacific-distro-default-smithi/7468634', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 01:58:59.350797', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGgfuD9QxfE3Jqkwe9AesTCw2Eqg0VLsPSfc3FxQl6P0Qs7QR1LTd+wmOSVP6me6OjaJEDi3D7NyhkNaE4g62hg='} 2023-11-28T02:42:17.000 INFO:teuthology.orchestra.console.smithi037:Power off 2023-11-28T02:42:17.001 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T02:42:17.021 DEBUG:teuthology.orchestra.console.smithi037:power off output: Chassis Power Control: Down/Off 2023-11-28T02:42:17.021 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T02:42:17.037 INFO:teuthology.orchestra.console.smithi140:Power off 2023-11-28T02:42:17.038 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T02:42:17.046 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off 2023-11-28T02:42:17.058 DEBUG:teuthology.orchestra.console.smithi140:power off output: Chassis Power Control: Down/Off 2023-11-28T02:42:17.058 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T02:42:17.079 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-11-28T02:42:17.146 INFO:teuthology.orchestra.console.smithi037:Power off completed 2023-11-28T02:42:17.181 INFO:teuthology.orchestra.console.smithi140:Power off completed 2023-11-28T02:42:17.297 INFO:teuthology.lock.ops:unlocked: smithi037.front.sepia.ceph.com 2023-11-28T02:42:17.329 INFO:teuthology.lock.ops:unlocked: smithi140.front.sepia.ceph.com