2024-01-13T08:59:54.417 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-13T08:59:54.418 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T08:59:54.560 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc0ec0c5c10>, signals=[15]) 2024-01-13T08:59:54.560 INFO:teuthology.lock.ops:Start node 'smithi163.front.sepia.ceph.com' reimaging 2024-01-13T08:59:54.560 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: reset os type and version on server 2024-01-13T08:59:54.561 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2024-01-13T08:59:54.581 INFO:teuthology.lock.ops:Start node 'smithi169.front.sepia.ceph.com' reimaging 2024-01-13T08:59:54.581 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: reset os type and version on server 2024-01-13T08:59:54.581 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2024-01-13T08:59:54.705 DEBUG:teuthology.provision.fog.smithi163:Requesting image smithi_centos_9.stream (ID 10) 2024-01-13T08:59:54.715 DEBUG:teuthology.provision.fog.smithi169:Requesting image smithi_centos_9.stream (ID 10) 2024-01-13T08:59:54.749 INFO:teuthology.provision.fog.smithi163:Scheduling deploy of centos 9.stream 2024-01-13T08:59:54.760 INFO:teuthology.provision.fog.smithi169:Scheduling deploy of centos 9.stream 2024-01-13T08:59:55.001 INFO:teuthology.orchestra.console.smithi163:Power off 2024-01-13T08:59:55.001 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-13T08:59:55.017 INFO:teuthology.orchestra.console.smithi169:Power off 2024-01-13T08:59:55.017 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-13T08:59:55.027 DEBUG:teuthology.orchestra.console.smithi163:power off output: Chassis Power Control: Down/Off 2024-01-13T08:59:55.027 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T08:59:55.041 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off 2024-01-13T08:59:55.042 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T08:59:55.050 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2024-01-13T08:59:55.062 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2024-01-13T08:59:59.052 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T08:59:59.063 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T08:59:59.161 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2024-01-13T08:59:59.172 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2024-01-13T09:00:03.164 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T09:00:03.173 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T09:00:03.273 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2024-01-13T09:00:03.282 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2024-01-13T09:00:03.374 INFO:teuthology.orchestra.console.smithi163:Power off completed 2024-01-13T09:00:03.475 INFO:teuthology.orchestra.console.smithi163:Power on 2024-01-13T09:00:03.475 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-13T09:00:03.503 DEBUG:teuthology.orchestra.console.smithi163:power on output: Chassis Power Control: Up/On 2024-01-13T09:00:03.503 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T09:00:03.526 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2024-01-13T09:00:07.286 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T09:00:07.395 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2024-01-13T09:00:07.496 INFO:teuthology.orchestra.console.smithi169:Power off completed 2024-01-13T09:00:07.526 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T09:00:07.597 INFO:teuthology.orchestra.console.smithi169:Power on 2024-01-13T09:00:07.597 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-13T09:00:07.618 DEBUG:teuthology.orchestra.console.smithi169:power on output: Chassis Power Control: Up/On 2024-01-13T09:00:07.619 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T09:00:07.635 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2024-01-13T09:00:07.639 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2024-01-13T09:00:11.636 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T09:00:11.643 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T09:00:11.745 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2024-01-13T09:00:11.751 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2024-01-13T09:00:11.847 INFO:teuthology.orchestra.console.smithi163:Power on completed 2024-01-13T09:00:11.852 INFO:teuthology.orchestra.console.smithi169:Power on completed 2024-01-13T09:00:11.948 INFO:teuthology.provision.fog.smithi163:Waiting for deploy to finish 2024-01-13T09:00:11.953 INFO:teuthology.provision.fog.smithi169:Waiting for deploy to finish 2024-01-13T09:02:57.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T09:03:00.992 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-01-13T09:03:06.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T09:03:10.076 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-01-13T09:03:12.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T09:03:16.060 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-01-13T09:03:16.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T09:03:19.132 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-01-13T09:03:22.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T09:03:25.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T09:03:25.148 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-01-13T09:03:28.192 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-01-13T09:03:31.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T09:03:34.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T09:03:34.204 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-01-13T09:03:37.276 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-01-13T09:03:40.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T09:03:43.260 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-01-13T09:03:43.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T09:03:46.332 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-01-13T09:03:49.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T09:03:52.316 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-01-13T09:03:52.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T09:03:55.388 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-01-13T09:03:58.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T09:04:01.372 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-01-13T09:04:01.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T09:04:07.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T09:04:10.428 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-01-13T09:04:16.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T09:04:19.484 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-01-13T09:04:19.772 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-01-13T09:04:25.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T09:04:25.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T09:04:28.572 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-01-13T09:04:28.828 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-01-13T09:04:34.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T09:04:34.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T09:04:37.888 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-01-13T09:04:43.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T09:04:44.168 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-13T09:04:44.169 DEBUG:teuthology.orchestra.run.smithi169:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-13T09:05:04.795 INFO:teuthology.provision.fog.smithi169:Node is ready 2024-01-13T09:05:04.795 DEBUG:teuthology.orchestra.run.smithi169:> hostname 2024-01-13T09:05:04.814 INFO:teuthology.orchestra.run.smithi169.stdout:smithi169.front.sepia.ceph.com 2024-01-13T09:05:04.814 DEBUG:teuthology.orchestra.run.smithi169:> grep smithi169.front.sepia.ceph.com /etc/hosts 2024-01-13T09:05:04.871 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.15.169 smithi169.front.sepia.ceph.com smithi169 2024-01-13T09:05:04.872 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2024-01-13T09:05:05.008 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hosts 2024-01-13T09:05:05.040 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/172.21.15.169/172.21.15.169/g' /etc/hosts 2024-01-13T09:05:05.112 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hostname 2024-01-13T09:05:05.184 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2024-01-13T09:05:05.255 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2024-01-13T09:05:05.311 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream" 2024-01-13T09:05:05.311 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="9" 2024-01-13T09:05:05.312 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos" 2024-01-13T09:05:05.312 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora" 2024-01-13T09:05:05.312 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="9" 2024-01-13T09:05:05.312 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el9" 2024-01-13T09:05:05.312 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-13T09:05:05.312 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2024-01-13T09:05:05.312 INFO:teuthology.orchestra.run.smithi169.stdout:LOGO="fedora-logo-icon" 2024-01-13T09:05:05.312 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-13T09:05:05.312 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/" 2024-01-13T09:05:05.312 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-13T09:05:05.312 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-13T09:05:05.312 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-13T09:05:05.313 INFO:teuthology.provision.fog.smithi169:Deploy complete! 2024-01-13T09:05:05.314 DEBUG:teuthology.parallel:result is None 2024-01-13T09:05:34.579 WARNING:teuthology.provision.fog.smithi163:timed out 2024-01-13T09:05:40.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T09:05:41.026 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-13T09:05:41.027 DEBUG:teuthology.orchestra.run.smithi163:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-13T09:05:41.345 INFO:teuthology.provision.fog.smithi163:Node is ready 2024-01-13T09:05:41.345 DEBUG:teuthology.orchestra.run.smithi163:> hostname 2024-01-13T09:05:41.359 INFO:teuthology.orchestra.run.smithi163.stdout:smithi163.front.sepia.ceph.com 2024-01-13T09:05:41.360 DEBUG:teuthology.orchestra.run.smithi163:> grep smithi163.front.sepia.ceph.com /etc/hosts 2024-01-13T09:05:41.419 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163 smithi163.front.sepia.ceph.com smithi163 2024-01-13T09:05:41.419 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname smithi163 2024-01-13T09:05:41.520 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi163.front.sepia.ceph.com/smithi163/g' /etc/hosts 2024-01-13T09:05:41.547 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/172.21.15.163/172.21.15.163/g' /etc/hosts 2024-01-13T09:05:41.618 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi163.front.sepia.ceph.com/smithi163/g' /etc/hostname 2024-01-13T09:05:41.689 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname smithi163 2024-01-13T09:05:41.759 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release 2024-01-13T09:05:41.817 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="CentOS Stream" 2024-01-13T09:05:41.817 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="9" 2024-01-13T09:05:41.817 INFO:teuthology.orchestra.run.smithi163.stdout:ID="centos" 2024-01-13T09:05:41.817 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="rhel fedora" 2024-01-13T09:05:41.817 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="9" 2024-01-13T09:05:41.817 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el9" 2024-01-13T09:05:41.818 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-13T09:05:41.818 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31" 2024-01-13T09:05:41.818 INFO:teuthology.orchestra.run.smithi163.stdout:LOGO="fedora-logo-icon" 2024-01-13T09:05:41.818 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-13T09:05:41.818 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://centos.org/" 2024-01-13T09:05:41.818 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-13T09:05:41.818 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-13T09:05:41.818 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-13T09:05:41.818 INFO:teuthology.provision.fog.smithi163:Deploy complete! 2024-01-13T09:05:41.819 DEBUG:teuthology.parallel:result is None 2024-01-13T09:05:41.986 INFO:teuthology.lock.ops:Checking smithi163.front.sepia.ceph.com 2024-01-13T09:05:41.986 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-13T09:05:42.008 INFO:teuthology.lock.ops:Checking smithi169.front.sepia.ceph.com 2024-01-13T09:05:42.009 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-13T09:05:42.034 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: set os type and version on server 2024-01-13T09:05:42.035 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-01-13T09:05:42.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T09:05:42.124 DEBUG:teuthology.orchestra.run.smithi163:> true 2024-01-13T09:05:42.190 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-01-13T09:05:42.190 DEBUG:teuthology.orchestra.run.smithi163:> uname -m 2024-01-13T09:05:42.244 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64 2024-01-13T09:05:42.244 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release 2024-01-13T09:05:42.298 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="CentOS Stream" 2024-01-13T09:05:42.298 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="9" 2024-01-13T09:05:42.298 INFO:teuthology.orchestra.run.smithi163.stdout:ID="centos" 2024-01-13T09:05:42.298 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="rhel fedora" 2024-01-13T09:05:42.299 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="9" 2024-01-13T09:05:42.299 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el9" 2024-01-13T09:05:42.299 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-13T09:05:42.299 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31" 2024-01-13T09:05:42.299 INFO:teuthology.orchestra.run.smithi163.stdout:LOGO="fedora-logo-icon" 2024-01-13T09:05:42.299 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-13T09:05:42.299 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://centos.org/" 2024-01-13T09:05:42.299 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-13T09:05:42.299 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-13T09:05:42.299 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-13T09:05:42.300 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2024-01-13T09:05:42.325 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: set os type and version on server 2024-01-13T09:05:42.325 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-01-13T09:05:42.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T09:05:42.416 DEBUG:teuthology.orchestra.run.smithi169:> true 2024-01-13T09:05:42.493 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-01-13T09:05:42.493 DEBUG:teuthology.orchestra.run.smithi169:> uname -m 2024-01-13T09:05:42.549 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64 2024-01-13T09:05:42.550 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2024-01-13T09:05:42.606 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream" 2024-01-13T09:05:42.606 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="9" 2024-01-13T09:05:42.606 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos" 2024-01-13T09:05:42.606 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora" 2024-01-13T09:05:42.606 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="9" 2024-01-13T09:05:42.606 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el9" 2024-01-13T09:05:42.607 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-13T09:05:42.607 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2024-01-13T09:05:42.607 INFO:teuthology.orchestra.run.smithi169.stdout:LOGO="fedora-logo-icon" 2024-01-13T09:05:42.607 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-13T09:05:42.607 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/" 2024-01-13T09:05:42.607 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-13T09:05:42.607 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-13T09:05:42.607 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-13T09:05:42.607 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2024-01-13T09:05:42.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T09:05:42.724 INFO:teuthology.dispatcher.supervisor:Running job 7516072 2024-01-13T09:05:42.724 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_myoungwon@teuthology --archive /home/teuthworker/archive/myoungwon-2024-01-13_08:55:10-rados:thrash-wip-ceph-dedup-tool-v2-distro-default-smithi/7516072 --name myoungwon-2024-01-13_08:55:10-rados:thrash-wip-ceph-dedup-tool-v2-distro-default-smithi --description rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/dedup-daemon} -- /home/teuthworker/archive/myoungwon-2024-01-13_08:55:10-rados:thrash-wip-ceph-dedup-tool-v2-distro-default-smithi/7516072/orig.config.yaml 2024-01-13T09:05:42.727 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/myoungwon-2024-01-13_08:55:10-rados:thrash-wip-ceph-dedup-tool-v2-distro-default-smithi/7516072 2024-01-13T09:05:42.727 INFO:teuthology.dispatcher.supervisor:Job PID: 4130198 2024-01-13T09:05:42.727 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-13T09:07:42.752 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T09:09:42.932 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T09:11:43.093 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T09:13:43.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T09:15:43.425 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T09:17:43.592 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T09:19:43.756 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T09:21:43.930 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T09:23:44.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T09:25:44.276 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T09:27:44.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T09:29:44.540 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T09:31:44.704 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T09:33:44.856 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T09:35:45.026 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T09:37:45.192 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T09:39:45.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T09:41:45.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T09:43:45.721 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T09:45:45.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T09:47:46.052 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T09:49:46.230 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T09:51:46.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T09:53:46.552 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T09:55:46.724 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T09:57:46.886 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T09:59:47.064 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T10:01:47.228 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T10:03:47.392 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T10:05:47.561 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T10:07:47.724 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T10:09:47.884 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T10:11:48.052 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T10:13:48.237 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T10:15:48.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T10:17:48.553 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T10:19:48.656 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T10:21:48.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T10:23:48.988 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T10:25:49.164 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T10:27:49.292 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T10:29:49.464 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T10:31:49.631 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T10:33:49.797 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T10:35:49.964 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T10:37:50.128 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T10:39:50.310 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T10:39:50.377 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-13T10:39:50.547 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-13T10:39:50.548 INFO:teuthology.nuke:Checking targets against current locks 2024-01-13T10:39:50.606 DEBUG:teuthology.nuke:shortname: smithi163 2024-01-13T10:39:50.606 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-13T10:39:50.628 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi163.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/myoungwon-2024-01-13_08:55:10-rados:thrash-wip-ceph-dedup-tool-v2-distro-default-smithi/7516072', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-13 08:59:53.382043', 'locked_by': 'scheduled_myoungwon@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGNBnkG/Eg5npvme6wXc6IWnT/M+3x6cCVV8uusqaKPvNesEfvh5c6YaqJ6FaCNxqp0rLDJcCtyFOcPHhIz5GMU='} 2024-01-13T10:39:50.633 DEBUG:teuthology.nuke:shortname: smithi169 2024-01-13T10:39:50.633 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-13T10:39:50.660 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/myoungwon-2024-01-13_08:55:10-rados:thrash-wip-ceph-dedup-tool-v2-distro-default-smithi/7516072', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-13 08:59:53.383508', 'locked_by': 'scheduled_myoungwon@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB/iglTpLL8tJ75iWEkhyswh5nr64hClHIFTmszPSm/fRLebfChycD4m1riEsQdLIetlgM9tb3AtLs85zlqtyK8='} 2024-01-13T10:39:50.680 INFO:teuthology.orchestra.console.smithi163:Power off 2024-01-13T10:39:50.680 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-13T10:39:50.704 DEBUG:teuthology.orchestra.console.smithi163:power off output: Chassis Power Control: Down/Off 2024-01-13T10:39:50.704 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T10:39:50.719 INFO:teuthology.orchestra.console.smithi169:Power off 2024-01-13T10:39:50.719 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-13T10:39:50.730 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2024-01-13T10:39:50.744 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off 2024-01-13T10:39:50.744 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T10:39:50.767 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2024-01-13T10:39:50.831 INFO:teuthology.orchestra.console.smithi163:Power off completed 2024-01-13T10:39:50.868 INFO:teuthology.orchestra.console.smithi169:Power off completed 2024-01-13T10:39:50.984 INFO:teuthology.lock.ops:unlocked: smithi163.front.sepia.ceph.com 2024-01-13T10:39:51.009 INFO:teuthology.lock.ops:unlocked: smithi169.front.sepia.ceph.com