2023-08-30T03:05:01.659 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-30T03:05:01.660 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T03:05:01.801 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fbfb224d1f0>, signals=[15]) 2023-08-30T03:05:01.802 INFO:teuthology.lock.ops:Start node 'smithi062.front.sepia.ceph.com' reimaging 2023-08-30T03:05:01.803 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: reset os type and version on server 2023-08-30T03:05:01.803 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2023-08-30T03:05:01.842 INFO:teuthology.lock.ops:Start node 'smithi141.front.sepia.ceph.com' reimaging 2023-08-30T03:05:01.842 INFO:teuthology.lock.ops:Updating [smithi141.front.sepia.ceph.com]: reset os type and version on server 2023-08-30T03:05:01.843 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server 2023-08-30T03:05:01.844 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /host {"name": "smithi062"} 2023-08-30T03:05:01.866 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /host {"name": "smithi141"} 2023-08-30T03:05:01.919 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-30T03:05:01.947 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-30T03:05:01.962 DEBUG:teuthology.provision.fog.smithi062:Requesting image smithi_centos_9.stream (ID 10) 2023-08-30T03:05:01.963 DEBUG:teuthology.provision.fog.smithi062:FOG request: PUT /host/167 {"imageID": 10} 2023-08-30T03:05:01.989 DEBUG:teuthology.provision.fog.smithi141:Requesting image smithi_centos_9.stream (ID 10) 2023-08-30T03:05:01.989 DEBUG:teuthology.provision.fog.smithi141:FOG request: PUT /host/246 {"imageID": 10} 2023-08-30T03:05:02.008 INFO:teuthology.provision.fog.smithi062:Scheduling deploy of centos 9.stream 2023-08-30T03:05:02.009 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-08-30T03:05:02.034 INFO:teuthology.provision.fog.smithi141:Scheduling deploy of centos 9.stream 2023-08-30T03:05:02.034 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-30T03:05:02.081 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /tasktype {"name": "deploy"} 2023-08-30T03:05:02.092 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /tasktype {"name": "deploy"} 2023-08-30T03:05:02.119 DEBUG:teuthology.provision.fog.smithi062:FOG request: POST /host/167/task {"taskTypeID": 1} 2023-08-30T03:05:02.136 DEBUG:teuthology.provision.fog.smithi141:FOG request: POST /host/246/task {"taskTypeID": 1} 2023-08-30T03:05:02.183 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-08-30T03:05:02.214 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-30T03:05:02.281 INFO:teuthology.orchestra.console.smithi062:Power off 2023-08-30T03:05:02.283 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T03:05:02.304 DEBUG:teuthology.orchestra.console.smithi062:power off output: Chassis Power Control: Down/Off 2023-08-30T03:05:02.304 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T03:05:02.321 INFO:teuthology.orchestra.console.smithi141:Power off 2023-08-30T03:05:02.321 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T03:05:02.329 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on 2023-08-30T03:05:02.343 DEBUG:teuthology.orchestra.console.smithi141:power off output: Chassis Power Control: Down/Off 2023-08-30T03:05:02.344 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T03:05:02.364 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on 2023-08-30T03:05:06.331 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T03:05:06.365 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T03:05:06.440 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on 2023-08-30T03:05:06.473 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on 2023-08-30T03:05:10.446 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T03:05:10.475 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T03:05:10.556 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on 2023-08-30T03:05:10.587 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on 2023-08-30T03:05:14.558 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T03:05:14.588 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T03:05:14.666 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off 2023-08-30T03:05:14.697 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off 2023-08-30T03:05:14.767 INFO:teuthology.orchestra.console.smithi062:Power off completed 2023-08-30T03:05:14.799 INFO:teuthology.orchestra.console.smithi141:Power off completed 2023-08-30T03:05:14.869 INFO:teuthology.orchestra.console.smithi062:Power on 2023-08-30T03:05:14.869 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-30T03:05:14.890 DEBUG:teuthology.orchestra.console.smithi062:power on output: Chassis Power Control: Up/On 2023-08-30T03:05:14.891 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T03:05:14.900 INFO:teuthology.orchestra.console.smithi141:Power on 2023-08-30T03:05:14.901 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-30T03:05:14.911 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off 2023-08-30T03:05:14.920 DEBUG:teuthology.orchestra.console.smithi141:power on output: Chassis Power Control: Up/On 2023-08-30T03:05:14.921 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T03:05:14.939 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off 2023-08-30T03:05:18.915 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T03:05:18.940 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T03:05:19.024 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off 2023-08-30T03:05:19.049 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off 2023-08-30T03:05:23.026 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T03:05:23.050 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T03:05:23.135 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on 2023-08-30T03:05:23.158 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on 2023-08-30T03:05:23.236 INFO:teuthology.orchestra.console.smithi062:Power on completed 2023-08-30T03:05:23.258 INFO:teuthology.orchestra.console.smithi141:Power on completed 2023-08-30T03:05:23.338 INFO:teuthology.provision.fog.smithi062:Waiting for deploy to finish 2023-08-30T03:05:23.339 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-08-30T03:05:23.360 INFO:teuthology.provision.fog.smithi141:Waiting for deploy to finish 2023-08-30T03:05:23.360 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-30T03:05:38.439 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-08-30T03:05:38.442 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-30T03:05:53.530 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-30T03:05:53.531 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-08-30T03:06:08.623 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-30T03:06:08.624 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-08-30T03:06:23.722 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-30T03:06:23.724 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-08-30T03:06:38.830 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-30T03:06:38.831 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-08-30T03:06:53.938 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-08-30T03:06:53.939 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-30T03:07:09.034 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-30T03:07:09.035 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-08-30T03:07:24.134 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-30T03:07:24.135 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-08-30T03:07:39.234 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-30T03:07:39.235 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-08-30T03:07:54.326 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-30T03:07:54.327 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-08-30T03:07:54.393 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T03:07:54.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T03:07:57.470 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-08-30T03:07:57.471 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-08-30T03:08:03.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T03:08:03.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T03:08:06.554 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-08-30T03:08:06.555 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-08-30T03:08:12.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T03:08:12.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T03:08:15.642 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-08-30T03:08:15.642 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-08-30T03:08:21.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T03:08:21.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T03:08:24.702 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-08-30T03:08:24.702 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-08-30T03:08:30.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T03:08:30.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T03:08:33.786 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-08-30T03:08:33.786 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-08-30T03:08:39.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T03:08:39.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T03:08:42.842 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-08-30T03:08:42.878 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-08-30T03:08:48.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T03:08:48.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T03:08:51.898 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-08-30T03:08:57.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T03:09:48.930 WARNING:teuthology.provision.fog.smithi062:timed out 2023-08-30T03:09:54.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T03:09:55.189 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-30T03:09:55.190 DEBUG:teuthology.orchestra.run.smithi062:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-30T03:09:55.515 INFO:teuthology.provision.fog.smithi062:Node is ready 2023-08-30T03:09:55.515 DEBUG:teuthology.orchestra.run.smithi062:> hostname 2023-08-30T03:09:55.532 INFO:teuthology.orchestra.run.smithi062.stdout:smithi062.front.sepia.ceph.com 2023-08-30T03:09:55.532 DEBUG:teuthology.orchestra.run.smithi062:> grep smithi062.front.sepia.ceph.com /etc/hosts 2023-08-30T03:09:55.588 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62 smithi062.front.sepia.ceph.com smithi062 2023-08-30T03:09:55.589 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062 2023-08-30T03:09:55.705 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi062.front.sepia.ceph.com/smithi062/g' /etc/hosts 2023-08-30T03:09:55.738 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/172.21.15.62/172.21.15.62/g' /etc/hosts 2023-08-30T03:09:55.810 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi062.front.sepia.ceph.com/smithi062/g' /etc/hostname 2023-08-30T03:09:55.882 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062 2023-08-30T03:09:55.953 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2023-08-30T03:09:56.009 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream" 2023-08-30T03:09:56.010 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="9" 2023-08-30T03:09:56.010 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos" 2023-08-30T03:09:56.010 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora" 2023-08-30T03:09:56.010 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="9" 2023-08-30T03:09:56.011 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el9" 2023-08-30T03:09:56.011 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-30T03:09:56.011 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2023-08-30T03:09:56.012 INFO:teuthology.orchestra.run.smithi062.stdout:LOGO="fedora-logo-icon" 2023-08-30T03:09:56.012 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-30T03:09:56.012 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/" 2023-08-30T03:09:56.012 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T03:09:56.012 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-30T03:09:56.013 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T03:09:56.013 INFO:teuthology.provision.fog.smithi062:Deploy complete! 2023-08-30T03:09:56.014 DEBUG:teuthology.parallel:result is None 2023-08-30T03:09:57.910 WARNING:teuthology.provision.fog.smithi141:timed out 2023-08-30T03:10:03.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T03:10:04.186 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-30T03:10:04.186 DEBUG:teuthology.orchestra.run.smithi141:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-30T03:10:04.478 INFO:teuthology.provision.fog.smithi141:Node is ready 2023-08-30T03:10:04.478 DEBUG:teuthology.orchestra.run.smithi141:> hostname 2023-08-30T03:10:04.493 INFO:teuthology.orchestra.run.smithi141.stdout:smithi141.front.sepia.ceph.com 2023-08-30T03:10:04.493 DEBUG:teuthology.orchestra.run.smithi141:> grep smithi141.front.sepia.ceph.com /etc/hosts 2023-08-30T03:10:04.547 INFO:teuthology.orchestra.run.smithi141.stdout:172.21.15.141 smithi141.front.sepia.ceph.com smithi141 2023-08-30T03:10:04.547 DEBUG:teuthology.orchestra.run.smithi141:> sudo hostname smithi141 2023-08-30T03:10:04.657 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/smithi141.front.sepia.ceph.com/smithi141/g' /etc/hosts 2023-08-30T03:10:04.685 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/172.21.15.141/172.21.15.141/g' /etc/hosts 2023-08-30T03:10:04.753 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/smithi141.front.sepia.ceph.com/smithi141/g' /etc/hostname 2023-08-30T03:10:04.820 DEBUG:teuthology.orchestra.run.smithi141:> sudo hostname smithi141 2023-08-30T03:10:04.887 DEBUG:teuthology.orchestra.run.smithi141:> cat /etc/os-release 2023-08-30T03:10:04.942 INFO:teuthology.orchestra.run.smithi141.stdout:NAME="CentOS Stream" 2023-08-30T03:10:04.942 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION="9" 2023-08-30T03:10:04.942 INFO:teuthology.orchestra.run.smithi141.stdout:ID="centos" 2023-08-30T03:10:04.943 INFO:teuthology.orchestra.run.smithi141.stdout:ID_LIKE="rhel fedora" 2023-08-30T03:10:04.943 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_ID="9" 2023-08-30T03:10:04.943 INFO:teuthology.orchestra.run.smithi141.stdout:PLATFORM_ID="platform:el9" 2023-08-30T03:10:04.943 INFO:teuthology.orchestra.run.smithi141.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-30T03:10:04.943 INFO:teuthology.orchestra.run.smithi141.stdout:ANSI_COLOR="0;31" 2023-08-30T03:10:04.944 INFO:teuthology.orchestra.run.smithi141.stdout:LOGO="fedora-logo-icon" 2023-08-30T03:10:04.944 INFO:teuthology.orchestra.run.smithi141.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-30T03:10:04.944 INFO:teuthology.orchestra.run.smithi141.stdout:HOME_URL="https://centos.org/" 2023-08-30T03:10:04.944 INFO:teuthology.orchestra.run.smithi141.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T03:10:04.944 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-30T03:10:04.945 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T03:10:04.945 INFO:teuthology.provision.fog.smithi141:Deploy complete! 2023-08-30T03:10:04.945 DEBUG:teuthology.parallel:result is None 2023-08-30T03:10:05.109 INFO:teuthology.lock.ops:Checking smithi062.front.sepia.ceph.com 2023-08-30T03:10:05.109 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-30T03:10:05.132 INFO:teuthology.lock.ops:Checking smithi141.front.sepia.ceph.com 2023-08-30T03:10:05.133 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-30T03:10:05.160 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: set os type and version on server 2023-08-30T03:10:05.161 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2023-08-30T03:10:05.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T03:10:05.262 DEBUG:teuthology.orchestra.run.smithi062:> true 2023-08-30T03:10:05.288 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2023-08-30T03:10:05.288 DEBUG:teuthology.orchestra.run.smithi062:> uname -m 2023-08-30T03:10:05.344 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2023-08-30T03:10:05.345 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2023-08-30T03:10:05.400 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream" 2023-08-30T03:10:05.400 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="9" 2023-08-30T03:10:05.401 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos" 2023-08-30T03:10:05.401 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora" 2023-08-30T03:10:05.401 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="9" 2023-08-30T03:10:05.401 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el9" 2023-08-30T03:10:05.401 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-30T03:10:05.402 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2023-08-30T03:10:05.402 INFO:teuthology.orchestra.run.smithi062.stdout:LOGO="fedora-logo-icon" 2023-08-30T03:10:05.402 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-30T03:10:05.402 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/" 2023-08-30T03:10:05.402 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T03:10:05.403 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-30T03:10:05.403 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T03:10:05.403 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2023-08-30T03:10:05.424 INFO:teuthology.lock.ops:Updating [smithi141.front.sepia.ceph.com]: set os type and version on server 2023-08-30T03:10:05.425 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-30T03:10:05.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T03:10:05.508 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-30T03:10:05.579 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-30T03:10:05.580 DEBUG:teuthology.orchestra.run.smithi141:> uname -m 2023-08-30T03:10:05.633 INFO:teuthology.orchestra.run.smithi141.stdout:x86_64 2023-08-30T03:10:05.634 DEBUG:teuthology.orchestra.run.smithi141:> cat /etc/os-release 2023-08-30T03:10:05.687 INFO:teuthology.orchestra.run.smithi141.stdout:NAME="CentOS Stream" 2023-08-30T03:10:05.688 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION="9" 2023-08-30T03:10:05.688 INFO:teuthology.orchestra.run.smithi141.stdout:ID="centos" 2023-08-30T03:10:05.688 INFO:teuthology.orchestra.run.smithi141.stdout:ID_LIKE="rhel fedora" 2023-08-30T03:10:05.688 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_ID="9" 2023-08-30T03:10:05.689 INFO:teuthology.orchestra.run.smithi141.stdout:PLATFORM_ID="platform:el9" 2023-08-30T03:10:05.689 INFO:teuthology.orchestra.run.smithi141.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-30T03:10:05.689 INFO:teuthology.orchestra.run.smithi141.stdout:ANSI_COLOR="0;31" 2023-08-30T03:10:05.689 INFO:teuthology.orchestra.run.smithi141.stdout:LOGO="fedora-logo-icon" 2023-08-30T03:10:05.689 INFO:teuthology.orchestra.run.smithi141.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-30T03:10:05.689 INFO:teuthology.orchestra.run.smithi141.stdout:HOME_URL="https://centos.org/" 2023-08-30T03:10:05.690 INFO:teuthology.orchestra.run.smithi141.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T03:10:05.690 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-30T03:10:05.690 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T03:10:05.691 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server 2023-08-30T03:10:05.716 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T03:10:05.806 INFO:teuthology.dispatcher.supervisor:Running job 7382779 2023-08-30T03:10:05.806 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-08-29_20:58:49-rados-wip-yuri8-testing-2023-08-28-1340-distro-default-smithi/7382779 --name yuriw-2023-08-29_20:58:49-rados-wip-yuri8-testing-2023-08-28-1340-distro-default-smithi --description rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/dedup-io-mixed} -- /home/teuthworker/archive/yuriw-2023-08-29_20:58:49-rados-wip-yuri8-testing-2023-08-28-1340-distro-default-smithi/7382779/orig.config.yaml 2023-08-30T03:10:05.810 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-08-29_20:58:49-rados-wip-yuri8-testing-2023-08-28-1340-distro-default-smithi/7382779 2023-08-30T03:10:05.810 INFO:teuthology.dispatcher.supervisor:Job PID: 2452213 2023-08-30T03:10:05.811 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-30T03:12:05.910 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T03:12:05.969 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-30T03:12:06.069 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-30T03:12:06.069 INFO:teuthology.nuke:Checking targets against current locks 2023-08-30T03:12:06.120 DEBUG:teuthology.nuke:shortname: smithi062 2023-08-30T03:12:06.120 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-30T03:12:06.133 DEBUG:teuthology.nuke:shortname: smithi141 2023-08-30T03:12:06.134 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-30T03:12:06.139 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-29_20:58:49-rados-wip-yuri8-testing-2023-08-28-1340-distro-default-smithi/7382779', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-30 03:05:00.890451', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBCzdBwyFGdpP/vf7Rb18NCOMoMbSDo2mt+ZdftdKS/r4jF40YuKa7qi14C7aeVv35V/spZghxFff9w4Pomb9M8='} 2023-08-30T03:12:06.157 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi141.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-29_20:58:49-rados-wip-yuri8-testing-2023-08-28-1340-distro-default-smithi/7382779', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-30 03:05:00.889005', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLdQpKjYeBpxL//NQeOp7nkk/wcLpldCODzSj9eik0LOVMuG6KclOTp9viraKsEbTxMNTlutJd9GD74WAlNcDG8='} 2023-08-30T03:12:06.187 INFO:teuthology.orchestra.console.smithi062:Power off 2023-08-30T03:12:06.188 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T03:12:06.208 DEBUG:teuthology.orchestra.console.smithi062:power off output: Chassis Power Control: Down/Off 2023-08-30T03:12:06.208 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T03:12:06.222 INFO:teuthology.orchestra.console.smithi141:Power off 2023-08-30T03:12:06.223 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T03:12:06.231 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off 2023-08-30T03:12:06.244 DEBUG:teuthology.orchestra.console.smithi141:power off output: Chassis Power Control: Down/Off 2023-08-30T03:12:06.244 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T03:12:06.264 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off 2023-08-30T03:12:06.332 INFO:teuthology.orchestra.console.smithi062:Power off completed 2023-08-30T03:12:06.366 INFO:teuthology.orchestra.console.smithi141:Power off completed 2023-08-30T03:12:06.495 INFO:teuthology.lock.ops:unlocked: smithi062.front.sepia.ceph.com 2023-08-30T03:12:06.511 INFO:teuthology.lock.ops:unlocked: smithi141.front.sepia.ceph.com