2023-08-08T08:04:51.261 INFO:root:teuthology version: 0.0.1.dev181+g7fda959 2023-08-08T08:04:51.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T08:04:51.407 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f14699e2280>, signals=[15]) 2023-08-08T08:04:51.408 INFO:teuthology.lock.ops:Start node 'smithi012.front.sepia.ceph.com' reimaging 2023-08-08T08:04:51.409 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: reset os type and version on server 2023-08-08T08:04:51.409 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2023-08-08T08:04:51.434 INFO:teuthology.lock.ops:Start node 'smithi204.front.sepia.ceph.com' reimaging 2023-08-08T08:04:51.435 INFO:teuthology.lock.ops:Updating [smithi204.front.sepia.ceph.com]: reset os type and version on server 2023-08-08T08:04:51.435 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server 2023-08-08T08:04:51.436 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /host {"name": "smithi012"} 2023-08-08T08:04:51.459 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /host {"name": "smithi204"} 2023-08-08T08:04:51.514 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-08T08:04:51.537 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-08T08:04:51.566 DEBUG:teuthology.provision.fog.smithi012:Requesting image smithi_centos_8.stream (ID 3) 2023-08-08T08:04:51.567 DEBUG:teuthology.provision.fog.smithi012:FOG request: PUT /host/118 {"imageID": 3} 2023-08-08T08:04:51.577 DEBUG:teuthology.provision.fog.smithi204:Requesting image smithi_centos_8.stream (ID 3) 2023-08-08T08:04:51.577 DEBUG:teuthology.provision.fog.smithi204:FOG request: PUT /host/308 {"imageID": 3} 2023-08-08T08:04:51.614 INFO:teuthology.provision.fog.smithi012:Scheduling deploy of centos 8.stream 2023-08-08T08:04:51.614 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-08-08T08:04:51.630 INFO:teuthology.provision.fog.smithi204:Scheduling deploy of centos 8.stream 2023-08-08T08:04:51.631 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-08-08T08:04:51.673 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /tasktype {"name": "deploy"} 2023-08-08T08:04:51.687 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /tasktype {"name": "deploy"} 2023-08-08T08:04:51.713 DEBUG:teuthology.provision.fog.smithi012:FOG request: POST /host/118/task {"taskTypeID": 1} 2023-08-08T08:04:51.724 DEBUG:teuthology.provision.fog.smithi204:FOG request: POST /host/308/task {"taskTypeID": 1} 2023-08-08T08:04:51.759 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-08-08T08:04:51.783 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-08-08T08:04:51.842 INFO:teuthology.orchestra.console.smithi012:Power off 2023-08-08T08:04:51.843 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-08T08:04:51.866 DEBUG:teuthology.orchestra.console.smithi012:power off output: Chassis Power Control: Down/Off 2023-08-08T08:04:51.867 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T08:04:51.885 INFO:teuthology.orchestra.console.smithi204:Power off 2023-08-08T08:04:51.886 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-08T08:04:51.903 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2023-08-08T08:04:51.915 DEBUG:teuthology.orchestra.console.smithi204:power off output: Chassis Power Control: Down/Off 2023-08-08T08:04:51.916 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T08:04:51.938 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on 2023-08-08T08:04:55.908 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T08:04:55.939 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T08:04:56.020 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2023-08-08T08:04:56.050 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on 2023-08-08T08:05:00.024 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T08:05:00.051 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T08:05:00.137 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2023-08-08T08:05:00.163 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on 2023-08-08T08:05:00.238 INFO:teuthology.orchestra.console.smithi012:Power off completed 2023-08-08T08:05:00.339 INFO:teuthology.orchestra.console.smithi012:Power on 2023-08-08T08:05:00.339 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-08T08:05:00.362 DEBUG:teuthology.orchestra.console.smithi012:power on output: Chassis Power Control: Up/On 2023-08-08T08:05:00.363 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T08:05:00.384 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2023-08-08T08:05:04.164 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T08:05:04.274 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is off 2023-08-08T08:05:04.375 INFO:teuthology.orchestra.console.smithi204:Power off completed 2023-08-08T08:05:04.385 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T08:05:04.476 INFO:teuthology.orchestra.console.smithi204:Power on 2023-08-08T08:05:04.477 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-08T08:05:04.495 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2023-08-08T08:05:04.498 DEBUG:teuthology.orchestra.console.smithi204:power on output: Chassis Power Control: Up/On 2023-08-08T08:05:04.499 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T08:05:04.522 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is off 2023-08-08T08:05:08.499 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T08:05:08.523 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T08:05:08.613 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2023-08-08T08:05:08.634 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on 2023-08-08T08:05:08.715 INFO:teuthology.orchestra.console.smithi012:Power on completed 2023-08-08T08:05:08.735 INFO:teuthology.orchestra.console.smithi204:Power on completed 2023-08-08T08:05:08.816 INFO:teuthology.provision.fog.smithi012:Waiting for deploy to finish 2023-08-08T08:05:08.817 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-08-08T08:05:08.837 INFO:teuthology.provision.fog.smithi204:Waiting for deploy to finish 2023-08-08T08:05:08.837 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-08-08T08:05:23.908 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-08-08T08:05:23.910 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-08-08T08:05:38.997 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-08-08T08:05:38.999 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-08-08T08:05:54.072 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-08-08T08:05:54.073 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-08-08T08:06:09.144 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-08-08T08:06:09.145 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-08-08T08:06:24.215 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-08-08T08:06:24.216 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-08-08T08:06:39.279 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-08-08T08:06:39.280 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-08-08T08:06:54.364 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-08-08T08:06:54.365 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-08-08T08:07:09.436 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-08-08T08:07:09.437 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-08-08T08:07:24.522 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-08-08T08:07:24.524 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-08-08T08:07:39.596 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-08-08T08:07:39.597 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-08-08T08:07:39.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T08:07:42.736 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-08-08T08:07:48.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T08:07:51.792 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-08-08T08:07:54.656 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-08-08T08:07:57.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T08:08:00.848 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-08-08T08:08:06.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T08:08:09.724 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-08-08T08:08:09.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T08:08:09.940 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-08-08T08:08:12.848 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-08-08T08:08:15.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T08:08:18.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T08:08:21.904 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-08-08T08:08:27.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T08:08:30.964 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-08-08T08:08:36.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T08:08:40.052 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-08-08T08:08:46.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T08:08:49.136 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-08-08T08:08:55.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T08:08:58.196 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-08-08T08:09:04.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T08:09:07.280 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-08-08T08:09:13.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T08:09:15.948 WARNING:teuthology.provision.fog.smithi012:timed out 2023-08-08T08:09:21.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T08:09:22.203 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-08T08:09:22.204 DEBUG:teuthology.orchestra.run.smithi012:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-08T08:09:22.447 INFO:teuthology.provision.fog.smithi012:Node is ready 2023-08-08T08:09:22.448 DEBUG:teuthology.orchestra.run.smithi012:> hostname 2023-08-08T08:09:22.467 INFO:teuthology.orchestra.run.smithi012.stdout:smithi012.front.sepia.ceph.com 2023-08-08T08:09:22.468 DEBUG:teuthology.orchestra.run.smithi012:> grep smithi012.front.sepia.ceph.com /etc/hosts 2023-08-08T08:09:22.527 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12 smithi012.front.sepia.ceph.com smithi012 2023-08-08T08:09:22.527 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname smithi012 2023-08-08T08:09:22.618 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/smithi012.front.sepia.ceph.com/smithi012/g' /etc/hosts 2023-08-08T08:09:22.648 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/172.21.15.12/172.21.15.12/g' /etc/hosts 2023-08-08T08:09:22.718 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/smithi012.front.sepia.ceph.com/smithi012/g' /etc/hostname 2023-08-08T08:09:22.787 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname smithi012 2023-08-08T08:09:22.855 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2023-08-08T08:09:22.913 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream" 2023-08-08T08:09:22.913 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="8" 2023-08-08T08:09:22.914 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos" 2023-08-08T08:09:22.914 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora" 2023-08-08T08:09:22.914 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="8" 2023-08-08T08:09:22.914 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el8" 2023-08-08T08:09:22.914 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-08T08:09:22.914 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31" 2023-08-08T08:09:22.914 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-08T08:09:22.915 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/" 2023-08-08T08:09:22.915 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-08T08:09:22.915 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-08T08:09:22.915 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-08T08:09:22.916 INFO:teuthology.provision.fog.smithi012:Deploy complete! 2023-08-08T08:09:22.917 DEBUG:teuthology.parallel:result is None 2023-08-08T08:10:13.336 WARNING:teuthology.provision.fog.smithi204:timed out 2023-08-08T08:10:19.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T08:10:19.567 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-08T08:10:19.567 DEBUG:teuthology.orchestra.run.smithi204:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-08T08:10:19.835 INFO:teuthology.provision.fog.smithi204:Node is ready 2023-08-08T08:10:19.835 DEBUG:teuthology.orchestra.run.smithi204:> hostname 2023-08-08T08:10:19.853 INFO:teuthology.orchestra.run.smithi204.stdout:smithi204.front.sepia.ceph.com 2023-08-08T08:10:19.854 DEBUG:teuthology.orchestra.run.smithi204:> grep smithi204.front.sepia.ceph.com /etc/hosts 2023-08-08T08:10:19.912 INFO:teuthology.orchestra.run.smithi204.stdout:172.21.15.204 smithi204.front.sepia.ceph.com smithi204 2023-08-08T08:10:19.912 DEBUG:teuthology.orchestra.run.smithi204:> sudo hostname smithi204 2023-08-08T08:10:20.031 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/smithi204.front.sepia.ceph.com/smithi204/g' /etc/hosts 2023-08-08T08:10:20.060 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/172.21.15.204/172.21.15.204/g' /etc/hosts 2023-08-08T08:10:20.128 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/smithi204.front.sepia.ceph.com/smithi204/g' /etc/hostname 2023-08-08T08:10:20.196 DEBUG:teuthology.orchestra.run.smithi204:> sudo hostname smithi204 2023-08-08T08:10:20.262 DEBUG:teuthology.orchestra.run.smithi204:> cat /etc/os-release 2023-08-08T08:10:20.320 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="CentOS Stream" 2023-08-08T08:10:20.321 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="8" 2023-08-08T08:10:20.321 INFO:teuthology.orchestra.run.smithi204.stdout:ID="centos" 2023-08-08T08:10:20.321 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE="rhel fedora" 2023-08-08T08:10:20.321 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="8" 2023-08-08T08:10:20.321 INFO:teuthology.orchestra.run.smithi204.stdout:PLATFORM_ID="platform:el8" 2023-08-08T08:10:20.321 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-08T08:10:20.321 INFO:teuthology.orchestra.run.smithi204.stdout:ANSI_COLOR="0;31" 2023-08-08T08:10:20.322 INFO:teuthology.orchestra.run.smithi204.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-08T08:10:20.322 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://centos.org/" 2023-08-08T08:10:20.322 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-08T08:10:20.322 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-08T08:10:20.322 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-08T08:10:20.323 INFO:teuthology.provision.fog.smithi204:Deploy complete! 2023-08-08T08:10:20.324 DEBUG:teuthology.parallel:result is None 2023-08-08T08:10:20.470 INFO:teuthology.lock.ops:Checking smithi012.front.sepia.ceph.com 2023-08-08T08:10:20.471 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-08T08:10:20.495 INFO:teuthology.lock.ops:Checking smithi204.front.sepia.ceph.com 2023-08-08T08:10:20.495 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-08T08:10:20.521 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: set os type and version on server 2023-08-08T08:10:20.521 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-08-08T08:10:20.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T08:10:20.590 DEBUG:teuthology.orchestra.run.smithi012:> true 2023-08-08T08:10:20.738 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-08-08T08:10:20.739 DEBUG:teuthology.orchestra.run.smithi012:> uname -m 2023-08-08T08:10:20.798 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64 2023-08-08T08:10:20.798 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2023-08-08T08:10:20.859 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream" 2023-08-08T08:10:20.859 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="8" 2023-08-08T08:10:20.860 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos" 2023-08-08T08:10:20.860 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora" 2023-08-08T08:10:20.860 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="8" 2023-08-08T08:10:20.860 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el8" 2023-08-08T08:10:20.860 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-08T08:10:20.860 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31" 2023-08-08T08:10:20.860 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-08T08:10:20.861 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/" 2023-08-08T08:10:20.861 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-08T08:10:20.861 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-08T08:10:20.861 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-08T08:10:20.862 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2023-08-08T08:10:20.886 INFO:teuthology.lock.ops:Updating [smithi204.front.sepia.ceph.com]: set os type and version on server 2023-08-08T08:10:20.887 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2023-08-08T08:10:20.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T08:10:20.952 DEBUG:teuthology.orchestra.run.smithi204:> true 2023-08-08T08:10:21.022 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi204.front.sepia.ceph.com' 2023-08-08T08:10:21.023 DEBUG:teuthology.orchestra.run.smithi204:> uname -m 2023-08-08T08:10:21.080 INFO:teuthology.orchestra.run.smithi204.stdout:x86_64 2023-08-08T08:10:21.081 DEBUG:teuthology.orchestra.run.smithi204:> cat /etc/os-release 2023-08-08T08:10:21.138 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="CentOS Stream" 2023-08-08T08:10:21.138 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="8" 2023-08-08T08:10:21.138 INFO:teuthology.orchestra.run.smithi204.stdout:ID="centos" 2023-08-08T08:10:21.139 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE="rhel fedora" 2023-08-08T08:10:21.139 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="8" 2023-08-08T08:10:21.139 INFO:teuthology.orchestra.run.smithi204.stdout:PLATFORM_ID="platform:el8" 2023-08-08T08:10:21.139 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-08T08:10:21.140 INFO:teuthology.orchestra.run.smithi204.stdout:ANSI_COLOR="0;31" 2023-08-08T08:10:21.140 INFO:teuthology.orchestra.run.smithi204.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-08T08:10:21.140 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://centos.org/" 2023-08-08T08:10:21.141 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-08T08:10:21.141 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-08T08:10:21.141 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-08T08:10:21.142 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server 2023-08-08T08:10:21.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T08:10:21.250 INFO:teuthology.dispatcher.supervisor:Running job 7362465 2023-08-08T08:10:21.251 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/bin/teuthology -v --owner scheduled_nmordech@teuthology --archive /home/teuthworker/archive/nmordech-2023-08-08_08:00:44-rados:thrash-erasure-code-main-distro-default-smithi/7362465 --name nmordech-2023-08-08_08:00:44-rados:thrash-erasure-code-main-distro-default-smithi --description rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=8-m=6-crush} -- /home/teuthworker/archive/nmordech-2023-08-08_08:00:44-rados:thrash-erasure-code-main-distro-default-smithi/7362465/orig.config.yaml 2023-08-08T08:10:21.257 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/nmordech-2023-08-08_08:00:44-rados:thrash-erasure-code-main-distro-default-smithi/7362465 2023-08-08T08:10:21.258 INFO:teuthology.dispatcher.supervisor:Job PID: 24918 2023-08-08T08:10:21.258 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-08T08:12:21.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T08:14:21.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T08:16:21.681 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T08:18:21.860 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T08:20:22.026 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T08:22:22.189 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T08:24:22.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T08:26:22.521 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T08:28:22.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T08:30:22.848 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T08:30:22.919 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-08T08:30:23.065 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-08T08:30:23.065 INFO:teuthology.nuke:Checking targets against current locks 2023-08-08T08:30:23.114 DEBUG:teuthology.nuke:shortname: smithi012 2023-08-08T08:30:23.114 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-08T08:30:23.133 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi012.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/nmordech-2023-08-08_08:00:44-rados:thrash-erasure-code-main-distro-default-smithi/7362465', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-08 08:04:50.378654', 'locked_by': 'scheduled_nmordech@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6D+M33YF4nhGFFSqaVCmrkxHRKZrczWrM6r7AV/RtNZHUDwdipvJN3yDdwP4Bxm/Y37sz2x8GxznNyTOYbFRY9E6mGJxu+aJWkGC+0EPVj38tgKaunmyo8y/clK0aSjCmC7Df0VSCKLQYOHKf+3NhAk/1rU9F5/a3MZ9DcfybDnSSilGCzkYcpD6jc5BBg4/QKClnWtJwRU5NRYNN6BpzOmLZaFdtP8Wpm6TE0r68c9wagYLmiGWykSWCPVOtt5CXaZws4daTSaEl5jecMj5OL6fD8JFT6JCe0a1iO8MHT6+x1SKI6rsNIr4nLViZJQMXGCFJN8MscV9E88Mx6h7qYTYKleFsGb2q9QdCqWog6rkctAFYaCTCoSbk1Akzx/T9ObdTxORurJ4Djgk36nYeCJcQd6Bg4zoT7j2uAQ8Gg51b6ihYB0lUcmNZInRVZVv4qjtmtmQqrvWwL3zk4oBNzAqZQ+ACBo0A3wnFAM8Cm4v8sJhtsQHXDVkca1Ysd58='} 2023-08-08T08:30:23.135 DEBUG:teuthology.nuke:shortname: smithi204 2023-08-08T08:30:23.136 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-08T08:30:23.159 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi204.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/nmordech-2023-08-08_08:00:44-rados:thrash-erasure-code-main-distro-default-smithi/7362465', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-08 08:04:50.380161', 'locked_by': 'scheduled_nmordech@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDzSu5Zjsg4hNnTAXnft0alx1Hi1Us+P8rWXLLy95jkNzYa4PhnknkmsYDPxGBVzSnVIhLW8q307pGThNphEHCA='} 2023-08-08T08:30:23.184 INFO:teuthology.orchestra.console.smithi012:Power off 2023-08-08T08:30:23.185 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-08T08:30:23.209 DEBUG:teuthology.orchestra.console.smithi012:power off output: Chassis Power Control: Down/Off 2023-08-08T08:30:23.210 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T08:30:23.228 INFO:teuthology.orchestra.console.smithi204:Power off 2023-08-08T08:30:23.228 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-08T08:30:23.238 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2023-08-08T08:30:23.250 DEBUG:teuthology.orchestra.console.smithi204:power off output: Chassis Power Control: Down/Off 2023-08-08T08:30:23.250 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T08:30:23.272 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is off 2023-08-08T08:30:23.339 INFO:teuthology.orchestra.console.smithi012:Power off completed 2023-08-08T08:30:23.374 INFO:teuthology.orchestra.console.smithi204:Power off completed 2023-08-08T08:30:23.484 INFO:teuthology.lock.ops:unlocked: smithi012.front.sepia.ceph.com 2023-08-08T08:30:23.517 INFO:teuthology.lock.ops:unlocked: smithi204.front.sepia.ceph.com