2023-09-28T05:27:37.171 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-28T05:27:37.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T05:27:37.299 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ffa0bb50670>, signals=[15]) 2023-09-28T05:27:37.300 INFO:teuthology.lock.ops:Start node 'smithi107.front.sepia.ceph.com' reimaging 2023-09-28T05:27:37.300 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: reset os type and version on server 2023-09-28T05:27:37.300 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2023-09-28T05:27:37.329 INFO:teuthology.lock.ops:Start node 'smithi191.front.sepia.ceph.com' reimaging 2023-09-28T05:27:37.329 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: reset os type and version on server 2023-09-28T05:27:37.329 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2023-09-28T05:27:37.330 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /host {"name": "smithi107"} 2023-09-28T05:27:37.354 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /host {"name": "smithi191"} 2023-09-28T05:27:37.408 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-09-28T05:27:37.414 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-09-28T05:27:37.445 DEBUG:teuthology.provision.fog.smithi107:Requesting image smithi_rhel_8.4 (ID 7) 2023-09-28T05:27:37.445 DEBUG:teuthology.provision.fog.smithi107:FOG request: PUT /host/212 {"imageID": 7} 2023-09-28T05:27:37.454 DEBUG:teuthology.provision.fog.smithi191:Requesting image smithi_rhel_8.4 (ID 7) 2023-09-28T05:27:37.454 DEBUG:teuthology.provision.fog.smithi191:FOG request: PUT /host/296 {"imageID": 7} 2023-09-28T05:27:37.495 INFO:teuthology.provision.fog.smithi191:Scheduling deploy of rhel 8.4 2023-09-28T05:27:37.495 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-09-28T05:27:37.503 INFO:teuthology.provision.fog.smithi107:Scheduling deploy of rhel 8.4 2023-09-28T05:27:37.503 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-09-28T05:27:37.554 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /tasktype {"name": "deploy"} 2023-09-28T05:27:37.557 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /tasktype {"name": "deploy"} 2023-09-28T05:27:37.588 DEBUG:teuthology.provision.fog.smithi107:FOG request: POST /host/212/task {"taskTypeID": 1} 2023-09-28T05:27:37.593 DEBUG:teuthology.provision.fog.smithi191:FOG request: POST /host/296/task {"taskTypeID": 1} 2023-09-28T05:27:37.651 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-09-28T05:27:37.654 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-09-28T05:27:37.736 INFO:teuthology.orchestra.console.smithi191:Power off 2023-09-28T05:27:37.737 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-28T05:27:37.747 INFO:teuthology.orchestra.console.smithi107:Power off 2023-09-28T05:27:37.748 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-28T05:27:37.757 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off 2023-09-28T05:27:37.757 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T05:27:37.770 DEBUG:teuthology.orchestra.console.smithi107:power off output: Chassis Power Control: Down/Off 2023-09-28T05:27:37.770 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T05:27:37.778 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2023-09-28T05:27:37.792 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2023-09-28T05:27:37.892 INFO:teuthology.orchestra.console.smithi107:Power off completed 2023-09-28T05:27:37.993 INFO:teuthology.orchestra.console.smithi107:Power on 2023-09-28T05:27:37.993 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-28T05:27:38.012 DEBUG:teuthology.orchestra.console.smithi107:power on output: Chassis Power Control: Up/On 2023-09-28T05:27:38.012 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T05:27:38.030 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2023-09-28T05:27:41.783 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T05:27:41.891 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2023-09-28T05:27:42.031 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T05:27:42.139 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2023-09-28T05:27:42.240 INFO:teuthology.orchestra.console.smithi107:Power on completed 2023-09-28T05:27:42.340 INFO:teuthology.provision.fog.smithi107:Waiting for deploy to finish 2023-09-28T05:27:42.340 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-09-28T05:27:45.894 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T05:27:46.003 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2023-09-28T05:27:46.104 INFO:teuthology.orchestra.console.smithi191:Power off completed 2023-09-28T05:27:46.204 INFO:teuthology.orchestra.console.smithi191:Power on 2023-09-28T05:27:46.205 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-28T05:27:46.225 DEBUG:teuthology.orchestra.console.smithi191:power on output: Chassis Power Control: Up/On 2023-09-28T05:27:46.226 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T05:27:46.246 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2023-09-28T05:27:50.250 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T05:27:50.362 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2023-09-28T05:27:54.367 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T05:27:54.550 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2023-09-28T05:27:54.651 INFO:teuthology.orchestra.console.smithi191:Power on completed 2023-09-28T05:27:54.752 INFO:teuthology.provision.fog.smithi191:Waiting for deploy to finish 2023-09-28T05:27:54.752 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-09-28T05:27:57.401 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-09-28T05:28:09.834 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-09-28T05:28:12.462 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-09-28T05:28:24.912 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-09-28T05:28:27.518 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-09-28T05:28:39.987 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-09-28T05:28:42.574 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-09-28T05:28:55.056 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-09-28T05:28:57.630 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-09-28T05:29:10.129 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-09-28T05:29:12.702 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-09-28T05:29:25.200 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-09-28T05:29:27.770 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-09-28T05:29:40.275 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-09-28T05:29:42.837 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-09-28T05:29:55.356 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-09-28T05:29:57.916 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-09-28T05:30:10.442 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-09-28T05:30:12.997 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-09-28T05:30:25.505 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-09-28T05:30:28.063 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-09-28T05:30:28.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T05:30:40.582 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-09-28T05:30:40.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T05:30:46.522 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-09-28T05:30:52.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T05:30:55.578 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-09-28T05:30:59.070 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-09-28T05:31:01.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T05:31:04.634 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-09-28T05:31:05.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T05:31:08.123 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-09-28T05:31:10.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T05:31:13.690 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-09-28T05:31:14.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T05:31:17.178 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-09-28T05:31:19.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T05:31:22.746 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-09-28T05:31:23.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T05:31:26.238 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-09-28T05:31:28.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T05:31:32.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T05:31:47.194 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-09-28T05:31:53.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T05:31:56.282 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-09-28T05:32:02.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T05:32:05.370 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-09-28T05:32:11.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T05:32:11.813 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-28T05:32:11.813 DEBUG:teuthology.orchestra.run.smithi107:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-28T05:32:32.063 INFO:teuthology.provision.fog.smithi107:Node is ready 2023-09-28T05:32:32.063 DEBUG:teuthology.orchestra.run.smithi107:> hostname 2023-09-28T05:32:32.079 INFO:teuthology.orchestra.run.smithi107.stdout:smithi107.front.sepia.ceph.com 2023-09-28T05:32:32.079 DEBUG:teuthology.orchestra.run.smithi107:> grep smithi107.front.sepia.ceph.com /etc/hosts 2023-09-28T05:32:32.133 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107 smithi107.front.sepia.ceph.com smithi107 2023-09-28T05:32:32.134 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107 2023-09-28T05:32:32.243 WARNING:teuthology.provision.fog.smithi191:timed out 2023-09-28T05:32:32.251 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hosts 2023-09-28T05:32:32.275 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/172.21.15.107/172.21.15.107/g' /etc/hosts 2023-09-28T05:32:32.342 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hostname 2023-09-28T05:32:32.409 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107 2023-09-28T05:32:32.475 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2023-09-28T05:32:32.532 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="Red Hat Enterprise Linux" 2023-09-28T05:32:32.532 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="8.4 (Ootpa)" 2023-09-28T05:32:32.532 INFO:teuthology.orchestra.run.smithi107.stdout:ID="rhel" 2023-09-28T05:32:32.532 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="fedora" 2023-09-28T05:32:32.532 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="8.4" 2023-09-28T05:32:32.532 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el8" 2023-09-28T05:32:32.532 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-09-28T05:32:32.532 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2023-09-28T05:32:32.532 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-09-28T05:32:32.533 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://www.redhat.com/" 2023-09-28T05:32:32.533 INFO:teuthology.orchestra.run.smithi107.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-28T05:32:32.533 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-28T05:32:32.533 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-28T05:32:32.533 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-28T05:32:32.533 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-09-28T05:32:32.533 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-28T05:32:32.533 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-09-28T05:32:32.534 INFO:teuthology.provision.fog.smithi107:Deploy complete! 2023-09-28T05:32:32.535 DEBUG:teuthology.parallel:result is None 2023-09-28T05:32:38.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T05:32:38.630 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-28T05:32:38.630 DEBUG:teuthology.orchestra.run.smithi191:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-28T05:32:38.884 INFO:teuthology.provision.fog.smithi191:Node is ready 2023-09-28T05:32:38.884 DEBUG:teuthology.orchestra.run.smithi191:> hostname 2023-09-28T05:32:38.898 INFO:teuthology.orchestra.run.smithi191.stdout:smithi191.front.sepia.ceph.com 2023-09-28T05:32:38.898 DEBUG:teuthology.orchestra.run.smithi191:> grep smithi191.front.sepia.ceph.com /etc/hosts 2023-09-28T05:32:38.953 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.15.191 smithi191.front.sepia.ceph.com smithi191 2023-09-28T05:32:38.953 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191 2023-09-28T05:32:39.074 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hosts 2023-09-28T05:32:39.098 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/172.21.15.191/172.21.15.191/g' /etc/hosts 2023-09-28T05:32:39.163 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hostname 2023-09-28T05:32:39.226 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191 2023-09-28T05:32:39.289 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2023-09-28T05:32:39.342 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="Red Hat Enterprise Linux" 2023-09-28T05:32:39.342 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="8.4 (Ootpa)" 2023-09-28T05:32:39.342 INFO:teuthology.orchestra.run.smithi191.stdout:ID="rhel" 2023-09-28T05:32:39.342 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="fedora" 2023-09-28T05:32:39.342 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="8.4" 2023-09-28T05:32:39.343 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el8" 2023-09-28T05:32:39.343 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-09-28T05:32:39.343 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2023-09-28T05:32:39.343 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-09-28T05:32:39.343 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://www.redhat.com/" 2023-09-28T05:32:39.343 INFO:teuthology.orchestra.run.smithi191.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-28T05:32:39.343 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-28T05:32:39.343 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-09-28T05:32:39.343 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-28T05:32:39.343 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-09-28T05:32:39.343 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-28T05:32:39.343 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-09-28T05:32:39.344 INFO:teuthology.provision.fog.smithi191:Deploy complete! 2023-09-28T05:32:39.344 DEBUG:teuthology.parallel:result is None 2023-09-28T05:32:39.483 INFO:teuthology.lock.ops:Checking smithi107.front.sepia.ceph.com 2023-09-28T05:32:39.484 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-28T05:32:39.508 INFO:teuthology.lock.ops:Checking smithi191.front.sepia.ceph.com 2023-09-28T05:32:39.508 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-28T05:32:39.525 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: set os type and version on server 2023-09-28T05:32:39.526 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2023-09-28T05:32:39.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T05:32:39.593 DEBUG:teuthology.orchestra.run.smithi107:> true 2023-09-28T05:32:39.658 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2023-09-28T05:32:39.658 DEBUG:teuthology.orchestra.run.smithi107:> uname -m 2023-09-28T05:32:39.715 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2023-09-28T05:32:39.715 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2023-09-28T05:32:39.771 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="Red Hat Enterprise Linux" 2023-09-28T05:32:39.771 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="8.4 (Ootpa)" 2023-09-28T05:32:39.771 INFO:teuthology.orchestra.run.smithi107.stdout:ID="rhel" 2023-09-28T05:32:39.772 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="fedora" 2023-09-28T05:32:39.772 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="8.4" 2023-09-28T05:32:39.772 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el8" 2023-09-28T05:32:39.772 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-09-28T05:32:39.772 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2023-09-28T05:32:39.772 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-09-28T05:32:39.772 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://www.redhat.com/" 2023-09-28T05:32:39.772 INFO:teuthology.orchestra.run.smithi107.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-28T05:32:39.772 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-28T05:32:39.772 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-28T05:32:39.772 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-28T05:32:39.772 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-09-28T05:32:39.773 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-28T05:32:39.773 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-09-28T05:32:39.773 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2023-09-28T05:32:39.791 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: set os type and version on server 2023-09-28T05:32:39.792 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-09-28T05:32:39.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T05:32:39.857 DEBUG:teuthology.orchestra.run.smithi191:> true 2023-09-28T05:32:39.919 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-09-28T05:32:39.920 DEBUG:teuthology.orchestra.run.smithi191:> uname -m 2023-09-28T05:32:39.973 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64 2023-09-28T05:32:39.973 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2023-09-28T05:32:40.027 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="Red Hat Enterprise Linux" 2023-09-28T05:32:40.027 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="8.4 (Ootpa)" 2023-09-28T05:32:40.027 INFO:teuthology.orchestra.run.smithi191.stdout:ID="rhel" 2023-09-28T05:32:40.027 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="fedora" 2023-09-28T05:32:40.027 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="8.4" 2023-09-28T05:32:40.027 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el8" 2023-09-28T05:32:40.027 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-09-28T05:32:40.027 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2023-09-28T05:32:40.027 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-09-28T05:32:40.027 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://www.redhat.com/" 2023-09-28T05:32:40.027 INFO:teuthology.orchestra.run.smithi191.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-28T05:32:40.028 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-28T05:32:40.028 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-09-28T05:32:40.028 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-28T05:32:40.028 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-09-28T05:32:40.028 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-28T05:32:40.028 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-09-28T05:32:40.028 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2023-09-28T05:32:40.049 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T05:32:40.147 INFO:teuthology.dispatcher.supervisor:Running job 7403655 2023-09-28T05:32:40.147 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403655 --name yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}} -- /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403655/orig.config.yaml 2023-09-28T05:32:40.150 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403655 2023-09-28T05:32:40.151 INFO:teuthology.dispatcher.supervisor:Job PID: 1862166 2023-09-28T05:32:40.151 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-28T05:34:40.239 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T05:36:40.399 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T05:38:40.548 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T05:40:40.704 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T05:42:40.872 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T05:44:41.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T05:46:41.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T05:48:41.374 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T05:50:41.545 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T05:52:41.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T05:52:41.781 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-09-28T05:52:41.892 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-28T05:52:41.893 INFO:teuthology.nuke:Checking targets against current locks 2023-09-28T05:52:41.939 DEBUG:teuthology.nuke:shortname: smithi107 2023-09-28T05:52:41.940 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-28T05:52:41.964 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403655', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-28 05:27:36.427829', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPzHmQcxW9Vjvo0l7eInl5jLkDGVIMHkV6MAyd8FNwMVCwsuyY7MgAfsTMYD6qwK4vqq4RFrKHAOCLVVEMXaXVA='} 2023-09-28T05:52:41.968 DEBUG:teuthology.nuke:shortname: smithi191 2023-09-28T05:52:41.968 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-28T05:52:41.988 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403655', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-28 05:27:36.426241', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFfyBHgNF3PYB6JZcwOuec7A9lqwvMNRDMXlM37yHEZSHTe5phYf7S2sWf/gbWWo0wcNPabODoDsEbdPgi6kAE4='} 2023-09-28T05:52:42.015 INFO:teuthology.orchestra.console.smithi107:Power off 2023-09-28T05:52:42.016 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-28T05:52:42.042 DEBUG:teuthology.orchestra.console.smithi107:power off output: Chassis Power Control: Down/Off 2023-09-28T05:52:42.043 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T05:52:42.060 INFO:teuthology.orchestra.console.smithi191:Power off 2023-09-28T05:52:42.060 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-28T05:52:42.070 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2023-09-28T05:52:42.083 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off 2023-09-28T05:52:42.083 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T05:52:42.105 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2023-09-28T05:52:42.172 INFO:teuthology.orchestra.console.smithi107:Power off completed 2023-09-28T05:52:42.206 INFO:teuthology.orchestra.console.smithi191:Power off completed 2023-09-28T05:52:42.322 INFO:teuthology.lock.ops:unlocked: smithi107.front.sepia.ceph.com 2023-09-28T05:52:42.356 INFO:teuthology.lock.ops:unlocked: smithi191.front.sepia.ceph.com