2023-07-25T21:11:39.740 INFO:root:teuthology version: 0.0.1.dev160+g407880c 2023-07-25T21:11:39.742 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-25T21:11:39.742 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-25T21:11:39.900 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4f6c4c93a0>, signals=[15]) 2023-07-25T21:11:39.903 INFO:teuthology.lock.ops:Start node 'smithi003.front.sepia.ceph.com' reimaging 2023-07-25T21:11:39.903 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: reset os type and version on server 2023-07-25T21:11:39.904 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2023-07-25T21:11:39.930 INFO:teuthology.lock.ops:Start node 'smithi130.front.sepia.ceph.com' reimaging 2023-07-25T21:11:39.930 INFO:teuthology.lock.ops:Updating [smithi130.front.sepia.ceph.com]: reset os type and version on server 2023-07-25T21:11:39.930 INFO:teuthology.lock.ops:Updating smithi130.front.sepia.ceph.com on lock server 2023-07-25T21:11:39.932 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /host {"name": "smithi003"} 2023-07-25T21:11:39.954 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /host {"name": "smithi130"} 2023-07-25T21:11:40.008 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-07-25T21:11:40.022 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-07-25T21:11:40.046 DEBUG:teuthology.provision.fog.smithi003:Requesting image smithi_rhel_8.4 (ID 7) 2023-07-25T21:11:40.046 DEBUG:teuthology.provision.fog.smithi003:FOG request: PUT /host/109 {"imageID": 7} 2023-07-25T21:11:40.062 DEBUG:teuthology.provision.fog.smithi130:Requesting image smithi_rhel_8.4 (ID 7) 2023-07-25T21:11:40.062 DEBUG:teuthology.provision.fog.smithi130:FOG request: PUT /host/235 {"imageID": 7} 2023-07-25T21:11:40.086 INFO:teuthology.provision.fog.smithi003:Scheduling deploy of rhel 8.4 2023-07-25T21:11:40.086 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-25T21:11:40.110 INFO:teuthology.provision.fog.smithi130:Scheduling deploy of rhel 8.4 2023-07-25T21:11:40.110 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None 2023-07-25T21:11:40.144 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /tasktype {"name": "deploy"} 2023-07-25T21:11:40.162 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /tasktype {"name": "deploy"} 2023-07-25T21:11:40.175 DEBUG:teuthology.provision.fog.smithi003:FOG request: POST /host/109/task {"taskTypeID": 1} 2023-07-25T21:11:40.200 DEBUG:teuthology.provision.fog.smithi130:FOG request: POST /host/235/task {"taskTypeID": 1} 2023-07-25T21:11:40.253 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-25T21:11:40.265 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None 2023-07-25T21:11:40.354 INFO:teuthology.orchestra.console:Power off smithi130 2023-07-25T21:11:40.356 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-25T21:11:40.372 INFO:teuthology.orchestra.console:Power off smithi003 2023-07-25T21:11:40.373 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-25T21:11:40.382 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-25T21:11:40.383 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T21:11:40.395 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-25T21:11:40.396 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T21:11:40.409 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-25T21:11:40.422 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-25T21:11:44.413 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T21:11:44.422 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T21:11:45.524 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T21:11:45.533 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T21:11:49.526 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T21:11:49.535 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T21:11:50.638 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T21:11:50.646 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T21:11:54.639 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T21:11:54.649 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T21:11:54.751 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-25T21:11:54.852 INFO:teuthology.orchestra.console:Power off for smithi130 completed 2023-07-25T21:11:54.953 INFO:teuthology.orchestra.console:Power on smithi130 2023-07-25T21:11:54.954 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-25T21:11:54.974 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On 2023-07-25T21:11:54.975 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T21:11:54.996 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-25T21:11:55.761 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T21:11:59.000 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T21:11:59.763 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T21:11:59.873 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-25T21:11:59.974 INFO:teuthology.orchestra.console:Power off for smithi003 completed 2023-07-25T21:12:00.075 INFO:teuthology.orchestra.console:Power on smithi003 2023-07-25T21:12:00.076 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-25T21:12:00.096 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On 2023-07-25T21:12:00.097 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T21:12:00.110 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T21:12:00.119 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-25T21:12:04.112 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T21:12:04.121 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T21:12:05.223 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T21:12:05.230 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T21:12:09.224 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T21:12:09.233 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T21:12:10.335 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T21:12:10.341 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T21:12:14.341 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T21:12:14.351 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T21:12:15.454 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T21:12:15.462 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T21:12:19.455 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T21:12:19.464 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T21:12:19.566 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-25T21:12:19.668 INFO:teuthology.orchestra.console:Power on for smithi130 completed 2023-07-25T21:12:19.769 INFO:teuthology.provision.fog.smithi130:Waiting for deploy to finish 2023-07-25T21:12:19.770 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None 2023-07-25T21:12:20.575 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T21:12:24.576 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T21:12:24.686 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-25T21:12:24.787 INFO:teuthology.orchestra.console:Power on for smithi003 completed 2023-07-25T21:12:24.887 INFO:teuthology.provision.fog.smithi003:Waiting for deploy to finish 2023-07-25T21:12:24.888 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-25T21:12:34.848 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None 2023-07-25T21:12:43.577 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-25T21:12:49.916 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None 2023-07-25T21:12:58.641 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-25T21:13:04.982 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None 2023-07-25T21:13:19.993 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-25T21:13:40.081 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None 2023-07-25T21:13:40.086 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-25T21:13:55.164 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-25T21:13:55.165 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None 2023-07-25T21:14:19.900 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-25T21:14:19.902 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None 2023-07-25T21:14:44.981 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None 2023-07-25T21:14:44.983 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-25T21:14:55.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T21:14:55.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T21:14:58.096 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130 2023-07-25T21:14:58.098 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-07-25T21:15:04.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T21:15:04.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T21:15:07.188 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130 2023-07-25T21:15:07.189 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-07-25T21:15:13.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T21:15:18.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T21:15:23.201 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130 2023-07-25T21:15:26.256 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-07-25T21:15:29.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T21:15:34.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T21:15:39.217 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130 2023-07-25T21:15:45.225 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T21:16:39.268 WARNING:teuthology.provision.fog.smithi003:timed out 2023-07-25T21:16:45.232 WARNING:teuthology.provision.fog.smithi130:timed out 2023-07-25T21:16:45.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T21:16:50.638 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-25T21:16:50.640 DEBUG:teuthology.orchestra.run.smithi003:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-25T21:16:50.945 INFO:teuthology.provision.fog.smithi003:Node is ready 2023-07-25T21:16:50.946 DEBUG:teuthology.orchestra.run.smithi003:> hostname 2023-07-25T21:16:50.966 INFO:teuthology.orchestra.run.smithi003.stdout:smithi003.front.sepia.ceph.com 2023-07-25T21:16:50.968 DEBUG:teuthology.orchestra.run.smithi003:> grep smithi003.front.sepia.ceph.com /etc/hosts 2023-07-25T21:16:51.028 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3 smithi003.front.sepia.ceph.com smithi003 2023-07-25T21:16:51.029 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2023-07-25T21:16:51.148 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hosts 2023-07-25T21:16:51.179 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/172.21.15.3/172.21.15.3/g' /etc/hosts 2023-07-25T21:16:51.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T21:16:56.241 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hostname 2023-07-25T21:16:56.312 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2023-07-25T21:16:56.380 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2023-07-25T21:16:56.437 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="Red Hat Enterprise Linux" 2023-07-25T21:16:56.437 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="8.4 (Ootpa)" 2023-07-25T21:16:56.437 INFO:teuthology.orchestra.run.smithi003.stdout:ID="rhel" 2023-07-25T21:16:56.437 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="fedora" 2023-07-25T21:16:56.438 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="8.4" 2023-07-25T21:16:56.438 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el8" 2023-07-25T21:16:56.438 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-07-25T21:16:56.438 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2023-07-25T21:16:56.438 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-07-25T21:16:56.438 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://www.redhat.com/" 2023-07-25T21:16:56.438 INFO:teuthology.orchestra.run.smithi003.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-25T21:16:56.439 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-25T21:16:56.439 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-07-25T21:16:56.439 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-25T21:16:56.439 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-07-25T21:16:56.439 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-25T21:16:56.439 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-07-25T21:16:56.440 INFO:teuthology.provision.fog.smithi003:Deploy complete! 2023-07-25T21:16:56.442 DEBUG:teuthology.parallel:result is None 2023-07-25T21:16:56.560 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-25T21:16:56.560 DEBUG:teuthology.orchestra.run.smithi130:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-25T21:16:56.844 INFO:teuthology.provision.fog.smithi130:Node is ready 2023-07-25T21:16:56.845 DEBUG:teuthology.orchestra.run.smithi130:> hostname 2023-07-25T21:16:56.900 INFO:teuthology.orchestra.run.smithi130.stdout:smithi130.front.sepia.ceph.com 2023-07-25T21:16:56.900 DEBUG:teuthology.orchestra.run.smithi130:> grep smithi130.front.sepia.ceph.com /etc/hosts 2023-07-25T21:16:56.956 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.15.130 smithi130.front.sepia.ceph.com smithi130 2023-07-25T21:16:56.957 DEBUG:teuthology.orchestra.run.smithi130:> sudo hostname smithi130 2023-07-25T21:16:57.063 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i -e 's/smithi130.front.sepia.ceph.com/smithi130/g' /etc/hosts 2023-07-25T21:16:57.091 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i -e 's/172.21.15.130/172.21.15.130/g' /etc/hosts 2023-07-25T21:16:57.157 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i -e 's/smithi130.front.sepia.ceph.com/smithi130/g' /etc/hostname 2023-07-25T21:16:57.223 DEBUG:teuthology.orchestra.run.smithi130:> sudo hostname smithi130 2023-07-25T21:16:57.286 DEBUG:teuthology.orchestra.run.smithi130:> cat /etc/os-release 2023-07-25T21:16:57.342 INFO:teuthology.orchestra.run.smithi130.stdout:NAME="Red Hat Enterprise Linux" 2023-07-25T21:16:57.342 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION="8.4 (Ootpa)" 2023-07-25T21:16:57.343 INFO:teuthology.orchestra.run.smithi130.stdout:ID="rhel" 2023-07-25T21:16:57.343 INFO:teuthology.orchestra.run.smithi130.stdout:ID_LIKE="fedora" 2023-07-25T21:16:57.343 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION_ID="8.4" 2023-07-25T21:16:57.344 INFO:teuthology.orchestra.run.smithi130.stdout:PLATFORM_ID="platform:el8" 2023-07-25T21:16:57.344 INFO:teuthology.orchestra.run.smithi130.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-07-25T21:16:57.344 INFO:teuthology.orchestra.run.smithi130.stdout:ANSI_COLOR="0;31" 2023-07-25T21:16:57.344 INFO:teuthology.orchestra.run.smithi130.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-07-25T21:16:57.345 INFO:teuthology.orchestra.run.smithi130.stdout:HOME_URL="https://www.redhat.com/" 2023-07-25T21:16:57.345 INFO:teuthology.orchestra.run.smithi130.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-25T21:16:57.345 INFO:teuthology.orchestra.run.smithi130.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-25T21:16:57.345 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-25T21:16:57.346 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-25T21:16:57.346 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-07-25T21:16:57.346 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-25T21:16:57.346 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-07-25T21:16:57.347 INFO:teuthology.provision.fog.smithi130:Deploy complete! 2023-07-25T21:16:57.347 DEBUG:teuthology.parallel:result is None 2023-07-25T21:17:06.686 INFO:teuthology.lock.ops:Checking smithi003.front.sepia.ceph.com 2023-07-25T21:17:06.687 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-25T21:17:06.718 INFO:teuthology.lock.ops:Checking smithi130.front.sepia.ceph.com 2023-07-25T21:17:06.718 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-25T21:17:06.744 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: set os type and version on server 2023-07-25T21:17:06.745 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-07-25T21:17:06.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T21:17:06.814 DEBUG:teuthology.orchestra.run.smithi003:> true 2023-07-25T21:17:06.936 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-07-25T21:17:06.936 DEBUG:teuthology.orchestra.run.smithi003:> uname -m 2023-07-25T21:17:06.991 INFO:teuthology.orchestra.run.smithi003.stdout:x86_64 2023-07-25T21:17:06.991 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2023-07-25T21:17:07.046 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="Red Hat Enterprise Linux" 2023-07-25T21:17:07.046 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="8.4 (Ootpa)" 2023-07-25T21:17:07.047 INFO:teuthology.orchestra.run.smithi003.stdout:ID="rhel" 2023-07-25T21:17:07.047 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="fedora" 2023-07-25T21:17:07.047 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="8.4" 2023-07-25T21:17:07.047 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el8" 2023-07-25T21:17:07.047 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-07-25T21:17:07.047 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2023-07-25T21:17:07.047 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-07-25T21:17:07.048 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://www.redhat.com/" 2023-07-25T21:17:07.048 INFO:teuthology.orchestra.run.smithi003.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-25T21:17:07.048 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-25T21:17:07.048 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-07-25T21:17:07.049 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-25T21:17:07.049 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-07-25T21:17:07.051 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-25T21:17:07.051 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-07-25T21:17:07.052 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2023-07-25T21:17:07.076 INFO:teuthology.lock.ops:Updating [smithi130.front.sepia.ceph.com]: set os type and version on server 2023-07-25T21:17:07.077 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-07-25T21:17:07.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T21:17:07.141 DEBUG:teuthology.orchestra.run.smithi130:> true 2023-07-25T21:17:07.209 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-07-25T21:17:07.209 DEBUG:teuthology.orchestra.run.smithi130:> uname -m 2023-07-25T21:17:07.265 INFO:teuthology.orchestra.run.smithi130.stdout:x86_64 2023-07-25T21:17:07.266 DEBUG:teuthology.orchestra.run.smithi130:> cat /etc/os-release 2023-07-25T21:17:07.321 INFO:teuthology.orchestra.run.smithi130.stdout:NAME="Red Hat Enterprise Linux" 2023-07-25T21:17:07.321 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION="8.4 (Ootpa)" 2023-07-25T21:17:07.321 INFO:teuthology.orchestra.run.smithi130.stdout:ID="rhel" 2023-07-25T21:17:07.321 INFO:teuthology.orchestra.run.smithi130.stdout:ID_LIKE="fedora" 2023-07-25T21:17:07.322 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION_ID="8.4" 2023-07-25T21:17:07.322 INFO:teuthology.orchestra.run.smithi130.stdout:PLATFORM_ID="platform:el8" 2023-07-25T21:17:07.322 INFO:teuthology.orchestra.run.smithi130.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-07-25T21:17:07.322 INFO:teuthology.orchestra.run.smithi130.stdout:ANSI_COLOR="0;31" 2023-07-25T21:17:07.322 INFO:teuthology.orchestra.run.smithi130.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-07-25T21:17:07.322 INFO:teuthology.orchestra.run.smithi130.stdout:HOME_URL="https://www.redhat.com/" 2023-07-25T21:17:07.322 INFO:teuthology.orchestra.run.smithi130.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-25T21:17:07.322 INFO:teuthology.orchestra.run.smithi130.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-25T21:17:07.323 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-07-25T21:17:07.323 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-25T21:17:07.323 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-07-25T21:17:07.323 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-25T21:17:07.323 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-07-25T21:17:07.324 INFO:teuthology.lock.ops:Updating smithi130.front.sepia.ceph.com on lock server 2023-07-25T21:17:07.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-25T21:17:07.351 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-25T21:17:07.445 INFO:teuthology.dispatcher.supervisor:Running job 7351992 2023-07-25T21:17:07.446 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/virtualenv/bin/teuthology -v --owner scheduled_gabrioux@teuthology --archive /home/teuthworker/archive/gabrioux-2023-07-25_19:57:34-orch:cephadm-wip-guits-testing-4-2023-07-25-0837-quincy-distro-default-smithi/7351992 --name gabrioux-2023-07-25_19:57:34-orch:cephadm-wip-guits-testing-4-2023-07-25-0837-quincy-distro-default-smithi --description orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys} -- /home/teuthworker/archive/gabrioux-2023-07-25_19:57:34-orch:cephadm-wip-guits-testing-4-2023-07-25-0837-quincy-distro-default-smithi/7351992/orig.config.yaml 2023-07-25T21:17:07.450 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/gabrioux-2023-07-25_19:57:34-orch:cephadm-wip-guits-testing-4-2023-07-25-0837-quincy-distro-default-smithi/7351992 2023-07-25T21:17:07.450 INFO:teuthology.dispatcher.supervisor:Job PID: 26373 2023-07-25T21:17:07.451 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-25T21:19:07.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-25T21:19:07.552 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-25T21:21:12.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-25T21:21:12.738 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-25T21:23:17.921 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-25T21:23:17.921 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-25T21:25:23.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-25T21:25:23.097 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-25T21:27:28.282 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-25T21:27:28.284 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-25T21:29:33.461 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-25T21:29:33.461 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-25T21:31:38.637 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-25T21:31:38.637 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-25T21:33:38.805 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-25T21:33:38.806 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-25T21:35:43.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-25T21:35:43.986 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-25T21:37:47.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-25T21:37:47.609 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-25T21:39:50.909 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-25T21:39:50.910 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-25T21:41:56.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-25T21:41:56.085 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-25T21:44:01.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-25T21:44:01.262 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-25T21:44:06.337 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-25T21:44:16.437 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-25T21:44:16.438 INFO:teuthology.nuke:Checking targets against current locks 2023-07-25T21:44:27.530 DEBUG:teuthology.nuke:shortname: smithi003 2023-07-25T21:44:27.531 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-25T21:44:27.559 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi003.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-25_19:57:34-orch:cephadm-wip-guits-testing-4-2023-07-25-0837-quincy-distro-default-smithi/7351992', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-25 21:11:38.870864', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1RcGsX8cu6QCHFlUedvw69ukcfabKTTVlbYtFIh0rgSZr+/nFMENH0ZJB2IPVT+cJUXpvCmAB5HWVpH60xQG5OcegvLnYkaE5rparlhigV3Ud93BVGOVMmt/1srFF4g+Qf1vFRlHIQPmMbDIs0U476NEnY2e1cnAhQqaHQ/fhp+cz6X0X9RXi7joQ1pWRe2Q6d5ApwqZkzhlKkv65arUvL3147fy05us/YB/6470jS43r5sVJBFsYLlh2z2BGWHrGqDw06Xb+lrZy2hVWO/OGIoEaI25cu/N8Q7uLy/WawYFTunF+EHy5CBIaRrqWtmlvT+sBk40eCwNq9yEtOvbNmSYzYlnqnw+Jr4aMaxkofAmAmodw1u0MrOB8d9seWlhaN/bhG5rle6p/COzVGm9RBTUF0lazhrZtq3I86lHoOSXdEr4UDFExsMlph3mrVXdVvCEsXRfQaGCGjZbkjIaIjm0THVaqtt66Ns1u1bBCtvJxOdqc4mH1zeZhHVJ9/+E='} 2023-07-25T21:44:27.562 DEBUG:teuthology.nuke:shortname: smithi130 2023-07-25T21:44:27.562 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-25T21:44:27.589 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi130.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-25_19:57:34-orch:cephadm-wip-guits-testing-4-2023-07-25-0837-quincy-distro-default-smithi/7351992', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-25 21:11:38.872729', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCdE3lS700PZ2sDAU2xjh1bWYaQ+fzIT2nUIRkRHXQ5BkqfC2CRWT8wHwC+Uk00biur5JIxmPSugAzAoWgTtvlUR1UEnMLvN/Vg/uMb7HYTa1dpJ96pbdc1QRNCZwtUD4qDcREhcS478ir1ks3hOIsljg3jbi9aDg634g011NTVJmLVz+PPuP93p/Am4zJyzn5Q0ZQZwTWb9PQKZqEX4iibMyGOsqIpsR1Q7VCJojKolVdQq3H8GUYCFVnEBpz5DOI8coyJ+v1UgBzlJuK/8adbXpMBahzKRqgq6pSA0bWzI0zH3bM1mfq9e5dpcrZHxcY87ARQVBCOJaWgI5rxw6YiF0Vv+meWglOnXaPx+5owlDSVcUKwldbXKp+KGCkme7G2U+ddMBVnL4h/Oe0Pj73YuXFN/K1dq5aKt5QlgHLUH0cjQdRT1bRGIxIn6ILBtN0m2Ndg5KnzTihEIaO4nbyt5yOArF0BQ9N/cyO1+Wh9lQXHr7ukwQdquXM1SUbOOOs='} 2023-07-25T21:44:27.621 INFO:teuthology.orchestra.console:Power off smithi003 2023-07-25T21:44:27.622 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-25T21:44:27.640 INFO:teuthology.orchestra.console:Power off smithi130 2023-07-25T21:44:27.641 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-25T21:44:27.652 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-25T21:44:27.653 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T21:44:27.666 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-25T21:44:27.667 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T21:44:27.678 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-25T21:44:27.688 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-25T21:44:27.780 INFO:teuthology.orchestra.console:Power off for smithi003 completed 2023-07-25T21:44:27.790 INFO:teuthology.orchestra.console:Power off for smithi130 completed 2023-07-25T21:44:47.956 INFO:teuthology.lock.ops:unlocked: smithi003.front.sepia.ceph.com 2023-07-25T21:44:47.964 INFO:teuthology.lock.ops:unlocked: smithi130.front.sepia.ceph.com