2023-07-10T04:03:46.823 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-10T04:03:46.825 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-10T04:03:46.826 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-10T04:03:47.054 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f24d1e198b0>, signals=[15]) 2023-07-10T04:03:47.056 INFO:teuthology.lock.ops:Start node 'smithi120.front.sepia.ceph.com' reimaging 2023-07-10T04:03:47.056 INFO:teuthology.lock.ops:Updating [smithi120.front.sepia.ceph.com]: reset os type and version on server 2023-07-10T04:03:47.056 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2023-07-10T04:03:47.085 INFO:teuthology.lock.ops:Start node 'smithi149.front.sepia.ceph.com' reimaging 2023-07-10T04:03:47.085 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: reset os type and version on server 2023-07-10T04:03:47.085 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2023-07-10T04:03:47.087 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /host {"name": "smithi120"} 2023-07-10T04:03:47.110 INFO:teuthology.lock.ops:Start node 'smithi191.front.sepia.ceph.com' reimaging 2023-07-10T04:03:47.110 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: reset os type and version on server 2023-07-10T04:03:47.110 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2023-07-10T04:03:47.112 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /host {"name": "smithi149"} 2023-07-10T04:03:47.137 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /host {"name": "smithi191"} 2023-07-10T04:03:47.165 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-10T04:03:47.189 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-10T04:03:47.211 DEBUG:teuthology.provision.fog.smithi120:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-10T04:03:47.211 DEBUG:teuthology.provision.fog.smithi120:FOG request: PUT /host/225 {"imageID": 5} 2023-07-10T04:03:47.216 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-10T04:03:47.233 DEBUG:teuthology.provision.fog.smithi149:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-10T04:03:47.234 DEBUG:teuthology.provision.fog.smithi149:FOG request: PUT /host/254 {"imageID": 5} 2023-07-10T04:03:47.256 INFO:teuthology.provision.fog.smithi120:Scheduling deploy of rhel 8.6 2023-07-10T04:03:47.257 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-07-10T04:03:47.260 DEBUG:teuthology.provision.fog.smithi191:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-10T04:03:47.261 DEBUG:teuthology.provision.fog.smithi191:FOG request: PUT /host/296 {"imageID": 5} 2023-07-10T04:03:47.283 INFO:teuthology.provision.fog.smithi149:Scheduling deploy of rhel 8.6 2023-07-10T04:03:47.284 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-10T04:03:47.308 INFO:teuthology.provision.fog.smithi191:Scheduling deploy of rhel 8.6 2023-07-10T04:03:47.308 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-07-10T04:03:47.331 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /tasktype {"name": "deploy"} 2023-07-10T04:03:47.341 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /tasktype {"name": "deploy"} 2023-07-10T04:03:47.365 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /tasktype {"name": "deploy"} 2023-07-10T04:03:47.373 DEBUG:teuthology.provision.fog.smithi149:FOG request: POST /host/254/task {"taskTypeID": 1} 2023-07-10T04:03:47.378 DEBUG:teuthology.provision.fog.smithi120:FOG request: POST /host/225/task {"taskTypeID": 1} 2023-07-10T04:03:47.399 DEBUG:teuthology.provision.fog.smithi191:FOG request: POST /host/296/task {"taskTypeID": 1} 2023-07-10T04:03:47.438 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-10T04:03:47.441 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-07-10T04:03:47.455 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-07-10T04:03:47.537 INFO:teuthology.orchestra.console:Power off smithi120 2023-07-10T04:03:47.538 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-10T04:03:47.560 INFO:teuthology.orchestra.console:Power off smithi191 2023-07-10T04:03:47.561 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-10T04:03:47.578 INFO:teuthology.orchestra.console:Power off smithi149 2023-07-10T04:03:47.579 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-10T04:03:47.588 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T04:03:47.600 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T04:03:47.610 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T04:03:51.628 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T04:03:51.637 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T04:03:51.646 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T04:03:55.740 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T04:03:55.749 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T04:03:55.760 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T04:03:55.963 INFO:teuthology.orchestra.console:Power off for smithi120 completed 2023-07-10T04:03:55.970 INFO:teuthology.orchestra.console:Power off for smithi149 completed 2023-07-10T04:03:56.065 INFO:teuthology.orchestra.console:Power on smithi120 2023-07-10T04:03:56.066 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-10T04:03:56.076 INFO:teuthology.orchestra.console:Power on smithi149 2023-07-10T04:03:56.077 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-10T04:03:56.090 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T04:03:56.104 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T04:03:59.857 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T04:04:00.069 INFO:teuthology.orchestra.console:Power off for smithi191 completed 2023-07-10T04:04:00.116 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T04:04:00.131 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T04:04:00.171 INFO:teuthology.orchestra.console:Power on smithi191 2023-07-10T04:04:00.172 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-10T04:04:00.192 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T04:04:04.216 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T04:04:04.229 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T04:04:04.243 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T04:04:04.442 INFO:teuthology.orchestra.console:Power on for smithi120 completed 2023-07-10T04:04:04.455 INFO:teuthology.orchestra.console:Power on for smithi149 completed 2023-07-10T04:04:04.543 INFO:teuthology.provision.fog.smithi120:Waiting for deploy to finish 2023-07-10T04:04:04.543 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-07-10T04:04:04.556 INFO:teuthology.provision.fog.smithi149:Waiting for deploy to finish 2023-07-10T04:04:04.557 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-10T04:04:08.332 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T04:04:08.544 INFO:teuthology.orchestra.console:Power on for smithi191 completed 2023-07-10T04:04:08.645 INFO:teuthology.provision.fog.smithi191:Waiting for deploy to finish 2023-07-10T04:04:08.646 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-07-10T04:04:19.628 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-07-10T04:04:19.629 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-10T04:04:23.712 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-07-10T04:04:34.700 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-07-10T04:04:34.701 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-10T04:04:38.792 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-07-10T04:04:49.780 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-07-10T04:04:49.782 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-10T04:04:53.864 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-07-10T04:05:04.876 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-10T04:05:04.878 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-07-10T04:05:08.936 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-07-10T04:05:19.956 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-10T04:05:19.958 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-07-10T04:05:24.001 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-07-10T04:05:35.032 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-07-10T04:05:35.034 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-10T04:05:39.068 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-07-10T04:05:50.124 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-07-10T04:05:50.125 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-10T04:05:54.160 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-07-10T04:06:05.216 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-10T04:06:05.218 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-07-10T04:06:09.248 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-07-10T04:06:20.296 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-10T04:06:20.297 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-07-10T04:06:24.324 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-07-10T04:06:35.368 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-10T04:06:35.370 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-07-10T04:06:39.400 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-07-10T04:06:39.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T04:06:39.752 ERROR:teuthology.orchestra.connection:Error authenticating with smithi191.front.sepia.ceph.com: Authentication failed. 2023-07-10T04:06:39.754 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-10T04:06:39.754 DEBUG:teuthology.orchestra.run.smithi191:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-10T04:06:39.755 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-10T04:06:50.434 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-10T04:06:50.437 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-07-10T04:06:50.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T04:06:50.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T04:06:53.552 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-10T04:06:53.553 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2023-07-10T04:06:59.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T04:06:59.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T04:07:02.612 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-10T04:07:02.613 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2023-07-10T04:07:08.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T04:07:08.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T04:07:11.668 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-10T04:07:11.700 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2023-07-10T04:07:17.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T04:07:17.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T04:07:20.724 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-10T04:07:20.752 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2023-07-10T04:07:26.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T04:07:26.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T04:07:29.776 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-10T04:07:29.808 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2023-07-10T04:07:35.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T04:07:35.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T04:07:38.832 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-10T04:07:44.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T04:07:47.892 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-10T04:07:53.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T04:08:35.812 WARNING:teuthology.provision.fog.smithi120:timed out 2023-07-10T04:08:41.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T04:08:42.164 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-10T04:08:42.165 DEBUG:teuthology.orchestra.run.smithi120:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-10T04:08:42.446 INFO:teuthology.provision.fog.smithi120:Node is ready 2023-07-10T04:08:42.446 DEBUG:teuthology.orchestra.run.smithi120:> hostname 2023-07-10T04:08:42.465 INFO:teuthology.orchestra.run.smithi120.stdout:smithi120 2023-07-10T04:08:42.465 DEBUG:teuthology.orchestra.run.smithi120:> grep smithi120 /etc/hosts 2023-07-10T04:08:42.522 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120 smithi120.front.sepia.ceph.com smithi120 2023-07-10T04:08:42.523 DEBUG:teuthology.orchestra.run.smithi120:> sudo hostname smithi120 2023-07-10T04:08:42.641 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/smithi120/smithi120/g' /etc/hosts 2023-07-10T04:08:42.677 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/172.21.15.120/172.21.15.120/g' /etc/hosts 2023-07-10T04:08:42.747 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/smithi120/smithi120/g' /etc/hostname 2023-07-10T04:08:42.815 DEBUG:teuthology.orchestra.run.smithi120:> sudo hostname smithi120 2023-07-10T04:08:42.882 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release 2023-07-10T04:08:42.939 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="Red Hat Enterprise Linux" 2023-07-10T04:08:42.939 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="8.6 (Ootpa)" 2023-07-10T04:08:42.939 INFO:teuthology.orchestra.run.smithi120.stdout:ID="rhel" 2023-07-10T04:08:42.939 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="fedora" 2023-07-10T04:08:42.939 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="8.6" 2023-07-10T04:08:42.939 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el8" 2023-07-10T04:08:42.940 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-10T04:08:42.940 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31" 2023-07-10T04:08:42.940 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-10T04:08:42.940 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://www.redhat.com/" 2023-07-10T04:08:42.940 INFO:teuthology.orchestra.run.smithi120.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-10T04:08:42.940 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-10T04:08:42.940 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-07-10T04:08:42.941 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-10T04:08:42.941 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-10T04:08:42.941 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-10T04:08:42.941 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-10T04:08:42.942 INFO:teuthology.provision.fog.smithi120:Deploy complete! 2023-07-10T04:08:42.943 DEBUG:teuthology.parallel:result is None 2023-07-10T04:08:43.888 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-10T04:08:43.889 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi191 2023-07-10T04:08:52.897 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-07-10T04:08:52.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T04:08:53.236 DEBUG:teuthology.orchestra.run.smithi191:> true 2023-07-10T04:08:53.522 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-07-10T04:08:53.523 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-10T04:08:53.523 DEBUG:teuthology.orchestra.run.smithi191:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-10T04:08:53.540 INFO:teuthology.provision.fog.smithi191:Node is ready 2023-07-10T04:08:53.541 DEBUG:teuthology.orchestra.run.smithi191:> hostname 2023-07-10T04:08:53.599 INFO:teuthology.orchestra.run.smithi191.stdout:smithi191 2023-07-10T04:08:53.599 DEBUG:teuthology.orchestra.run.smithi191:> grep smithi191 /etc/hosts 2023-07-10T04:08:53.661 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.15.191 smithi191.front.sepia.ceph.com smithi191 2023-07-10T04:08:53.661 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191 2023-07-10T04:08:53.784 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191/smithi191/g' /etc/hosts 2023-07-10T04:08:53.814 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/172.21.15.191/172.21.15.191/g' /etc/hosts 2023-07-10T04:08:53.882 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191/smithi191/g' /etc/hostname 2023-07-10T04:08:53.895 WARNING:teuthology.provision.fog.smithi149:timed out 2023-07-10T04:08:53.949 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191 2023-07-10T04:08:54.016 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2023-07-10T04:08:54.073 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="Red Hat Enterprise Linux" 2023-07-10T04:08:54.073 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="8.6 (Ootpa)" 2023-07-10T04:08:54.073 INFO:teuthology.orchestra.run.smithi191.stdout:ID="rhel" 2023-07-10T04:08:54.074 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="fedora" 2023-07-10T04:08:54.074 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="8.6" 2023-07-10T04:08:54.074 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el8" 2023-07-10T04:08:54.074 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-10T04:08:54.074 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2023-07-10T04:08:54.074 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-10T04:08:54.074 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://www.redhat.com/" 2023-07-10T04:08:54.075 INFO:teuthology.orchestra.run.smithi191.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-10T04:08:54.075 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-10T04:08:54.075 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-07-10T04:08:54.075 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-10T04:08:54.075 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-10T04:08:54.075 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-10T04:08:54.076 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-10T04:08:54.076 INFO:teuthology.provision.fog.smithi191:Deploy complete! 2023-07-10T04:08:54.076 DEBUG:teuthology.parallel:result is None 2023-07-10T04:08:59.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T04:09:00.439 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-10T04:09:00.439 DEBUG:teuthology.orchestra.run.smithi149:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-10T04:09:00.752 INFO:teuthology.provision.fog.smithi149:Node is ready 2023-07-10T04:09:00.753 DEBUG:teuthology.orchestra.run.smithi149:> hostname 2023-07-10T04:09:00.771 INFO:teuthology.orchestra.run.smithi149.stdout:smithi149.front.sepia.ceph.com 2023-07-10T04:09:00.772 DEBUG:teuthology.orchestra.run.smithi149:> grep smithi149.front.sepia.ceph.com /etc/hosts 2023-07-10T04:09:00.830 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.15.149 smithi149.front.sepia.ceph.com smithi149 2023-07-10T04:09:00.830 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149 2023-07-10T04:09:00.941 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hosts 2023-07-10T04:09:00.970 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/172.21.15.149/172.21.15.149/g' /etc/hosts 2023-07-10T04:09:01.039 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hostname 2023-07-10T04:09:01.106 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149 2023-07-10T04:09:01.172 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2023-07-10T04:09:01.229 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="Red Hat Enterprise Linux" 2023-07-10T04:09:01.229 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="8.6 (Ootpa)" 2023-07-10T04:09:01.229 INFO:teuthology.orchestra.run.smithi149.stdout:ID="rhel" 2023-07-10T04:09:01.229 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="fedora" 2023-07-10T04:09:01.229 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="8.6" 2023-07-10T04:09:01.230 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el8" 2023-07-10T04:09:01.230 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-10T04:09:01.230 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2023-07-10T04:09:01.230 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-10T04:09:01.230 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://www.redhat.com/" 2023-07-10T04:09:01.230 INFO:teuthology.orchestra.run.smithi149.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-10T04:09:01.230 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-10T04:09:01.231 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-07-10T04:09:01.231 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-10T04:09:01.231 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-10T04:09:01.231 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-10T04:09:01.232 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-10T04:09:01.232 INFO:teuthology.provision.fog.smithi149:Deploy complete! 2023-07-10T04:09:01.232 DEBUG:teuthology.parallel:result is None 2023-07-10T04:09:01.453 INFO:teuthology.lock.ops:Checking smithi120.front.sepia.ceph.com 2023-07-10T04:09:01.454 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-10T04:09:01.483 INFO:teuthology.lock.ops:Checking smithi149.front.sepia.ceph.com 2023-07-10T04:09:01.483 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-10T04:09:01.507 INFO:teuthology.lock.ops:Checking smithi191.front.sepia.ceph.com 2023-07-10T04:09:01.508 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-10T04:09:01.526 INFO:teuthology.lock.ops:Updating [smithi120.front.sepia.ceph.com]: set os type and version on server 2023-07-10T04:09:01.526 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2023-07-10T04:09:01.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T04:09:01.595 DEBUG:teuthology.orchestra.run.smithi120:> true 2023-07-10T04:09:01.726 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com' 2023-07-10T04:09:01.726 DEBUG:teuthology.orchestra.run.smithi120:> uname -m 2023-07-10T04:09:01.783 INFO:teuthology.orchestra.run.smithi120.stdout:x86_64 2023-07-10T04:09:01.783 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release 2023-07-10T04:09:01.845 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="Red Hat Enterprise Linux" 2023-07-10T04:09:01.845 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="8.6 (Ootpa)" 2023-07-10T04:09:01.846 INFO:teuthology.orchestra.run.smithi120.stdout:ID="rhel" 2023-07-10T04:09:01.846 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="fedora" 2023-07-10T04:09:01.847 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="8.6" 2023-07-10T04:09:01.847 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el8" 2023-07-10T04:09:01.847 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-10T04:09:01.847 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31" 2023-07-10T04:09:01.847 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-10T04:09:01.847 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://www.redhat.com/" 2023-07-10T04:09:01.847 INFO:teuthology.orchestra.run.smithi120.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-10T04:09:01.848 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-10T04:09:01.848 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-07-10T04:09:01.848 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-10T04:09:01.848 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-10T04:09:01.848 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-10T04:09:01.848 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-10T04:09:01.849 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2023-07-10T04:09:01.874 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: set os type and version on server 2023-07-10T04:09:01.875 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-07-10T04:09:01.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T04:09:01.940 DEBUG:teuthology.orchestra.run.smithi149:> true 2023-07-10T04:09:01.966 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-07-10T04:09:01.967 DEBUG:teuthology.orchestra.run.smithi149:> uname -m 2023-07-10T04:09:02.027 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64 2023-07-10T04:09:02.028 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2023-07-10T04:09:02.087 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="Red Hat Enterprise Linux" 2023-07-10T04:09:02.087 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="8.6 (Ootpa)" 2023-07-10T04:09:02.087 INFO:teuthology.orchestra.run.smithi149.stdout:ID="rhel" 2023-07-10T04:09:02.087 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="fedora" 2023-07-10T04:09:02.088 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="8.6" 2023-07-10T04:09:02.088 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el8" 2023-07-10T04:09:02.088 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-10T04:09:02.088 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2023-07-10T04:09:02.088 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-10T04:09:02.088 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://www.redhat.com/" 2023-07-10T04:09:02.089 INFO:teuthology.orchestra.run.smithi149.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-10T04:09:02.089 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-10T04:09:02.089 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-07-10T04:09:02.089 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-10T04:09:02.089 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-10T04:09:02.089 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-10T04:09:02.089 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-10T04:09:02.090 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2023-07-10T04:09:02.116 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: set os type and version on server 2023-07-10T04:09:02.117 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-07-10T04:09:02.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T04:09:02.185 DEBUG:teuthology.orchestra.run.smithi191:> true 2023-07-10T04:09:02.261 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-07-10T04:09:02.262 DEBUG:teuthology.orchestra.run.smithi191:> uname -m 2023-07-10T04:09:02.321 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64 2023-07-10T04:09:02.321 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2023-07-10T04:09:02.379 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="Red Hat Enterprise Linux" 2023-07-10T04:09:02.380 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="8.6 (Ootpa)" 2023-07-10T04:09:02.380 INFO:teuthology.orchestra.run.smithi191.stdout:ID="rhel" 2023-07-10T04:09:02.380 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="fedora" 2023-07-10T04:09:02.380 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="8.6" 2023-07-10T04:09:02.380 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el8" 2023-07-10T04:09:02.381 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-10T04:09:02.381 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2023-07-10T04:09:02.381 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-10T04:09:02.381 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://www.redhat.com/" 2023-07-10T04:09:02.381 INFO:teuthology.orchestra.run.smithi191.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-10T04:09:02.381 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-10T04:09:02.381 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-07-10T04:09:02.382 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-10T04:09:02.382 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-10T04:09:02.382 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-10T04:09:02.382 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-10T04:09:02.383 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2023-07-10T04:09:02.400 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-10T04:09:02.401 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-10T04:09:02.590 INFO:teuthology.dispatcher.supervisor:Running job 7331769 2023-07-10T04:09:02.591 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-10_00:47:51-fs-reef-distro-default-smithi/7331769 --name yuriw-2023-07-10_00:47:51-fs-reef-distro-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/fsx}} -- /home/teuthworker/archive/yuriw-2023-07-10_00:47:51-fs-reef-distro-default-smithi/7331769/orig.config.yaml 2023-07-10T04:09:02.596 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-07-10_00:47:51-fs-reef-distro-default-smithi/7331769 2023-07-10T04:09:02.596 INFO:teuthology.dispatcher.supervisor:Job PID: 4546 2023-07-10T04:09:02.597 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-10T04:11:02.696 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-10T04:11:02.698 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-10T04:13:02.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-10T04:13:02.872 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-10T04:15:03.042 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-10T04:15:03.043 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-10T04:17:03.217 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-10T04:17:03.218 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-10T04:19:03.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-10T04:19:03.398 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-10T04:21:03.572 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-10T04:21:03.573 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-10T04:23:03.754 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-10T04:23:03.755 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-10T04:25:03.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-10T04:25:03.926 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-10T04:27:04.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-10T04:27:04.086 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-10T04:29:04.258 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-10T04:29:04.259 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-10T04:31:04.437 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-10T04:31:04.438 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-10T04:33:04.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-10T04:33:04.612 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-10T04:35:04.785 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-10T04:35:04.786 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-10T04:37:04.953 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-10T04:37:04.954 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-10T04:39:05.125 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-10T04:39:05.126 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-10T04:41:05.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-10T04:41:05.302 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-10T04:43:05.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-10T04:43:05.474 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-10T04:45:05.645 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-10T04:45:05.646 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-10T04:47:05.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-10T04:47:05.824 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-10T04:49:05.996 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-10T04:49:05.996 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-10T04:51:06.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-10T04:51:06.170 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-10T04:53:06.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-10T04:53:06.292 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-10T04:53:06.370 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-10T04:53:06.626 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-10T04:53:06.627 INFO:teuthology.nuke:Checking targets against current locks 2023-07-10T04:53:06.682 DEBUG:teuthology.nuke:shortname: smithi120 2023-07-10T04:53:06.683 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-10T04:53:06.705 DEBUG:teuthology.nuke:shortname: smithi149 2023-07-10T04:53:06.705 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-10T04:53:06.709 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi120.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-10_00:47:51-fs-reef-distro-default-smithi/7331769', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-10 04:03:45.912186', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-10T04:53:06.730 DEBUG:teuthology.nuke:shortname: smithi191 2023-07-10T04:53:06.731 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-10T04:53:06.733 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-10_00:47:51-fs-reef-distro-default-smithi/7331769', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-10 04:03:45.910322', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-10T04:53:06.754 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-10_00:47:51-fs-reef-distro-default-smithi/7331769', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-10 04:03:45.913860', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-10T04:53:06.763 INFO:teuthology.orchestra.console:Power off smithi120 2023-07-10T04:53:06.763 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-10T04:53:06.784 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T04:53:06.806 INFO:teuthology.orchestra.console:Power off smithi149 2023-07-10T04:53:06.807 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-10T04:53:06.826 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T04:53:06.845 INFO:teuthology.orchestra.console:Power off smithi191 2023-07-10T04:53:06.846 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-10T04:53:06.867 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T04:53:06.916 INFO:teuthology.orchestra.console:Power off for smithi120 completed 2023-07-10T04:53:06.957 INFO:teuthology.orchestra.console:Power off for smithi149 completed 2023-07-10T04:53:06.989 INFO:teuthology.orchestra.console:Power off for smithi191 completed 2023-07-10T04:53:07.076 INFO:teuthology.lock.ops:unlocked: smithi120.front.sepia.ceph.com 2023-07-10T04:53:07.109 INFO:teuthology.lock.ops:unlocked: smithi149.front.sepia.ceph.com 2023-07-10T04:53:07.142 INFO:teuthology.lock.ops:unlocked: smithi191.front.sepia.ceph.com