2023-07-20T02:33:23.800 INFO:root:teuthology version: 0.0.1.dev153+g79491cb 2023-07-20T02:33:23.801 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:33:23.802 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:33:23.991 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9c4c2458b0>, signals=[15]) 2023-07-20T02:33:23.993 INFO:teuthology.lock.ops:Start node 'smithi138.front.sepia.ceph.com' reimaging 2023-07-20T02:33:23.994 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: reset os type and version on server 2023-07-20T02:33:23.994 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2023-07-20T02:33:24.018 INFO:teuthology.lock.ops:Start node 'smithi149.front.sepia.ceph.com' reimaging 2023-07-20T02:33:24.018 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: reset os type and version on server 2023-07-20T02:33:24.019 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2023-07-20T02:33:24.020 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /host {"name": "smithi138"} 2023-07-20T02:33:24.041 INFO:teuthology.lock.ops:Start node 'smithi172.front.sepia.ceph.com' reimaging 2023-07-20T02:33:24.042 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: reset os type and version on server 2023-07-20T02:33:24.042 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2023-07-20T02:33:24.043 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /host {"name": "smithi149"} 2023-07-20T02:33:24.066 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /host {"name": "smithi172"} 2023-07-20T02:33:24.100 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-20T02:33:24.107 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-20T02:33:24.130 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-20T02:33:24.147 DEBUG:teuthology.provision.fog.smithi138:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-20T02:33:24.147 DEBUG:teuthology.provision.fog.smithi138:FOG request: PUT /host/243 {"imageID": 5} 2023-07-20T02:33:24.151 DEBUG:teuthology.provision.fog.smithi149:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-20T02:33:24.152 DEBUG:teuthology.provision.fog.smithi149:FOG request: PUT /host/254 {"imageID": 5} 2023-07-20T02:33:24.172 DEBUG:teuthology.provision.fog.smithi172:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-20T02:33:24.172 DEBUG:teuthology.provision.fog.smithi172:FOG request: PUT /host/277 {"imageID": 5} 2023-07-20T02:33:24.195 INFO:teuthology.provision.fog.smithi138:Scheduling deploy of rhel 8.6 2023-07-20T02:33:24.196 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None 2023-07-20T02:33:24.209 INFO:teuthology.provision.fog.smithi149:Scheduling deploy of rhel 8.6 2023-07-20T02:33:24.209 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-20T02:33:24.222 INFO:teuthology.provision.fog.smithi172:Scheduling deploy of rhel 8.6 2023-07-20T02:33:24.223 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-07-20T02:33:24.264 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /tasktype {"name": "deploy"} 2023-07-20T02:33:24.267 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /tasktype {"name": "deploy"} 2023-07-20T02:33:24.282 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /tasktype {"name": "deploy"} 2023-07-20T02:33:24.303 DEBUG:teuthology.provision.fog.smithi138:FOG request: POST /host/243/task {"taskTypeID": 1} 2023-07-20T02:33:24.310 DEBUG:teuthology.provision.fog.smithi149:FOG request: POST /host/254/task {"taskTypeID": 1} 2023-07-20T02:33:24.313 DEBUG:teuthology.provision.fog.smithi172:FOG request: POST /host/277/task {"taskTypeID": 1} 2023-07-20T02:33:24.354 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None 2023-07-20T02:33:24.357 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-07-20T02:33:24.359 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-20T02:33:24.467 INFO:teuthology.orchestra.console:Power off smithi138 2023-07-20T02:33:24.468 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T02:33:24.486 INFO:teuthology.orchestra.console:Power off smithi149 2023-07-20T02:33:24.487 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T02:33:24.501 INFO:teuthology.orchestra.console:Power off smithi172 2023-07-20T02:33:24.502 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T02:33:24.513 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:33:24.523 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:33:24.533 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:33:28.548 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:33:28.557 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:33:28.567 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:33:32.664 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:33:32.675 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:33:32.682 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:33:32.878 INFO:teuthology.orchestra.console:Power off for smithi149 completed 2023-07-20T02:33:32.885 INFO:teuthology.orchestra.console:Power off for smithi138 completed 2023-07-20T02:33:32.894 INFO:teuthology.orchestra.console:Power off for smithi172 completed 2023-07-20T02:33:32.979 INFO:teuthology.orchestra.console:Power on smithi149 2023-07-20T02:33:32.980 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-20T02:33:32.989 INFO:teuthology.orchestra.console:Power on smithi138 2023-07-20T02:33:32.990 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-20T02:33:32.998 INFO:teuthology.orchestra.console:Power on smithi172 2023-07-20T02:33:32.999 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-20T02:33:33.009 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:33:33.018 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:33:33.027 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:33:37.040 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:33:37.048 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:33:37.058 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:33:37.251 INFO:teuthology.orchestra.console:Power on for smithi149 completed 2023-07-20T02:33:37.352 INFO:teuthology.provision.fog.smithi149:Waiting for deploy to finish 2023-07-20T02:33:37.352 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-20T02:33:41.164 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:33:41.172 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:33:41.383 INFO:teuthology.orchestra.console:Power on for smithi172 completed 2023-07-20T02:33:41.458 INFO:teuthology.orchestra.console:Power on for smithi138 completed 2023-07-20T02:33:41.484 INFO:teuthology.provision.fog.smithi172:Waiting for deploy to finish 2023-07-20T02:33:41.485 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-07-20T02:33:41.560 INFO:teuthology.provision.fog.smithi138:Waiting for deploy to finish 2023-07-20T02:33:41.560 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None 2023-07-20T02:33:52.421 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-20T02:33:56.566 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-07-20T02:33:56.624 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None 2023-07-20T02:34:07.496 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-20T02:34:11.648 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-07-20T02:34:11.691 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None 2023-07-20T02:34:22.572 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-20T02:34:26.712 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-07-20T02:34:26.752 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None 2023-07-20T02:34:37.644 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-20T02:34:41.785 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-07-20T02:34:41.810 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None 2023-07-20T02:34:52.717 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-20T02:34:56.852 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-07-20T02:34:56.870 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None 2023-07-20T02:35:07.784 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-20T02:35:11.916 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-07-20T02:35:11.921 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None 2023-07-20T02:35:22.852 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-20T02:35:26.976 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-07-20T02:35:26.977 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None 2023-07-20T02:35:37.932 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-20T02:35:42.036 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None 2023-07-20T02:35:42.039 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-07-20T02:35:52.988 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-20T02:35:57.104 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None 2023-07-20T02:35:57.105 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-07-20T02:36:08.046 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-20T02:36:12.168 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-07-20T02:36:12.169 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None 2023-07-20T02:36:12.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:36:12.296 ERROR:teuthology.orchestra.connection:Error authenticating with smithi138.front.sepia.ceph.com: Authentication failed. 2023-07-20T02:36:12.297 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-20T02:36:12.298 DEBUG:teuthology.orchestra.run.smithi138:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-20T02:36:12.299 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-20T02:36:23.098 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-20T02:36:23.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:36:26.224 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-20T02:36:27.216 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-07-20T02:36:27.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:36:30.320 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-07-20T02:36:32.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:36:35.282 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-20T02:36:36.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:36:39.376 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-07-20T02:36:41.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:36:44.340 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-20T02:36:45.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:36:48.432 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-07-20T02:36:50.341 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:36:53.392 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-20T02:36:54.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:36:57.488 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-07-20T02:36:59.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:37:02.448 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-20T02:37:03.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:37:06.548 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-07-20T02:37:08.450 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:37:11.508 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-20T02:37:12.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:37:15.604 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-07-20T02:37:17.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:37:20.560 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-20T02:37:21.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:37:24.656 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-07-20T02:37:26.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:37:30.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:38:04.400 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-20T02:38:04.402 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi138 2023-07-20T02:38:13.408 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2023-07-20T02:38:13.409 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:38:13.821 DEBUG:teuthology.orchestra.run.smithi138:> true 2023-07-20T02:38:14.115 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2023-07-20T02:38:14.116 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-20T02:38:14.116 DEBUG:teuthology.orchestra.run.smithi138:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-20T02:38:14.134 INFO:teuthology.provision.fog.smithi138:Node is ready 2023-07-20T02:38:14.134 DEBUG:teuthology.orchestra.run.smithi138:> hostname 2023-07-20T02:38:14.192 INFO:teuthology.orchestra.run.smithi138.stdout:smithi138.front.sepia.ceph.com 2023-07-20T02:38:14.192 DEBUG:teuthology.orchestra.run.smithi138:> grep smithi138.front.sepia.ceph.com /etc/hosts 2023-07-20T02:38:14.250 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138 smithi138.front.sepia.ceph.com smithi138 2023-07-20T02:38:14.251 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname smithi138 2023-07-20T02:38:14.377 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/smithi138.front.sepia.ceph.com/smithi138/g' /etc/hosts 2023-07-20T02:38:14.405 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/172.21.15.138/172.21.15.138/g' /etc/hosts 2023-07-20T02:38:14.473 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/smithi138.front.sepia.ceph.com/smithi138/g' /etc/hostname 2023-07-20T02:38:14.541 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname smithi138 2023-07-20T02:38:14.607 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2023-07-20T02:38:14.663 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="Red Hat Enterprise Linux" 2023-07-20T02:38:14.664 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="8.6 (Ootpa)" 2023-07-20T02:38:14.664 INFO:teuthology.orchestra.run.smithi138.stdout:ID="rhel" 2023-07-20T02:38:14.664 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="fedora" 2023-07-20T02:38:14.664 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="8.6" 2023-07-20T02:38:14.664 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el8" 2023-07-20T02:38:14.664 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-20T02:38:14.664 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31" 2023-07-20T02:38:14.665 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-20T02:38:14.665 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://www.redhat.com/" 2023-07-20T02:38:14.665 INFO:teuthology.orchestra.run.smithi138.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-20T02:38:14.665 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-20T02:38:14.665 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-07-20T02:38:14.665 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-20T02:38:14.665 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-20T02:38:14.666 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-20T02:38:14.666 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-20T02:38:14.666 INFO:teuthology.provision.fog.smithi138:Deploy complete! 2023-07-20T02:38:14.668 DEBUG:teuthology.parallel:result is None 2023-07-20T02:38:26.576 WARNING:teuthology.provision.fog.smithi149:timed out 2023-07-20T02:38:30.660 WARNING:teuthology.provision.fog.smithi172:timed out 2023-07-20T02:38:32.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:38:32.829 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-20T02:38:32.830 DEBUG:teuthology.orchestra.run.smithi149:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-20T02:38:33.143 INFO:teuthology.provision.fog.smithi149:Node is ready 2023-07-20T02:38:33.144 DEBUG:teuthology.orchestra.run.smithi149:> hostname 2023-07-20T02:38:33.160 INFO:teuthology.orchestra.run.smithi149.stdout:smithi149.front.sepia.ceph.com 2023-07-20T02:38:33.161 DEBUG:teuthology.orchestra.run.smithi149:> grep smithi149.front.sepia.ceph.com /etc/hosts 2023-07-20T02:38:33.222 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.15.149 smithi149.front.sepia.ceph.com smithi149 2023-07-20T02:38:33.222 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149 2023-07-20T02:38:33.339 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hosts 2023-07-20T02:38:33.366 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/172.21.15.149/172.21.15.149/g' /etc/hosts 2023-07-20T02:38:33.436 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hostname 2023-07-20T02:38:33.506 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149 2023-07-20T02:38:33.576 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2023-07-20T02:38:33.635 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="Red Hat Enterprise Linux" 2023-07-20T02:38:33.635 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="8.6 (Ootpa)" 2023-07-20T02:38:33.636 INFO:teuthology.orchestra.run.smithi149.stdout:ID="rhel" 2023-07-20T02:38:33.636 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="fedora" 2023-07-20T02:38:33.636 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="8.6" 2023-07-20T02:38:33.636 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el8" 2023-07-20T02:38:33.636 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-20T02:38:33.636 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2023-07-20T02:38:33.637 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-20T02:38:33.637 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://www.redhat.com/" 2023-07-20T02:38:33.637 INFO:teuthology.orchestra.run.smithi149.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-20T02:38:33.637 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-20T02:38:33.637 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-07-20T02:38:33.637 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-20T02:38:33.637 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-20T02:38:33.637 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-20T02:38:33.638 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-20T02:38:33.638 INFO:teuthology.provision.fog.smithi149:Deploy complete! 2023-07-20T02:38:33.639 DEBUG:teuthology.parallel:result is None 2023-07-20T02:38:36.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:38:37.016 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-20T02:38:37.017 DEBUG:teuthology.orchestra.run.smithi172:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-20T02:38:37.300 INFO:teuthology.provision.fog.smithi172:Node is ready 2023-07-20T02:38:37.301 DEBUG:teuthology.orchestra.run.smithi172:> hostname 2023-07-20T02:38:37.320 INFO:teuthology.orchestra.run.smithi172.stdout:smithi172.front.sepia.ceph.com 2023-07-20T02:38:37.321 DEBUG:teuthology.orchestra.run.smithi172:> grep smithi172.front.sepia.ceph.com /etc/hosts 2023-07-20T02:38:37.380 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.15.172 smithi172.front.sepia.ceph.com smithi172 2023-07-20T02:38:37.381 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname smithi172 2023-07-20T02:38:37.521 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/smithi172.front.sepia.ceph.com/smithi172/g' /etc/hosts 2023-07-20T02:38:37.550 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/172.21.15.172/172.21.15.172/g' /etc/hosts 2023-07-20T02:38:37.618 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/smithi172.front.sepia.ceph.com/smithi172/g' /etc/hostname 2023-07-20T02:38:37.687 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname smithi172 2023-07-20T02:38:37.754 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2023-07-20T02:38:37.811 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="Red Hat Enterprise Linux" 2023-07-20T02:38:37.812 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="8.6 (Ootpa)" 2023-07-20T02:38:37.812 INFO:teuthology.orchestra.run.smithi172.stdout:ID="rhel" 2023-07-20T02:38:37.812 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="fedora" 2023-07-20T02:38:37.812 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="8.6" 2023-07-20T02:38:37.813 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el8" 2023-07-20T02:38:37.813 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-20T02:38:37.813 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2023-07-20T02:38:37.814 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-20T02:38:37.814 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://www.redhat.com/" 2023-07-20T02:38:37.815 INFO:teuthology.orchestra.run.smithi172.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-20T02:38:37.815 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-20T02:38:37.816 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-07-20T02:38:37.816 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-20T02:38:37.816 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-20T02:38:37.817 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-20T02:38:37.817 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-20T02:38:37.818 INFO:teuthology.provision.fog.smithi172:Deploy complete! 2023-07-20T02:38:37.818 DEBUG:teuthology.parallel:result is None 2023-07-20T02:38:38.006 INFO:teuthology.lock.ops:Checking smithi138.front.sepia.ceph.com 2023-07-20T02:38:38.007 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-20T02:38:38.040 INFO:teuthology.lock.ops:Checking smithi149.front.sepia.ceph.com 2023-07-20T02:38:38.040 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-20T02:38:38.064 INFO:teuthology.lock.ops:Checking smithi172.front.sepia.ceph.com 2023-07-20T02:38:38.065 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-20T02:38:38.090 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: set os type and version on server 2023-07-20T02:38:38.091 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2023-07-20T02:38:38.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:38:38.158 DEBUG:teuthology.orchestra.run.smithi138:> true 2023-07-20T02:38:38.290 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2023-07-20T02:38:38.290 DEBUG:teuthology.orchestra.run.smithi138:> uname -m 2023-07-20T02:38:38.348 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64 2023-07-20T02:38:38.349 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2023-07-20T02:38:38.405 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="Red Hat Enterprise Linux" 2023-07-20T02:38:38.406 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="8.6 (Ootpa)" 2023-07-20T02:38:38.406 INFO:teuthology.orchestra.run.smithi138.stdout:ID="rhel" 2023-07-20T02:38:38.406 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="fedora" 2023-07-20T02:38:38.406 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="8.6" 2023-07-20T02:38:38.406 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el8" 2023-07-20T02:38:38.407 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-20T02:38:38.407 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31" 2023-07-20T02:38:38.407 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-20T02:38:38.407 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://www.redhat.com/" 2023-07-20T02:38:38.407 INFO:teuthology.orchestra.run.smithi138.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-20T02:38:38.407 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-20T02:38:38.407 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-07-20T02:38:38.408 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-20T02:38:38.408 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-20T02:38:38.408 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-20T02:38:38.408 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-20T02:38:38.409 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2023-07-20T02:38:38.430 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: set os type and version on server 2023-07-20T02:38:38.431 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-07-20T02:38:38.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:38:38.497 DEBUG:teuthology.orchestra.run.smithi149:> true 2023-07-20T02:38:38.568 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-07-20T02:38:38.568 DEBUG:teuthology.orchestra.run.smithi149:> uname -m 2023-07-20T02:38:38.627 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64 2023-07-20T02:38:38.627 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2023-07-20T02:38:38.686 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="Red Hat Enterprise Linux" 2023-07-20T02:38:38.687 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="8.6 (Ootpa)" 2023-07-20T02:38:38.687 INFO:teuthology.orchestra.run.smithi149.stdout:ID="rhel" 2023-07-20T02:38:38.687 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="fedora" 2023-07-20T02:38:38.687 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="8.6" 2023-07-20T02:38:38.688 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el8" 2023-07-20T02:38:38.688 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-20T02:38:38.688 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2023-07-20T02:38:38.688 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-20T02:38:38.689 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://www.redhat.com/" 2023-07-20T02:38:38.689 INFO:teuthology.orchestra.run.smithi149.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-20T02:38:38.689 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-20T02:38:38.689 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-07-20T02:38:38.690 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-20T02:38:38.690 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-20T02:38:38.690 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-20T02:38:38.691 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-20T02:38:38.691 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2023-07-20T02:38:38.714 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: set os type and version on server 2023-07-20T02:38:38.714 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-07-20T02:38:38.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:38:38.782 DEBUG:teuthology.orchestra.run.smithi172:> true 2023-07-20T02:38:38.855 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-07-20T02:38:38.856 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2023-07-20T02:38:38.914 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2023-07-20T02:38:38.915 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2023-07-20T02:38:38.974 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="Red Hat Enterprise Linux" 2023-07-20T02:38:38.974 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="8.6 (Ootpa)" 2023-07-20T02:38:38.975 INFO:teuthology.orchestra.run.smithi172.stdout:ID="rhel" 2023-07-20T02:38:38.975 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="fedora" 2023-07-20T02:38:38.975 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="8.6" 2023-07-20T02:38:38.975 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el8" 2023-07-20T02:38:38.976 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-20T02:38:38.976 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2023-07-20T02:38:38.976 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-20T02:38:38.976 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://www.redhat.com/" 2023-07-20T02:38:38.976 INFO:teuthology.orchestra.run.smithi172.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-20T02:38:38.976 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-20T02:38:38.976 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-07-20T02:38:38.977 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-20T02:38:38.977 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-20T02:38:38.977 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-20T02:38:38.978 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-20T02:38:38.978 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2023-07-20T02:38:39.006 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:38:39.007 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:38:39.120 INFO:teuthology.dispatcher.supervisor:Running job 7344314 2023-07-20T02:38:39.120 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-07-20_00:39:06-fs:workload-wip-pdonnell-testing-20230719.201220-distro-default-smithi/7344314 --name pdonnell-2023-07-20_00:39:06-fs:workload-wip-pdonnell-testing-20230719.201220-distro-default-smithi --description fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/distributed export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/suites/blogbench}} -- /home/teuthworker/archive/pdonnell-2023-07-20_00:39:06-fs:workload-wip-pdonnell-testing-20230719.201220-distro-default-smithi/7344314/orig.config.yaml 2023-07-20T02:38:39.125 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-07-20_00:39:06-fs:workload-wip-pdonnell-testing-20230719.201220-distro-default-smithi/7344314 2023-07-20T02:38:39.126 INFO:teuthology.dispatcher.supervisor:Job PID: 12428 2023-07-20T02:38:39.126 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-20T02:40:39.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:40:39.226 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:42:39.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:42:39.410 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:44:39.589 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:44:39.589 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:46:39.766 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:46:39.767 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:48:39.941 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:48:39.941 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:50:40.125 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:50:40.125 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:52:40.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:52:40.302 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:54:40.468 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:54:40.469 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:56:40.642 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:56:40.643 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:58:40.817 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:58:40.818 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T03:00:40.993 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T03:00:40.994 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T03:02:41.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T03:02:41.170 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T03:04:41.334 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T03:04:41.335 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T03:06:41.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T03:06:41.498 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T03:08:41.664 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T03:08:41.665 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T03:10:41.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T03:10:41.837 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T03:12:42.013 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T03:12:42.015 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T03:14:42.197 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T03:14:42.197 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T03:16:42.382 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T03:16:42.383 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T03:18:42.554 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T03:18:42.555 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T03:20:42.761 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T03:20:42.761 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T03:20:42.832 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-20T03:20:42.999 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-20T03:20:43.001 INFO:teuthology.nuke:Checking targets against current locks 2023-07-20T03:20:43.060 DEBUG:teuthology.nuke:shortname: smithi138 2023-07-20T03:20:43.061 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-20T03:20:43.087 DEBUG:teuthology.nuke:shortname: smithi149 2023-07-20T03:20:43.088 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-20T03:20:43.090 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi138.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-20_00:39:06-fs:workload-wip-pdonnell-testing-20230719.201220-distro-default-smithi/7344314', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-20 02:33:22.948860', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-20T03:20:43.107 DEBUG:teuthology.nuke:shortname: smithi172 2023-07-20T03:20:43.107 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-20T03:20:43.110 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-20_00:39:06-fs:workload-wip-pdonnell-testing-20230719.201220-distro-default-smithi/7344314', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-20 02:33:22.944876', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-20T03:20:43.131 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-20_00:39:06-fs:workload-wip-pdonnell-testing-20230719.201220-distro-default-smithi/7344314', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-20 02:33:22.947104', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-20T03:20:43.145 INFO:teuthology.orchestra.console:Power off smithi138 2023-07-20T03:20:43.146 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T03:20:43.168 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T03:20:43.192 INFO:teuthology.orchestra.console:Power off smithi149 2023-07-20T03:20:43.193 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T03:20:43.217 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T03:20:43.237 INFO:teuthology.orchestra.console:Power off smithi172 2023-07-20T03:20:43.238 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T03:20:43.261 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T03:20:43.305 INFO:teuthology.orchestra.console:Power off for smithi138 completed 2023-07-20T03:20:43.349 INFO:teuthology.orchestra.console:Power off for smithi149 completed 2023-07-20T03:20:43.387 INFO:teuthology.orchestra.console:Power off for smithi172 completed 2023-07-20T03:20:43.473 INFO:teuthology.lock.ops:unlocked: smithi138.front.sepia.ceph.com 2023-07-20T03:20:43.498 INFO:teuthology.lock.ops:unlocked: smithi149.front.sepia.ceph.com 2023-07-20T03:20:43.539 INFO:teuthology.lock.ops:unlocked: smithi172.front.sepia.ceph.com