2023-07-28T11:36:12.768 INFO:root:teuthology version: 0.0.1.dev165+g3117e89 2023-07-28T11:36:12.770 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-28T11:36:12.770 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-28T11:36:12.994 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7efcb73cc5e0>, signals=[15]) 2023-07-28T11:36:12.996 INFO:teuthology.lock.ops:Start node 'smithi101.front.sepia.ceph.com' reimaging 2023-07-28T11:36:12.996 INFO:teuthology.lock.ops:Updating [smithi101.front.sepia.ceph.com]: reset os type and version on server 2023-07-28T11:36:12.997 INFO:teuthology.lock.ops:Updating smithi101.front.sepia.ceph.com on lock server 2023-07-28T11:36:13.021 INFO:teuthology.lock.ops:Start node 'smithi102.front.sepia.ceph.com' reimaging 2023-07-28T11:36:13.021 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: reset os type and version on server 2023-07-28T11:36:13.022 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2023-07-28T11:36:13.023 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /host {"name": "smithi101"} 2023-07-28T11:36:13.045 INFO:teuthology.lock.ops:Start node 'smithi190.front.sepia.ceph.com' reimaging 2023-07-28T11:36:13.046 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: reset os type and version on server 2023-07-28T11:36:13.046 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2023-07-28T11:36:13.047 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /host {"name": "smithi102"} 2023-07-28T11:36:13.070 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /host {"name": "smithi190"} 2023-07-28T11:36:13.096 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-28T11:36:13.133 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-28T11:36:13.140 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-28T11:36:13.144 DEBUG:teuthology.provision.fog.smithi101:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-28T11:36:13.144 DEBUG:teuthology.provision.fog.smithi101:FOG request: PUT /host/206 {"imageID": 5} 2023-07-28T11:36:13.168 DEBUG:teuthology.provision.fog.smithi102:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-28T11:36:13.168 DEBUG:teuthology.provision.fog.smithi102:FOG request: PUT /host/207 {"imageID": 5} 2023-07-28T11:36:13.177 DEBUG:teuthology.provision.fog.smithi190:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-28T11:36:13.177 DEBUG:teuthology.provision.fog.smithi190:FOG request: PUT /host/295 {"imageID": 5} 2023-07-28T11:36:13.186 INFO:teuthology.provision.fog.smithi101:Scheduling deploy of rhel 8.6 2023-07-28T11:36:13.187 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-28T11:36:13.212 INFO:teuthology.provision.fog.smithi102:Scheduling deploy of rhel 8.6 2023-07-28T11:36:13.213 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-28T11:36:13.215 INFO:teuthology.provision.fog.smithi190:Scheduling deploy of rhel 8.6 2023-07-28T11:36:13.215 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-07-28T11:36:13.223 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /tasktype {"name": "deploy"} 2023-07-28T11:36:13.254 DEBUG:teuthology.provision.fog.smithi101:FOG request: POST /host/206/task {"taskTypeID": 1} 2023-07-28T11:36:13.257 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /tasktype {"name": "deploy"} 2023-07-28T11:36:13.260 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /tasktype {"name": "deploy"} 2023-07-28T11:36:13.288 DEBUG:teuthology.provision.fog.smithi190:FOG request: POST /host/295/task {"taskTypeID": 1} 2023-07-28T11:36:13.290 DEBUG:teuthology.provision.fog.smithi102:FOG request: POST /host/207/task {"taskTypeID": 1} 2023-07-28T11:36:13.312 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-28T11:36:13.332 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-07-28T11:36:13.350 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-28T11:36:13.388 INFO:teuthology.orchestra.console.smithi101:Power off 2023-07-28T11:36:13.389 DEBUG:teuthology.orchestra.console.smithi101:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-28T11:36:13.411 DEBUG:teuthology.orchestra.console.smithi101:power off output: Chassis Power Control: Down/Off 2023-07-28T11:36:13.412 DEBUG:teuthology.orchestra.console.smithi101:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T11:36:13.428 INFO:teuthology.orchestra.console.smithi190:Power off 2023-07-28T11:36:13.428 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-28T11:36:13.445 INFO:teuthology.orchestra.console.smithi102:Power off 2023-07-28T11:36:13.446 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-28T11:36:13.454 DEBUG:teuthology.orchestra.console.smithi101:check power output: Chassis Power is off 2023-07-28T11:36:13.456 DEBUG:teuthology.orchestra.console.smithi190:power off output: Chassis Power Control: Down/Off 2023-07-28T11:36:13.457 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T11:36:13.467 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off 2023-07-28T11:36:13.468 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T11:36:13.479 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-07-28T11:36:13.487 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2023-07-28T11:36:13.556 INFO:teuthology.orchestra.console.smithi101:Power off completed 2023-07-28T11:36:13.656 INFO:teuthology.orchestra.console.smithi101:Power on 2023-07-28T11:36:13.657 DEBUG:teuthology.orchestra.console.smithi101:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-28T11:36:13.678 DEBUG:teuthology.orchestra.console.smithi101:power on output: Chassis Power Control: Up/On 2023-07-28T11:36:13.679 DEBUG:teuthology.orchestra.console.smithi101:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T11:36:13.699 DEBUG:teuthology.orchestra.console.smithi101:check power output: Chassis Power is off 2023-07-28T11:36:17.483 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T11:36:17.492 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T11:36:17.595 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-07-28T11:36:17.605 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2023-07-28T11:36:17.701 DEBUG:teuthology.orchestra.console.smithi101:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T11:36:17.811 DEBUG:teuthology.orchestra.console.smithi101:check power output: Chassis Power is on 2023-07-28T11:36:17.912 INFO:teuthology.orchestra.console.smithi101:Power on completed 2023-07-28T11:36:18.012 INFO:teuthology.provision.fog.smithi101:Waiting for deploy to finish 2023-07-28T11:36:18.013 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-28T11:36:21.599 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T11:36:21.608 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T11:36:21.710 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-07-28T11:36:21.718 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2023-07-28T11:36:21.812 INFO:teuthology.orchestra.console.smithi190:Power off completed 2023-07-28T11:36:21.820 INFO:teuthology.orchestra.console.smithi102:Power off completed 2023-07-28T11:36:21.913 INFO:teuthology.orchestra.console.smithi190:Power on 2023-07-28T11:36:21.914 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-28T11:36:21.922 INFO:teuthology.orchestra.console.smithi102:Power on 2023-07-28T11:36:21.923 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-28T11:36:21.934 DEBUG:teuthology.orchestra.console.smithi190:power on output: Chassis Power Control: Up/On 2023-07-28T11:36:21.935 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T11:36:21.945 DEBUG:teuthology.orchestra.console.smithi102:power on output: Chassis Power Control: Up/On 2023-07-28T11:36:21.946 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T11:36:21.956 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-07-28T11:36:21.967 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2023-07-28T11:36:25.960 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T11:36:25.967 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T11:36:26.069 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-07-28T11:36:26.077 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2023-07-28T11:36:26.171 INFO:teuthology.orchestra.console.smithi190:Power on completed 2023-07-28T11:36:26.272 INFO:teuthology.provision.fog.smithi190:Waiting for deploy to finish 2023-07-28T11:36:26.273 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-07-28T11:36:30.082 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T11:36:30.192 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2023-07-28T11:36:30.293 INFO:teuthology.orchestra.console.smithi102:Power on completed 2023-07-28T11:36:30.394 INFO:teuthology.provision.fog.smithi102:Waiting for deploy to finish 2023-07-28T11:36:30.394 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-28T11:36:33.068 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-28T11:36:41.333 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-07-28T11:36:45.451 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-28T11:36:48.126 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-28T11:36:56.406 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-07-28T11:37:00.515 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-28T11:37:03.189 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-28T11:37:11.469 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-07-28T11:37:15.569 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-28T11:37:18.240 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-28T11:37:26.531 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-07-28T11:37:30.622 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-28T11:37:33.297 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-28T11:37:41.592 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-07-28T11:37:45.687 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-28T11:37:48.356 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-28T11:37:56.652 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-07-28T11:38:00.744 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-28T11:38:03.409 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-28T11:38:11.712 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-07-28T11:38:15.800 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-28T11:38:18.460 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-28T11:38:26.774 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-07-28T11:38:30.860 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-28T11:38:33.513 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-28T11:38:41.844 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-07-28T11:38:45.913 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-28T11:38:48.564 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-28T11:38:56.900 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-07-28T11:39:00.968 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-28T11:39:03.619 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-28T11:39:03.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T11:39:11.960 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-07-28T11:39:12.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T11:39:16.020 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-28T11:39:16.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T11:39:22.096 WARNING:teuthology.provision.fog.smithi101:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-07-28T11:39:28.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T11:39:30.544 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-07-28T11:39:31.184 WARNING:teuthology.provision.fog.smithi101:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-07-28T11:39:34.384 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-07-28T11:39:36.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T11:39:37.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T11:39:39.600 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-07-28T11:39:40.240 WARNING:teuthology.provision.fog.smithi101:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-07-28T11:39:40.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T11:39:43.440 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-07-28T11:39:45.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T11:39:46.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T11:39:48.656 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-07-28T11:39:49.296 WARNING:teuthology.provision.fog.smithi101:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-07-28T11:39:49.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T11:39:52.496 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-07-28T11:39:54.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T11:39:55.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T11:39:57.712 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-07-28T11:39:58.352 WARNING:teuthology.provision.fog.smithi101:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-07-28T11:39:58.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T11:40:01.556 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-07-28T11:40:03.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T11:40:04.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T11:40:07.561 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T11:41:03.772 WARNING:teuthology.provision.fog.smithi190:timed out 2023-07-28T11:41:04.357 WARNING:teuthology.provision.fog.smithi101:timed out 2023-07-28T11:41:07.565 WARNING:teuthology.provision.fog.smithi102:timed out 2023-07-28T11:41:09.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T11:41:10.146 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-28T11:41:10.146 DEBUG:teuthology.orchestra.run.smithi190:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-28T11:41:10.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T11:41:10.452 INFO:teuthology.provision.fog.smithi190:Node is ready 2023-07-28T11:41:10.453 DEBUG:teuthology.orchestra.run.smithi190:> hostname 2023-07-28T11:41:10.471 INFO:teuthology.orchestra.run.smithi190.stdout:smithi190.front.sepia.ceph.com 2023-07-28T11:41:10.472 DEBUG:teuthology.orchestra.run.smithi190:> grep smithi190.front.sepia.ceph.com /etc/hosts 2023-07-28T11:41:10.530 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.15.190 smithi190.front.sepia.ceph.com smithi190 2023-07-28T11:41:10.530 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190 2023-07-28T11:41:10.653 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi190.front.sepia.ceph.com/smithi190/g' /etc/hosts 2023-07-28T11:41:10.678 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-28T11:41:10.678 DEBUG:teuthology.orchestra.run.smithi101:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-28T11:41:10.680 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/172.21.15.190/172.21.15.190/g' /etc/hosts 2023-07-28T11:41:10.747 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi190.front.sepia.ceph.com/smithi190/g' /etc/hostname 2023-07-28T11:41:10.813 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190 2023-07-28T11:41:10.879 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2023-07-28T11:41:10.935 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="Red Hat Enterprise Linux" 2023-07-28T11:41:10.935 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="8.6 (Ootpa)" 2023-07-28T11:41:10.935 INFO:teuthology.orchestra.run.smithi190.stdout:ID="rhel" 2023-07-28T11:41:10.935 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="fedora" 2023-07-28T11:41:10.935 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="8.6" 2023-07-28T11:41:10.935 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el8" 2023-07-28T11:41:10.936 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-28T11:41:10.936 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2023-07-28T11:41:10.936 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-28T11:41:10.936 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.redhat.com/" 2023-07-28T11:41:10.936 INFO:teuthology.orchestra.run.smithi190.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-28T11:41:10.936 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-28T11:41:10.936 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-07-28T11:41:10.937 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-28T11:41:10.937 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-28T11:41:10.937 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-28T11:41:10.937 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-28T11:41:10.938 INFO:teuthology.provision.fog.smithi190:Deploy complete! 2023-07-28T11:41:10.939 DEBUG:teuthology.parallel:result is None 2023-07-28T11:41:10.958 INFO:teuthology.provision.fog.smithi101:Node is ready 2023-07-28T11:41:10.958 DEBUG:teuthology.orchestra.run.smithi101:> hostname 2023-07-28T11:41:10.975 INFO:teuthology.orchestra.run.smithi101.stdout:smithi101.front.sepia.ceph.com 2023-07-28T11:41:10.976 DEBUG:teuthology.orchestra.run.smithi101:> grep smithi101.front.sepia.ceph.com /etc/hosts 2023-07-28T11:41:11.030 INFO:teuthology.orchestra.run.smithi101.stdout:172.21.15.101 smithi101.front.sepia.ceph.com smithi101 2023-07-28T11:41:11.030 DEBUG:teuthology.orchestra.run.smithi101:> sudo hostname smithi101 2023-07-28T11:41:11.138 DEBUG:teuthology.orchestra.run.smithi101:> sudo sed -i -e 's/smithi101.front.sepia.ceph.com/smithi101/g' /etc/hosts 2023-07-28T11:41:11.166 DEBUG:teuthology.orchestra.run.smithi101:> sudo sed -i -e 's/172.21.15.101/172.21.15.101/g' /etc/hosts 2023-07-28T11:41:11.231 DEBUG:teuthology.orchestra.run.smithi101:> sudo sed -i -e 's/smithi101.front.sepia.ceph.com/smithi101/g' /etc/hostname 2023-07-28T11:41:11.294 DEBUG:teuthology.orchestra.run.smithi101:> sudo hostname smithi101 2023-07-28T11:41:11.357 DEBUG:teuthology.orchestra.run.smithi101:> cat /etc/os-release 2023-07-28T11:41:11.411 INFO:teuthology.orchestra.run.smithi101.stdout:NAME="Red Hat Enterprise Linux" 2023-07-28T11:41:11.411 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION="8.6 (Ootpa)" 2023-07-28T11:41:11.411 INFO:teuthology.orchestra.run.smithi101.stdout:ID="rhel" 2023-07-28T11:41:11.411 INFO:teuthology.orchestra.run.smithi101.stdout:ID_LIKE="fedora" 2023-07-28T11:41:11.411 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION_ID="8.6" 2023-07-28T11:41:11.412 INFO:teuthology.orchestra.run.smithi101.stdout:PLATFORM_ID="platform:el8" 2023-07-28T11:41:11.412 INFO:teuthology.orchestra.run.smithi101.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-28T11:41:11.412 INFO:teuthology.orchestra.run.smithi101.stdout:ANSI_COLOR="0;31" 2023-07-28T11:41:11.412 INFO:teuthology.orchestra.run.smithi101.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-28T11:41:11.412 INFO:teuthology.orchestra.run.smithi101.stdout:HOME_URL="https://www.redhat.com/" 2023-07-28T11:41:11.412 INFO:teuthology.orchestra.run.smithi101.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-28T11:41:11.412 INFO:teuthology.orchestra.run.smithi101.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-28T11:41:11.413 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-07-28T11:41:11.413 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-28T11:41:11.413 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-28T11:41:11.413 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-28T11:41:11.413 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-28T11:41:11.413 INFO:teuthology.provision.fog.smithi101:Deploy complete! 2023-07-28T11:41:11.414 DEBUG:teuthology.parallel:result is None 2023-07-28T11:41:13.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T11:41:13.796 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-28T11:41:13.796 DEBUG:teuthology.orchestra.run.smithi102:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-28T11:41:14.111 INFO:teuthology.provision.fog.smithi102:Node is ready 2023-07-28T11:41:14.111 DEBUG:teuthology.orchestra.run.smithi102:> hostname 2023-07-28T11:41:14.130 INFO:teuthology.orchestra.run.smithi102.stdout:smithi102.front.sepia.ceph.com 2023-07-28T11:41:14.130 DEBUG:teuthology.orchestra.run.smithi102:> grep smithi102.front.sepia.ceph.com /etc/hosts 2023-07-28T11:41:14.189 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.102 smithi102.front.sepia.ceph.com smithi102 2023-07-28T11:41:14.190 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102 2023-07-28T11:41:14.317 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hosts 2023-07-28T11:41:14.350 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/172.21.15.102/172.21.15.102/g' /etc/hosts 2023-07-28T11:41:14.422 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hostname 2023-07-28T11:41:14.494 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102 2023-07-28T11:41:14.565 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2023-07-28T11:41:14.624 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="Red Hat Enterprise Linux" 2023-07-28T11:41:14.625 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="8.6 (Ootpa)" 2023-07-28T11:41:14.625 INFO:teuthology.orchestra.run.smithi102.stdout:ID="rhel" 2023-07-28T11:41:14.625 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="fedora" 2023-07-28T11:41:14.625 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="8.6" 2023-07-28T11:41:14.625 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el8" 2023-07-28T11:41:14.625 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-28T11:41:14.626 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2023-07-28T11:41:14.626 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-28T11:41:14.626 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://www.redhat.com/" 2023-07-28T11:41:14.626 INFO:teuthology.orchestra.run.smithi102.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-28T11:41:14.626 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-28T11:41:14.626 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-07-28T11:41:14.626 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-28T11:41:14.627 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-28T11:41:14.627 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-28T11:41:14.627 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-28T11:41:14.627 INFO:teuthology.provision.fog.smithi102:Deploy complete! 2023-07-28T11:41:14.628 DEBUG:teuthology.parallel:result is None 2023-07-28T11:41:14.812 INFO:teuthology.lock.ops:Checking smithi101.front.sepia.ceph.com 2023-07-28T11:41:14.814 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-28T11:41:14.840 INFO:teuthology.lock.ops:Checking smithi102.front.sepia.ceph.com 2023-07-28T11:41:14.841 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-28T11:41:14.865 INFO:teuthology.lock.ops:Checking smithi190.front.sepia.ceph.com 2023-07-28T11:41:14.865 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-28T11:41:14.883 INFO:teuthology.lock.ops:Updating [smithi101.front.sepia.ceph.com]: set os type and version on server 2023-07-28T11:41:14.883 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi101.front.sepia.ceph.com' 2023-07-28T11:41:14.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T11:41:14.950 DEBUG:teuthology.orchestra.run.smithi101:> true 2023-07-28T11:41:15.019 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi101.front.sepia.ceph.com' 2023-07-28T11:41:15.020 DEBUG:teuthology.orchestra.run.smithi101:> uname -m 2023-07-28T11:41:15.078 INFO:teuthology.orchestra.run.smithi101.stdout:x86_64 2023-07-28T11:41:15.078 DEBUG:teuthology.orchestra.run.smithi101:> cat /etc/os-release 2023-07-28T11:41:15.135 INFO:teuthology.orchestra.run.smithi101.stdout:NAME="Red Hat Enterprise Linux" 2023-07-28T11:41:15.136 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION="8.6 (Ootpa)" 2023-07-28T11:41:15.136 INFO:teuthology.orchestra.run.smithi101.stdout:ID="rhel" 2023-07-28T11:41:15.136 INFO:teuthology.orchestra.run.smithi101.stdout:ID_LIKE="fedora" 2023-07-28T11:41:15.136 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION_ID="8.6" 2023-07-28T11:41:15.136 INFO:teuthology.orchestra.run.smithi101.stdout:PLATFORM_ID="platform:el8" 2023-07-28T11:41:15.136 INFO:teuthology.orchestra.run.smithi101.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-28T11:41:15.137 INFO:teuthology.orchestra.run.smithi101.stdout:ANSI_COLOR="0;31" 2023-07-28T11:41:15.137 INFO:teuthology.orchestra.run.smithi101.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-28T11:41:15.137 INFO:teuthology.orchestra.run.smithi101.stdout:HOME_URL="https://www.redhat.com/" 2023-07-28T11:41:15.137 INFO:teuthology.orchestra.run.smithi101.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-28T11:41:15.137 INFO:teuthology.orchestra.run.smithi101.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-28T11:41:15.137 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-07-28T11:41:15.137 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-28T11:41:15.137 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-28T11:41:15.138 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-28T11:41:15.138 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-28T11:41:15.138 INFO:teuthology.lock.ops:Updating smithi101.front.sepia.ceph.com on lock server 2023-07-28T11:41:15.165 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: set os type and version on server 2023-07-28T11:41:15.166 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-07-28T11:41:15.166 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T11:41:15.234 DEBUG:teuthology.orchestra.run.smithi102:> true 2023-07-28T11:41:15.303 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-07-28T11:41:15.304 DEBUG:teuthology.orchestra.run.smithi102:> uname -m 2023-07-28T11:41:15.366 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64 2023-07-28T11:41:15.367 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2023-07-28T11:41:15.429 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="Red Hat Enterprise Linux" 2023-07-28T11:41:15.430 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="8.6 (Ootpa)" 2023-07-28T11:41:15.430 INFO:teuthology.orchestra.run.smithi102.stdout:ID="rhel" 2023-07-28T11:41:15.430 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="fedora" 2023-07-28T11:41:15.430 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="8.6" 2023-07-28T11:41:15.430 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el8" 2023-07-28T11:41:15.430 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-28T11:41:15.430 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2023-07-28T11:41:15.431 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-28T11:41:15.431 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://www.redhat.com/" 2023-07-28T11:41:15.431 INFO:teuthology.orchestra.run.smithi102.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-28T11:41:15.431 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-28T11:41:15.431 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-07-28T11:41:15.431 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-28T11:41:15.431 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-28T11:41:15.431 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-28T11:41:15.432 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-28T11:41:15.432 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2023-07-28T11:41:15.457 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: set os type and version on server 2023-07-28T11:41:15.457 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-07-28T11:41:15.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T11:41:15.527 DEBUG:teuthology.orchestra.run.smithi190:> true 2023-07-28T11:41:15.595 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-07-28T11:41:15.595 DEBUG:teuthology.orchestra.run.smithi190:> uname -m 2023-07-28T11:41:15.658 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64 2023-07-28T11:41:15.659 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2023-07-28T11:41:15.722 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="Red Hat Enterprise Linux" 2023-07-28T11:41:15.722 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="8.6 (Ootpa)" 2023-07-28T11:41:15.722 INFO:teuthology.orchestra.run.smithi190.stdout:ID="rhel" 2023-07-28T11:41:15.723 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="fedora" 2023-07-28T11:41:15.723 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="8.6" 2023-07-28T11:41:15.723 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el8" 2023-07-28T11:41:15.723 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-28T11:41:15.723 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2023-07-28T11:41:15.723 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-28T11:41:15.723 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.redhat.com/" 2023-07-28T11:41:15.724 INFO:teuthology.orchestra.run.smithi190.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-28T11:41:15.724 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-28T11:41:15.724 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-07-28T11:41:15.724 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-28T11:41:15.724 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-28T11:41:15.724 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-28T11:41:15.724 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-28T11:41:15.725 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2023-07-28T11:41:15.748 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-28T11:41:15.749 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-28T11:41:15.852 INFO:teuthology.dispatcher.supervisor:Running job 7355101 2023-07-28T11:41:15.852 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-07-28_06:48:51-fs-wip-vshankar-testing-20230727.111459-testing-default-smithi/7355101 --name vshankar-2023-07-28_06:48:51-fs-wip-vshankar-testing-20230727.111459-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/fs/misc}} -- /home/teuthworker/archive/vshankar-2023-07-28_06:48:51-fs-wip-vshankar-testing-20230727.111459-testing-default-smithi/7355101/orig.config.yaml 2023-07-28T11:41:15.855 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-07-28_06:48:51-fs-wip-vshankar-testing-20230727.111459-testing-default-smithi/7355101 2023-07-28T11:41:15.856 INFO:teuthology.dispatcher.supervisor:Job PID: 5641 2023-07-28T11:41:15.856 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-28T11:43:15.946 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-28T11:43:15.947 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-28T11:45:16.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-28T11:45:16.129 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-28T11:47:16.296 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-28T11:47:16.297 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-28T11:49:16.457 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-28T11:49:16.458 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-28T11:51:16.624 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-28T11:51:16.625 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-28T11:53:16.792 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-28T11:53:16.793 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-28T11:55:16.951 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-28T11:55:16.952 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-28T11:57:17.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-28T11:57:17.114 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-28T11:59:17.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-28T11:59:17.276 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-28T12:01:17.441 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-28T12:01:17.441 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-28T12:03:17.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-28T12:03:17.610 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-28T12:05:17.744 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-28T12:05:17.744 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-28T12:07:17.917 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-28T12:07:17.917 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-28T12:09:18.089 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-28T12:09:18.089 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-28T12:11:18.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-28T12:11:18.253 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-28T12:11:18.322 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-28T12:11:18.564 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-28T12:11:18.565 INFO:teuthology.nuke:Checking targets against current locks 2023-07-28T12:11:18.614 DEBUG:teuthology.nuke:shortname: smithi101 2023-07-28T12:11:18.615 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-28T12:11:18.641 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi101.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-28_06:48:51-fs-wip-vshankar-testing-20230727.111459-testing-default-smithi/7355101', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-28 11:36:11.967235', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-28T12:11:18.646 DEBUG:teuthology.nuke:shortname: smithi102 2023-07-28T12:11:18.646 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-28T12:11:18.668 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-28_06:48:51-fs-wip-vshankar-testing-20230727.111459-testing-default-smithi/7355101', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-28 11:36:11.969376', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-28T12:11:18.671 DEBUG:teuthology.nuke:shortname: smithi190 2023-07-28T12:11:18.671 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-28T12:11:18.696 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi190.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-28_06:48:51-fs-wip-vshankar-testing-20230727.111459-testing-default-smithi/7355101', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-28 11:36:11.971164', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-28T12:11:18.705 INFO:teuthology.orchestra.console.smithi101:Power off 2023-07-28T12:11:18.706 DEBUG:teuthology.orchestra.console.smithi101:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-28T12:11:18.729 DEBUG:teuthology.orchestra.console.smithi101:power off output: Chassis Power Control: Down/Off 2023-07-28T12:11:18.730 DEBUG:teuthology.orchestra.console.smithi101:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T12:11:18.749 INFO:teuthology.orchestra.console.smithi102:Power off 2023-07-28T12:11:18.750 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-28T12:11:18.762 DEBUG:teuthology.orchestra.console.smithi101:check power output: Chassis Power is off 2023-07-28T12:11:18.773 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off 2023-07-28T12:11:18.774 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T12:11:18.794 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2023-07-28T12:11:18.815 INFO:teuthology.orchestra.console.smithi190:Power off 2023-07-28T12:11:18.816 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-28T12:11:18.838 DEBUG:teuthology.orchestra.console.smithi190:power off output: Chassis Power Control: Down/Off 2023-07-28T12:11:18.838 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T12:11:18.859 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-07-28T12:11:18.863 INFO:teuthology.orchestra.console.smithi101:Power off completed 2023-07-28T12:11:18.895 INFO:teuthology.orchestra.console.smithi102:Power off completed 2023-07-28T12:11:18.960 INFO:teuthology.orchestra.console.smithi190:Power off completed 2023-07-28T12:11:19.019 INFO:teuthology.lock.ops:unlocked: smithi101.front.sepia.ceph.com 2023-07-28T12:11:19.044 INFO:teuthology.lock.ops:unlocked: smithi102.front.sepia.ceph.com 2023-07-28T12:11:19.111 INFO:teuthology.lock.ops:unlocked: smithi190.front.sepia.ceph.com