2023-10-06T21:37:24.079 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-06T21:37:24.080 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T21:37:24.259 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f39d5f72dc0>, signals=[15]) 2023-10-06T21:37:24.260 INFO:teuthology.lock.ops:Start node 'smithi057.front.sepia.ceph.com' reimaging 2023-10-06T21:37:24.260 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: reset os type and version on server 2023-10-06T21:37:24.260 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2023-10-06T21:37:24.281 INFO:teuthology.lock.ops:Start node 'smithi156.front.sepia.ceph.com' reimaging 2023-10-06T21:37:24.282 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: reset os type and version on server 2023-10-06T21:37:24.282 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2023-10-06T21:37:24.284 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /host {"name": "smithi057"} 2023-10-06T21:37:24.306 INFO:teuthology.lock.ops:Start node 'smithi190.front.sepia.ceph.com' reimaging 2023-10-06T21:37:24.306 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: reset os type and version on server 2023-10-06T21:37:24.306 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2023-10-06T21:37:24.308 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /host {"name": "smithi156"} 2023-10-06T21:37:24.330 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /host {"name": "smithi190"} 2023-10-06T21:37:24.361 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-10-06T21:37:24.376 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-10-06T21:37:24.399 DEBUG:teuthology.provision.fog.smithi057:Requesting image smithi_rhel_8.6 (ID 5) 2023-10-06T21:37:24.399 DEBUG:teuthology.provision.fog.smithi057:FOG request: PUT /host/162 {"imageID": 5} 2023-10-06T21:37:24.405 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-10-06T21:37:24.426 DEBUG:teuthology.provision.fog.smithi156:Requesting image smithi_rhel_8.6 (ID 5) 2023-10-06T21:37:24.426 DEBUG:teuthology.provision.fog.smithi156:FOG request: PUT /host/261 {"imageID": 5} 2023-10-06T21:37:24.443 DEBUG:teuthology.provision.fog.smithi190:Requesting image smithi_rhel_8.6 (ID 5) 2023-10-06T21:37:24.443 DEBUG:teuthology.provision.fog.smithi190:FOG request: PUT /host/295 {"imageID": 5} 2023-10-06T21:37:24.446 INFO:teuthology.provision.fog.smithi057:Scheduling deploy of rhel 8.6 2023-10-06T21:37:24.446 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-06T21:37:24.482 INFO:teuthology.provision.fog.smithi190:Scheduling deploy of rhel 8.6 2023-10-06T21:37:24.482 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-06T21:37:24.485 INFO:teuthology.provision.fog.smithi156:Scheduling deploy of rhel 8.6 2023-10-06T21:37:24.485 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-10-06T21:37:24.513 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /tasktype {"name": "deploy"} 2023-10-06T21:37:24.542 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /tasktype {"name": "deploy"} 2023-10-06T21:37:24.546 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /tasktype {"name": "deploy"} 2023-10-06T21:37:24.554 DEBUG:teuthology.provision.fog.smithi057:FOG request: POST /host/162/task {"taskTypeID": 1} 2023-10-06T21:37:24.577 DEBUG:teuthology.provision.fog.smithi156:FOG request: POST /host/261/task {"taskTypeID": 1} 2023-10-06T21:37:24.582 DEBUG:teuthology.provision.fog.smithi190:FOG request: POST /host/295/task {"taskTypeID": 1} 2023-10-06T21:37:24.603 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-06T21:37:24.623 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-10-06T21:37:24.640 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-06T21:37:24.690 INFO:teuthology.orchestra.console.smithi057:Power off 2023-10-06T21:37:24.690 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T21:37:24.712 DEBUG:teuthology.orchestra.console.smithi057:power off output: Chassis Power Control: Down/Off 2023-10-06T21:37:24.712 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T21:37:24.731 INFO:teuthology.orchestra.console.smithi190:Power off 2023-10-06T21:37:24.732 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T21:37:24.745 INFO:teuthology.orchestra.console.smithi156:Power off 2023-10-06T21:37:24.745 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T21:37:24.751 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2023-10-06T21:37:24.753 DEBUG:teuthology.orchestra.console.smithi190:power off output: Chassis Power Control: Down/Off 2023-10-06T21:37:24.753 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T21:37:24.768 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off 2023-10-06T21:37:24.768 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T21:37:24.776 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-10-06T21:37:24.790 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-10-06T21:37:28.756 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T21:37:28.778 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T21:37:28.791 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T21:37:28.866 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2023-10-06T21:37:28.886 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-10-06T21:37:28.898 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-10-06T21:37:32.870 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T21:37:32.887 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T21:37:32.899 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T21:37:32.980 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2023-10-06T21:37:32.994 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-10-06T21:37:33.008 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-10-06T21:37:33.081 INFO:teuthology.orchestra.console.smithi057:Power off completed 2023-10-06T21:37:33.181 INFO:teuthology.orchestra.console.smithi057:Power on 2023-10-06T21:37:33.181 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-06T21:37:33.202 DEBUG:teuthology.orchestra.console.smithi057:power on output: Chassis Power Control: Up/On 2023-10-06T21:37:33.202 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T21:37:33.224 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2023-10-06T21:37:36.998 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T21:37:37.009 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T21:37:37.107 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-10-06T21:37:37.117 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-10-06T21:37:37.208 INFO:teuthology.orchestra.console.smithi190:Power off completed 2023-10-06T21:37:37.217 INFO:teuthology.orchestra.console.smithi156:Power off completed 2023-10-06T21:37:37.226 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T21:37:37.309 INFO:teuthology.orchestra.console.smithi190:Power on 2023-10-06T21:37:37.309 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-06T21:37:37.318 INFO:teuthology.orchestra.console.smithi156:Power on 2023-10-06T21:37:37.318 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-06T21:37:37.329 DEBUG:teuthology.orchestra.console.smithi190:power on output: Chassis Power Control: Up/On 2023-10-06T21:37:37.330 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T21:37:37.336 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2023-10-06T21:37:37.337 DEBUG:teuthology.orchestra.console.smithi156:power on output: Chassis Power Control: Up/On 2023-10-06T21:37:37.337 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T21:37:37.349 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-10-06T21:37:37.357 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-10-06T21:37:41.341 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T21:37:41.350 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T21:37:41.358 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T21:37:41.450 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2023-10-06T21:37:41.458 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-10-06T21:37:41.466 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-10-06T21:37:41.551 INFO:teuthology.orchestra.console.smithi057:Power on completed 2023-10-06T21:37:41.558 INFO:teuthology.orchestra.console.smithi190:Power on completed 2023-10-06T21:37:41.567 INFO:teuthology.orchestra.console.smithi156:Power on completed 2023-10-06T21:37:41.652 INFO:teuthology.provision.fog.smithi057:Waiting for deploy to finish 2023-10-06T21:37:41.653 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-06T21:37:41.659 INFO:teuthology.provision.fog.smithi190:Waiting for deploy to finish 2023-10-06T21:37:41.660 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-06T21:37:41.668 INFO:teuthology.provision.fog.smithi156:Waiting for deploy to finish 2023-10-06T21:37:41.668 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-10-06T21:37:56.735 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-06T21:37:56.736 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-06T21:37:56.737 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-10-06T21:38:11.818 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-06T21:38:11.820 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-06T21:38:11.820 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-10-06T21:38:26.918 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-10-06T21:38:26.919 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-06T21:38:26.923 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-06T21:38:42.010 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-06T21:38:42.011 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-10-06T21:38:42.012 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-06T21:38:57.097 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-06T21:38:57.099 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-10-06T21:38:57.099 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-06T21:39:12.190 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-10-06T21:39:12.192 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-06T21:39:12.202 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-06T21:39:27.274 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-10-06T21:39:27.275 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-06T21:39:27.278 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-06T21:39:42.372 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-06T21:39:42.373 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-10-06T21:39:42.374 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-06T21:39:57.478 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-06T21:39:57.502 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-10-06T21:39:57.503 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-06T21:40:12.594 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-06T21:40:12.596 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-06T21:40:12.596 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-10-06T21:40:27.706 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-06T21:40:27.707 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-06T21:40:27.708 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-10-06T21:40:27.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T21:40:27.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T21:40:27.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T21:40:30.842 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-10-06T21:40:30.843 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-10-06T21:40:36.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T21:40:36.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T21:40:39.902 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-10-06T21:40:39.903 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-10-06T21:40:45.903 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T21:40:45.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T21:40:48.958 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-10-06T21:40:48.986 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-10-06T21:40:54.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T21:40:54.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T21:40:58.010 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-10-06T21:40:58.042 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-10-06T21:41:04.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T21:41:04.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T21:41:07.070 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-10-06T21:41:07.102 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-10-06T21:41:13.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T21:41:13.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T21:41:16.122 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-10-06T21:41:16.154 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-10-06T21:41:22.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T21:41:22.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T21:41:25.210 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-10-06T21:41:31.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T21:41:58.286 ERROR:teuthology.orchestra.connection:Error authenticating with smithi156.front.sepia.ceph.com: Authentication timeout. 2023-10-06T21:41:58.287 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-06T21:41:58.287 DEBUG:teuthology.orchestra.run.smithi156:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-06T21:42:22.152 WARNING:teuthology.provision.fog.smithi190:timed out 2023-10-06T21:42:28.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T21:42:28.588 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-06T21:42:28.588 DEBUG:teuthology.orchestra.run.smithi190:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-06T21:42:28.849 INFO:teuthology.provision.fog.smithi190:Node is ready 2023-10-06T21:42:28.849 DEBUG:teuthology.orchestra.run.smithi190:> hostname 2023-10-06T21:42:28.866 INFO:teuthology.orchestra.run.smithi190.stdout:smithi190 2023-10-06T21:42:28.866 DEBUG:teuthology.orchestra.run.smithi190:> grep smithi190 /etc/hosts 2023-10-06T21:42:28.923 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.15.190 smithi190.front.sepia.ceph.com smithi190 2023-10-06T21:42:28.923 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190 2023-10-06T21:42:29.050 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi190/smithi190/g' /etc/hosts 2023-10-06T21:42:29.077 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/172.21.15.190/172.21.15.190/g' /etc/hosts 2023-10-06T21:42:29.145 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi190/smithi190/g' /etc/hostname 2023-10-06T21:42:29.212 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190 2023-10-06T21:42:29.277 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2023-10-06T21:42:29.334 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T21:42:29.334 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="8.6 (Ootpa)" 2023-10-06T21:42:29.334 INFO:teuthology.orchestra.run.smithi190.stdout:ID="rhel" 2023-10-06T21:42:29.334 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="fedora" 2023-10-06T21:42:29.334 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="8.6" 2023-10-06T21:42:29.335 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el8" 2023-10-06T21:42:29.335 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-06T21:42:29.335 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2023-10-06T21:42:29.335 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-06T21:42:29.335 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T21:42:29.335 INFO:teuthology.orchestra.run.smithi190.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T21:42:29.335 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T21:42:29.335 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-06T21:42:29.335 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T21:42:29.335 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-06T21:42:29.335 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T21:42:29.335 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-06T21:42:29.336 INFO:teuthology.provision.fog.smithi190:Deploy complete! 2023-10-06T21:42:29.337 DEBUG:teuthology.parallel:result is None 2023-10-06T21:42:31.214 WARNING:teuthology.provision.fog.smithi057:timed out 2023-10-06T21:42:37.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T21:42:37.454 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-06T21:42:37.454 DEBUG:teuthology.orchestra.run.smithi057:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-06T21:42:37.768 INFO:teuthology.provision.fog.smithi057:Node is ready 2023-10-06T21:42:37.768 DEBUG:teuthology.orchestra.run.smithi057:> hostname 2023-10-06T21:42:37.787 INFO:teuthology.orchestra.run.smithi057.stdout:smithi057.front.sepia.ceph.com 2023-10-06T21:42:37.788 DEBUG:teuthology.orchestra.run.smithi057:> grep smithi057.front.sepia.ceph.com /etc/hosts 2023-10-06T21:42:37.847 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57 smithi057.front.sepia.ceph.com smithi057 2023-10-06T21:42:37.847 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname smithi057 2023-10-06T21:42:37.970 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/smithi057.front.sepia.ceph.com/smithi057/g' /etc/hosts 2023-10-06T21:42:38.000 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/172.21.15.57/172.21.15.57/g' /etc/hosts 2023-10-06T21:42:38.071 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/smithi057.front.sepia.ceph.com/smithi057/g' /etc/hostname 2023-10-06T21:42:38.141 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname smithi057 2023-10-06T21:42:38.210 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2023-10-06T21:42:38.268 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T21:42:38.268 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="8.6 (Ootpa)" 2023-10-06T21:42:38.269 INFO:teuthology.orchestra.run.smithi057.stdout:ID="rhel" 2023-10-06T21:42:38.269 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="fedora" 2023-10-06T21:42:38.269 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="8.6" 2023-10-06T21:42:38.269 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el8" 2023-10-06T21:42:38.269 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-06T21:42:38.269 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31" 2023-10-06T21:42:38.269 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-06T21:42:38.269 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T21:42:38.269 INFO:teuthology.orchestra.run.smithi057.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T21:42:38.269 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T21:42:38.269 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T21:42:38.269 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T21:42:38.270 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-06T21:42:38.270 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T21:42:38.270 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-06T21:42:38.270 INFO:teuthology.provision.fog.smithi057:Deploy complete! 2023-10-06T21:42:38.271 DEBUG:teuthology.parallel:result is None 2023-10-06T21:43:45.531 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-10-06T21:43:45.531 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi156 2023-10-06T21:43:54.538 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-10-06T21:43:54.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T21:43:54.858 DEBUG:teuthology.orchestra.run.smithi156:> true 2023-10-06T21:43:55.169 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-10-06T21:43:55.169 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-06T21:43:55.169 DEBUG:teuthology.orchestra.run.smithi156:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-06T21:43:55.187 INFO:teuthology.provision.fog.smithi156:Node is ready 2023-10-06T21:43:55.187 DEBUG:teuthology.orchestra.run.smithi156:> hostname 2023-10-06T21:43:55.245 INFO:teuthology.orchestra.run.smithi156.stdout:smithi156 2023-10-06T21:43:55.246 DEBUG:teuthology.orchestra.run.smithi156:> grep smithi156 /etc/hosts 2023-10-06T21:43:55.304 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156 smithi156.front.sepia.ceph.com smithi156 2023-10-06T21:43:55.304 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156 2023-10-06T21:43:55.412 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156/smithi156/g' /etc/hosts 2023-10-06T21:43:55.441 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/172.21.15.156/172.21.15.156/g' /etc/hosts 2023-10-06T21:43:55.508 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156/smithi156/g' /etc/hostname 2023-10-06T21:43:55.575 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156 2023-10-06T21:43:55.642 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2023-10-06T21:43:55.699 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T21:43:55.699 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="8.6 (Ootpa)" 2023-10-06T21:43:55.699 INFO:teuthology.orchestra.run.smithi156.stdout:ID="rhel" 2023-10-06T21:43:55.699 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="fedora" 2023-10-06T21:43:55.699 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="8.6" 2023-10-06T21:43:55.699 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el8" 2023-10-06T21:43:55.699 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-06T21:43:55.699 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2023-10-06T21:43:55.700 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-06T21:43:55.700 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T21:43:55.700 INFO:teuthology.orchestra.run.smithi156.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T21:43:55.700 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T21:43:55.700 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-06T21:43:55.700 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T21:43:55.700 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-06T21:43:55.700 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T21:43:55.700 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-06T21:43:55.700 INFO:teuthology.provision.fog.smithi156:Deploy complete! 2023-10-06T21:43:55.701 DEBUG:teuthology.parallel:result is None 2023-10-06T21:43:55.898 INFO:teuthology.lock.ops:Checking smithi057.front.sepia.ceph.com 2023-10-06T21:43:55.898 INFO:teuthology.lock.ops:Checking smithi156.front.sepia.ceph.com 2023-10-06T21:43:55.898 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-06T21:43:55.922 INFO:teuthology.lock.ops:Checking smithi190.front.sepia.ceph.com 2023-10-06T21:43:55.922 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-06T21:43:55.940 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: set os type and version on server 2023-10-06T21:43:55.940 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-10-06T21:43:55.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T21:43:56.008 DEBUG:teuthology.orchestra.run.smithi057:> true 2023-10-06T21:43:56.144 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-10-06T21:43:56.144 DEBUG:teuthology.orchestra.run.smithi057:> uname -m 2023-10-06T21:43:56.202 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64 2023-10-06T21:43:56.202 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2023-10-06T21:43:56.260 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T21:43:56.260 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="8.6 (Ootpa)" 2023-10-06T21:43:56.260 INFO:teuthology.orchestra.run.smithi057.stdout:ID="rhel" 2023-10-06T21:43:56.261 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="fedora" 2023-10-06T21:43:56.261 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="8.6" 2023-10-06T21:43:56.261 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el8" 2023-10-06T21:43:56.261 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-06T21:43:56.261 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31" 2023-10-06T21:43:56.261 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-06T21:43:56.261 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T21:43:56.261 INFO:teuthology.orchestra.run.smithi057.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T21:43:56.261 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T21:43:56.261 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T21:43:56.261 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T21:43:56.261 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-06T21:43:56.261 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T21:43:56.262 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-06T21:43:56.262 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2023-10-06T21:43:56.281 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: set os type and version on server 2023-10-06T21:43:56.281 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-10-06T21:43:56.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T21:43:56.346 DEBUG:teuthology.orchestra.run.smithi156:> true 2023-10-06T21:43:56.415 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-10-06T21:43:56.415 DEBUG:teuthology.orchestra.run.smithi156:> uname -m 2023-10-06T21:43:56.475 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64 2023-10-06T21:43:56.475 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2023-10-06T21:43:56.532 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T21:43:56.532 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="8.6 (Ootpa)" 2023-10-06T21:43:56.532 INFO:teuthology.orchestra.run.smithi156.stdout:ID="rhel" 2023-10-06T21:43:56.532 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="fedora" 2023-10-06T21:43:56.532 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="8.6" 2023-10-06T21:43:56.532 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el8" 2023-10-06T21:43:56.532 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-06T21:43:56.533 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2023-10-06T21:43:56.533 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-06T21:43:56.533 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T21:43:56.533 INFO:teuthology.orchestra.run.smithi156.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T21:43:56.533 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T21:43:56.533 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-06T21:43:56.533 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T21:43:56.533 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-06T21:43:56.533 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T21:43:56.533 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-06T21:43:56.534 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2023-10-06T21:43:56.556 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: set os type and version on server 2023-10-06T21:43:56.556 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-10-06T21:43:56.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T21:43:56.623 DEBUG:teuthology.orchestra.run.smithi190:> true 2023-10-06T21:43:56.710 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-10-06T21:43:56.710 DEBUG:teuthology.orchestra.run.smithi190:> uname -m 2023-10-06T21:43:56.767 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64 2023-10-06T21:43:56.767 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2023-10-06T21:43:56.823 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T21:43:56.824 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="8.6 (Ootpa)" 2023-10-06T21:43:56.824 INFO:teuthology.orchestra.run.smithi190.stdout:ID="rhel" 2023-10-06T21:43:56.824 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="fedora" 2023-10-06T21:43:56.824 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="8.6" 2023-10-06T21:43:56.824 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el8" 2023-10-06T21:43:56.824 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-06T21:43:56.824 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2023-10-06T21:43:56.824 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-06T21:43:56.824 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T21:43:56.824 INFO:teuthology.orchestra.run.smithi190.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T21:43:56.824 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T21:43:56.825 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-06T21:43:56.825 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T21:43:56.825 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-06T21:43:56.825 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T21:43:56.825 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-06T21:43:56.825 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2023-10-06T21:43:56.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T21:43:56.944 INFO:teuthology.dispatcher.supervisor:Running job 7414695 2023-10-06T21:43:56.944 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-10-06_11:56:52-fs-rishabh-cephfs-mon-testing-default-smithi/7414695 --name rishabh-2023-10-06_11:56:52-fs-rishabh-cephfs-mon-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} delegate_inos/enabled mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/blogbench}} -- /home/teuthworker/archive/rishabh-2023-10-06_11:56:52-fs-rishabh-cephfs-mon-testing-default-smithi/7414695/orig.config.yaml 2023-10-06T21:43:56.947 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-10-06_11:56:52-fs-rishabh-cephfs-mon-testing-default-smithi/7414695 2023-10-06T21:43:56.947 INFO:teuthology.dispatcher.supervisor:Job PID: 1455187 2023-10-06T21:43:56.947 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-06T21:45:57.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T21:47:57.224 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T21:49:57.392 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T21:51:57.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T21:53:57.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T21:55:57.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T21:57:58.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T21:59:58.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T22:01:58.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T22:03:58.591 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T22:05:58.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T22:07:58.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T22:09:59.058 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T22:11:59.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T22:13:59.386 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T22:15:59.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T22:17:59.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T22:19:59.917 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T22:22:00.081 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T22:24:00.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T22:26:00.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T22:28:00.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T22:30:00.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T22:32:00.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T22:34:01.059 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T22:36:01.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T22:36:01.283 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-10-06T22:36:01.503 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-06T22:36:01.503 INFO:teuthology.nuke:Checking targets against current locks 2023-10-06T22:36:01.548 DEBUG:teuthology.nuke:shortname: smithi057 2023-10-06T22:36:01.548 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T22:36:01.574 DEBUG:teuthology.nuke:shortname: smithi156 2023-10-06T22:36:01.574 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T22:36:01.581 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi057.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-06_11:56:52-fs-rishabh-cephfs-mon-testing-default-smithi/7414695', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 21:37:23.215983', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-06T22:36:01.592 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi156.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-06_11:56:52-fs-rishabh-cephfs-mon-testing-default-smithi/7414695', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 21:37:23.212972', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-06T22:36:01.602 DEBUG:teuthology.nuke:shortname: smithi190 2023-10-06T22:36:01.602 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T22:36:01.620 INFO:teuthology.orchestra.console.smithi057:Power off 2023-10-06T22:36:01.621 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T22:36:01.629 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi190.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-06_11:56:52-fs-rishabh-cephfs-mon-testing-default-smithi/7414695', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 21:37:23.214517', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-06T22:36:01.641 DEBUG:teuthology.orchestra.console.smithi057:power off output: Chassis Power Control: Down/Off 2023-10-06T22:36:01.641 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T22:36:01.653 INFO:teuthology.orchestra.console.smithi156:Power off 2023-10-06T22:36:01.653 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T22:36:01.664 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2023-10-06T22:36:01.672 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off 2023-10-06T22:36:01.672 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T22:36:01.688 INFO:teuthology.orchestra.console.smithi190:Power off 2023-10-06T22:36:01.688 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T22:36:01.695 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-10-06T22:36:01.708 DEBUG:teuthology.orchestra.console.smithi190:power off output: Chassis Power Control: Down/Off 2023-10-06T22:36:01.708 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T22:36:01.727 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-10-06T22:36:01.766 INFO:teuthology.orchestra.console.smithi057:Power off completed 2023-10-06T22:36:01.796 INFO:teuthology.orchestra.console.smithi156:Power off completed 2023-10-06T22:36:01.828 INFO:teuthology.orchestra.console.smithi190:Power off completed 2023-10-06T22:36:01.917 INFO:teuthology.lock.ops:unlocked: smithi057.front.sepia.ceph.com 2023-10-06T22:36:01.940 INFO:teuthology.lock.ops:unlocked: smithi156.front.sepia.ceph.com 2023-10-06T22:36:01.982 INFO:teuthology.lock.ops:unlocked: smithi190.front.sepia.ceph.com