2023-11-10T11:53:20.741 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2
2023-11-10T11:53:20.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T11:53:20.903 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f0a01071b80>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f0a00d27b80>, signals=[15])
2023-11-10T11:53:20.904 INFO:teuthology.lock.ops:Start node 'smithi062.front.sepia.ceph.com' reimaging
2023-11-10T11:53:20.905 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: reset os type and version on server
2023-11-10T11:53:20.905 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server
2023-11-10T11:53:20.927 INFO:teuthology.lock.ops:Start node 'smithi103.front.sepia.ceph.com' reimaging
2023-11-10T11:53:20.927 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: reset os type and version on server
2023-11-10T11:53:20.927 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server
2023-11-10T11:53:20.929 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /host {"name": "smithi062"}
2023-11-10T11:53:20.951 INFO:teuthology.lock.ops:Start node 'smithi111.front.sepia.ceph.com' reimaging
2023-11-10T11:53:20.951 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: reset os type and version on server
2023-11-10T11:53:20.952 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server
2023-11-10T11:53:20.953 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /host {"name": "smithi103"}
2023-11-10T11:53:20.976 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /host {"name": "smithi111"}
2023-11-10T11:53:21.008 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-11-10T11:53:21.021 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-11-10T11:53:21.031 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-11-10T11:53:21.058 DEBUG:teuthology.provision.fog.smithi062:Requesting image smithi_rhel_8.6 (ID 5)
2023-11-10T11:53:21.059 DEBUG:teuthology.provision.fog.smithi062:FOG request: PUT /host/167 {"imageID": 5}
2023-11-10T11:53:21.062 DEBUG:teuthology.provision.fog.smithi103:Requesting image smithi_rhel_8.6 (ID 5)
2023-11-10T11:53:21.062 DEBUG:teuthology.provision.fog.smithi103:FOG request: PUT /host/208 {"imageID": 5}
2023-11-10T11:53:21.072 DEBUG:teuthology.provision.fog.smithi111:Requesting image smithi_rhel_8.6 (ID 5)
2023-11-10T11:53:21.072 DEBUG:teuthology.provision.fog.smithi111:FOG request: PUT /host/216 {"imageID": 5}
2023-11-10T11:53:21.103 INFO:teuthology.provision.fog.smithi062:Scheduling deploy of rhel 8.6
2023-11-10T11:53:21.103 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-11-10T11:53:21.107 INFO:teuthology.provision.fog.smithi111:Scheduling deploy of rhel 8.6
2023-11-10T11:53:21.107 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-11-10T11:53:21.108 INFO:teuthology.provision.fog.smithi103:Scheduling deploy of rhel 8.6
2023-11-10T11:53:21.109 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None
2023-11-10T11:53:21.186 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /tasktype {"name": "deploy"}
2023-11-10T11:53:21.190 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /tasktype {"name": "deploy"}
2023-11-10T11:53:21.192 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /tasktype {"name": "deploy"}
2023-11-10T11:53:21.239 DEBUG:teuthology.provision.fog.smithi062:FOG request: POST /host/167/task {"taskTypeID": 1}
2023-11-10T11:53:21.243 DEBUG:teuthology.provision.fog.smithi103:FOG request: POST /host/208/task {"taskTypeID": 1}
2023-11-10T11:53:21.244 DEBUG:teuthology.provision.fog.smithi111:FOG request: POST /host/216/task {"taskTypeID": 1}
2023-11-10T11:53:21.294 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-11-10T11:53:21.297 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None
2023-11-10T11:53:21.306 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-11-10T11:53:21.406 INFO:teuthology.orchestra.console.smithi103:Power off
2023-11-10T11:53:21.406 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-10T11:53:21.429 DEBUG:teuthology.orchestra.console.smithi103:power off output: Chassis Power Control: Down/Off
2023-11-10T11:53:21.430 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-10T11:53:21.447 INFO:teuthology.orchestra.console.smithi062:Power off
2023-11-10T11:53:21.448 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-10T11:53:21.460 INFO:teuthology.orchestra.console.smithi111:Power off
2023-11-10T11:53:21.460 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-10T11:53:21.467 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on
2023-11-10T11:53:21.470 DEBUG:teuthology.orchestra.console.smithi062:power off output: Chassis Power Control: Down/Off
2023-11-10T11:53:21.471 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-10T11:53:21.482 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off
2023-11-10T11:53:21.482 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-10T11:53:21.490 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on
2023-11-10T11:53:21.502 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2023-11-10T11:53:21.603 INFO:teuthology.orchestra.console.smithi111:Power off completed
2023-11-10T11:53:21.704 INFO:teuthology.orchestra.console.smithi111:Power on
2023-11-10T11:53:21.704 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-10T11:53:21.725 DEBUG:teuthology.orchestra.console.smithi111:power on output: Chassis Power Control: Up/On
2023-11-10T11:53:21.725 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-10T11:53:21.747 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2023-11-10T11:53:25.470 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-10T11:53:25.491 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-10T11:53:25.579 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on
2023-11-10T11:53:25.599 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on
2023-11-10T11:53:25.748 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-10T11:53:25.857 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on
2023-11-10T11:53:25.958 INFO:teuthology.orchestra.console.smithi111:Power on completed
2023-11-10T11:53:26.059 INFO:teuthology.provision.fog.smithi111:Waiting for deploy to finish
2023-11-10T11:53:26.060 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-11-10T11:53:29.583 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-10T11:53:29.600 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-10T11:53:29.692 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on
2023-11-10T11:53:29.709 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on
2023-11-10T11:53:33.699 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-10T11:53:33.710 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-10T11:53:33.808 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off
2023-11-10T11:53:33.818 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off
2023-11-10T11:53:33.909 INFO:teuthology.orchestra.console.smithi103:Power off completed
2023-11-10T11:53:33.919 INFO:teuthology.orchestra.console.smithi062:Power off completed
2023-11-10T11:53:34.011 INFO:teuthology.orchestra.console.smithi103:Power on
2023-11-10T11:53:34.011 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-10T11:53:34.020 INFO:teuthology.orchestra.console.smithi062:Power on
2023-11-10T11:53:34.020 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-10T11:53:34.032 DEBUG:teuthology.orchestra.console.smithi103:power on output: Chassis Power Control: Up/On
2023-11-10T11:53:34.032 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-10T11:53:34.041 DEBUG:teuthology.orchestra.console.smithi062:power on output: Chassis Power Control: Up/On
2023-11-10T11:53:34.041 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-10T11:53:34.052 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off
2023-11-10T11:53:34.061 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off
2023-11-10T11:53:38.057 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-10T11:53:38.064 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-10T11:53:38.166 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off
2023-11-10T11:53:38.172 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on
2023-11-10T11:53:38.273 INFO:teuthology.orchestra.console.smithi062:Power on completed
2023-11-10T11:53:38.374 INFO:teuthology.provision.fog.smithi062:Waiting for deploy to finish
2023-11-10T11:53:38.374 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-11-10T11:53:41.217 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-11-10T11:53:42.168 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-10T11:53:42.277 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on
2023-11-10T11:53:42.378 INFO:teuthology.orchestra.console.smithi103:Power on completed
2023-11-10T11:53:42.478 INFO:teuthology.provision.fog.smithi103:Waiting for deploy to finish
2023-11-10T11:53:42.479 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None
2023-11-10T11:53:53.542 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-11-10T11:53:56.387 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-11-10T11:53:57.655 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None
2023-11-10T11:54:08.712 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-11-10T11:54:11.553 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-11-10T11:54:12.834 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None
2023-11-10T11:54:23.885 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-11-10T11:54:26.722 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-11-10T11:54:28.033 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None
2023-11-10T11:54:39.059 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-11-10T11:54:41.894 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-11-10T11:54:43.199 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None
2023-11-10T11:54:54.250 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-11-10T11:54:57.058 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-11-10T11:54:58.405 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None
2023-11-10T11:55:09.431 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-11-10T11:55:12.292 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-11-10T11:55:13.612 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None
2023-11-10T11:55:24.613 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-11-10T11:55:27.525 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-11-10T11:55:28.892 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None
2023-11-10T11:55:39.872 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-11-10T11:55:45.328 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-11-10T11:55:45.656 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None
2023-11-10T11:56:01.562 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-11-10T11:56:01.851 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-11-10T11:56:01.897 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None
2023-11-10T11:56:18.778 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-11-10T11:56:18.936 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None
2023-11-10T11:56:19.037 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-11-10T11:56:35.863 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-11-10T11:56:36.012 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None
2023-11-10T11:56:36.016 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-11-10T11:56:51.902 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-11-10T11:56:52.230 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-11-10T11:56:52.251 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None
2023-11-10T11:57:07.106 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-11-10T11:57:08.363 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-11-10T11:57:08.556 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None
2023-11-10T11:57:22.305 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-11-10T11:57:24.003 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-11-10T11:57:24.174 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None
2023-11-10T11:57:37.494 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-11-10T11:57:39.238 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-11-10T11:57:39.355 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None
2023-11-10T11:57:52.634 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-11-10T11:57:54.398 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-11-10T11:57:54.497 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None
2023-11-10T11:58:07.813 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-11-10T11:58:09.561 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-11-10T11:58:09.654 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None
2023-11-10T11:58:22.939 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-11-10T11:58:24.706 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-11-10T11:58:24.769 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None
2023-11-10T11:58:38.078 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-11-10T11:58:39.861 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-11-10T11:58:39.893 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None
2023-11-10T11:58:53.178 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-11-10T11:58:53.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T11:58:54.986 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None
2023-11-10T11:58:55.017 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None
2023-11-10T11:58:55.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T11:58:55.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T11:58:56.314 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-11-10T11:58:58.138 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-11-10T11:58:58.170 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2023-11-10T11:59:02.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T11:59:04.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T11:59:04.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T11:59:05.370 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-11-10T11:59:07.194 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-11-10T11:59:07.230 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2023-11-10T11:59:11.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T11:59:13.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T11:59:13.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T11:59:14.426 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-11-10T11:59:16.250 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-11-10T11:59:16.286 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2023-11-10T11:59:20.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T11:59:22.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T11:59:22.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T11:59:23.482 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-11-10T11:59:25.306 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-11-10T11:59:25.370 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2023-11-10T11:59:29.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T11:59:31.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T11:59:31.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T11:59:32.542 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-11-10T11:59:34.362 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-11-10T11:59:34.429 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2023-11-10T11:59:38.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T11:59:40.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T11:59:40.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T11:59:41.630 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-11-10T11:59:43.418 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-11-10T11:59:43.486 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2023-11-10T11:59:47.634 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T11:59:49.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T11:59:49.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T11:59:52.474 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-11-10T11:59:52.538 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2023-11-10T11:59:58.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T11:59:58.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T12:00:01.530 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-11-10T12:00:01.594 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2023-11-10T12:00:06.010 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-11-10T12:00:07.533 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T12:00:07.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T12:00:12.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T12:00:15.066 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-11-10T12:00:17.790 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2023-11-10T12:00:21.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T12:00:22.134 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-10T12:00:22.135 DEBUG:teuthology.orchestra.run.smithi062:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-10T12:00:22.398 INFO:teuthology.provision.fog.smithi062:Node is ready
2023-11-10T12:00:22.399 DEBUG:teuthology.orchestra.run.smithi062:> hostname
2023-11-10T12:00:22.414 INFO:teuthology.orchestra.run.smithi062.stdout:smithi022
2023-11-10T12:00:22.415 DEBUG:teuthology.orchestra.run.smithi062:> grep smithi022 /etc/hosts
2023-11-10T12:00:22.472 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022
2023-11-10T12:00:22.472 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062
2023-11-10T12:00:22.583 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi022/smithi062/g' /etc/hosts
2023-11-10T12:00:22.610 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/172.21.15.22/172.21.15.62/g' /etc/hosts
2023-11-10T12:00:22.677 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi022/smithi062/g' /etc/hostname
2023-11-10T12:00:22.744 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062
2023-11-10T12:00:22.811 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release
2023-11-10T12:00:22.867 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="Red Hat Enterprise Linux"
2023-11-10T12:00:22.868 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="8.6 (Ootpa)"
2023-11-10T12:00:22.868 INFO:teuthology.orchestra.run.smithi062.stdout:ID="rhel"
2023-11-10T12:00:22.868 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="fedora"
2023-11-10T12:00:22.868 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="8.6"
2023-11-10T12:00:22.869 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el8"
2023-11-10T12:00:22.869 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-11-10T12:00:22.869 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31"
2023-11-10T12:00:22.869 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-11-10T12:00:22.869 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://www.redhat.com/"
2023-11-10T12:00:22.870 INFO:teuthology.orchestra.run.smithi062.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-10T12:00:22.870 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-10T12:00:22.870 INFO:teuthology.orchestra.run.smithi062.stdout:
2023-11-10T12:00:22.870 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-10T12:00:22.870 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-11-10T12:00:22.871 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-10T12:00:22.871 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-11-10T12:00:22.872 INFO:teuthology.provision.fog.smithi062:Deploy complete!
2023-11-10T12:00:22.873 DEBUG:teuthology.parallel:result is None
2023-11-10T12:00:23.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T12:00:26.878 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2023-11-10T12:00:32.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T12:00:35.962 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2023-11-10T12:00:41.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T12:00:42.294 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-10T12:00:42.294 DEBUG:teuthology.orchestra.run.smithi103:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-10T12:00:42.556 INFO:teuthology.provision.fog.smithi103:Node is ready
2023-11-10T12:00:42.556 DEBUG:teuthology.orchestra.run.smithi103:> hostname
2023-11-10T12:00:42.573 INFO:teuthology.orchestra.run.smithi103.stdout:smithi022
2023-11-10T12:00:42.574 DEBUG:teuthology.orchestra.run.smithi103:> grep smithi022 /etc/hosts
2023-11-10T12:00:42.630 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022
2023-11-10T12:00:42.630 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname smithi103
2023-11-10T12:00:42.745 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi022/smithi103/g' /etc/hosts
2023-11-10T12:00:42.772 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/172.21.15.22/172.21.15.103/g' /etc/hosts
2023-11-10T12:00:42.839 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi022/smithi103/g' /etc/hostname
2023-11-10T12:00:42.908 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname smithi103
2023-11-10T12:00:42.978 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release
2023-11-10T12:00:43.036 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="Red Hat Enterprise Linux"
2023-11-10T12:00:43.036 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="8.6 (Ootpa)"
2023-11-10T12:00:43.036 INFO:teuthology.orchestra.run.smithi103.stdout:ID="rhel"
2023-11-10T12:00:43.036 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="fedora"
2023-11-10T12:00:43.037 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="8.6"
2023-11-10T12:00:43.037 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el8"
2023-11-10T12:00:43.037 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-11-10T12:00:43.037 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31"
2023-11-10T12:00:43.037 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-11-10T12:00:43.038 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://www.redhat.com/"
2023-11-10T12:00:43.038 INFO:teuthology.orchestra.run.smithi103.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-10T12:00:43.038 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-10T12:00:43.038 INFO:teuthology.orchestra.run.smithi103.stdout:
2023-11-10T12:00:43.038 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-10T12:00:43.039 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-11-10T12:00:43.039 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-10T12:00:43.039 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-11-10T12:00:43.039 INFO:teuthology.provision.fog.smithi103:Deploy complete!
2023-11-10T12:00:43.040 DEBUG:teuthology.parallel:result is None
2023-11-10T12:01:07.536 WARNING:teuthology.provision.fog.smithi111:timed out
2023-11-10T12:01:13.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T12:01:13.839 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-10T12:01:13.840 DEBUG:teuthology.orchestra.run.smithi111:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-10T12:01:14.114 INFO:teuthology.provision.fog.smithi111:Node is ready
2023-11-10T12:01:14.114 DEBUG:teuthology.orchestra.run.smithi111:> hostname
2023-11-10T12:01:14.133 INFO:teuthology.orchestra.run.smithi111.stdout:smithi111
2023-11-10T12:01:14.133 DEBUG:teuthology.orchestra.run.smithi111:> grep smithi111 /etc/hosts
2023-11-10T12:01:14.192 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111 smithi111.front.sepia.ceph.com smithi111
2023-11-10T12:01:14.192 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111
2023-11-10T12:01:14.313 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111/smithi111/g' /etc/hosts
2023-11-10T12:01:14.343 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/172.21.15.111/172.21.15.111/g' /etc/hosts
2023-11-10T12:01:14.410 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111/smithi111/g' /etc/hostname
2023-11-10T12:01:14.452 ERROR:paramiko.transport:Unknown exception: The socket has already been closed by another greenlet
2023-11-10T12:01:14.454 ERROR:paramiko.transport:Traceback (most recent call last):
2023-11-10T12:01:14.455 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2110, in run
2023-11-10T12:01:14.455 ERROR:paramiko.transport:    ptype, m = self.packetizer.read_message()
2023-11-10T12:01:14.455 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 459, in read_message
2023-11-10T12:01:14.455 ERROR:paramiko.transport:    header = self.read_all(self.__block_size_in, check_rekey=True)
2023-11-10T12:01:14.456 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 301, in read_all
2023-11-10T12:01:14.456 ERROR:paramiko.transport:    x = self.__socket.recv(n)
2023-11-10T12:01:14.456 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 663, in recv
2023-11-10T12:01:14.457 ERROR:paramiko.transport:    self._wait(self._read_event)
2023-11-10T12:01:14.457 ERROR:paramiko.transport:  File "src/gevent/_hub_primitives.py", line 317, in gevent._gevent_c_hub_primitives.wait_on_socket
2023-11-10T12:01:14.457 ERROR:paramiko.transport:  File "src/gevent/_hub_primitives.py", line 321, in gevent._gevent_c_hub_primitives.wait_on_socket
2023-11-10T12:01:14.458 ERROR:paramiko.transport:gevent.exceptions.ConcurrentObjectUseError: The socket has already been closed by another greenlet
2023-11-10T12:01:14.458 ERROR:paramiko.transport:
2023-11-10T12:01:14.477 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111
2023-11-10T12:01:14.542 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release
2023-11-10T12:01:14.597 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Red Hat Enterprise Linux"
2023-11-10T12:01:14.598 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="8.6 (Ootpa)"
2023-11-10T12:01:14.598 INFO:teuthology.orchestra.run.smithi111.stdout:ID="rhel"
2023-11-10T12:01:14.598 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="fedora"
2023-11-10T12:01:14.598 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="8.6"
2023-11-10T12:01:14.599 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el8"
2023-11-10T12:01:14.599 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-11-10T12:01:14.599 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31"
2023-11-10T12:01:14.599 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-11-10T12:01:14.599 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.redhat.com/"
2023-11-10T12:01:14.600 INFO:teuthology.orchestra.run.smithi111.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-10T12:01:14.600 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-10T12:01:14.600 INFO:teuthology.orchestra.run.smithi111.stdout:
2023-11-10T12:01:14.600 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-10T12:01:14.600 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-11-10T12:01:14.601 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-10T12:01:14.601 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-11-10T12:01:14.601 INFO:teuthology.provision.fog.smithi111:Deploy complete!
2023-11-10T12:01:14.602 DEBUG:teuthology.parallel:result is None
2023-11-10T12:01:14.791 INFO:teuthology.lock.ops:Checking smithi062.front.sepia.ceph.com
2023-11-10T12:01:14.791 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-10T12:01:14.813 INFO:teuthology.lock.ops:Checking smithi103.front.sepia.ceph.com
2023-11-10T12:01:14.813 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-10T12:01:14.829 INFO:teuthology.lock.ops:Checking smithi111.front.sepia.ceph.com
2023-11-10T12:01:14.830 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-10T12:01:14.847 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: set os type and version on server
2023-11-10T12:01:14.848 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com'
2023-11-10T12:01:14.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T12:01:14.917 DEBUG:teuthology.orchestra.run.smithi062:> true
2023-11-10T12:01:15.061 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com'
2023-11-10T12:01:15.061 DEBUG:teuthology.orchestra.run.smithi062:> uname -m
2023-11-10T12:01:15.119 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64
2023-11-10T12:01:15.119 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release
2023-11-10T12:01:15.177 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="Red Hat Enterprise Linux"
2023-11-10T12:01:15.177 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="8.6 (Ootpa)"
2023-11-10T12:01:15.177 INFO:teuthology.orchestra.run.smithi062.stdout:ID="rhel"
2023-11-10T12:01:15.178 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="fedora"
2023-11-10T12:01:15.178 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="8.6"
2023-11-10T12:01:15.178 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el8"
2023-11-10T12:01:15.178 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-11-10T12:01:15.178 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31"
2023-11-10T12:01:15.179 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-11-10T12:01:15.179 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://www.redhat.com/"
2023-11-10T12:01:15.179 INFO:teuthology.orchestra.run.smithi062.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-10T12:01:15.180 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-10T12:01:15.180 INFO:teuthology.orchestra.run.smithi062.stdout:
2023-11-10T12:01:15.180 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-10T12:01:15.180 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-11-10T12:01:15.181 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-10T12:01:15.181 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-11-10T12:01:15.182 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server
2023-11-10T12:01:15.205 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: set os type and version on server
2023-11-10T12:01:15.205 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com'
2023-11-10T12:01:15.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T12:01:15.274 DEBUG:teuthology.orchestra.run.smithi103:> true
2023-11-10T12:01:15.347 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com'
2023-11-10T12:01:15.347 DEBUG:teuthology.orchestra.run.smithi103:> uname -m
2023-11-10T12:01:15.406 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64
2023-11-10T12:01:15.407 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release
2023-11-10T12:01:15.465 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="Red Hat Enterprise Linux"
2023-11-10T12:01:15.466 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="8.6 (Ootpa)"
2023-11-10T12:01:15.466 INFO:teuthology.orchestra.run.smithi103.stdout:ID="rhel"
2023-11-10T12:01:15.466 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="fedora"
2023-11-10T12:01:15.467 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="8.6"
2023-11-10T12:01:15.467 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el8"
2023-11-10T12:01:15.467 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-11-10T12:01:15.467 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31"
2023-11-10T12:01:15.468 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-11-10T12:01:15.468 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://www.redhat.com/"
2023-11-10T12:01:15.468 INFO:teuthology.orchestra.run.smithi103.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-10T12:01:15.468 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-10T12:01:15.469 INFO:teuthology.orchestra.run.smithi103.stdout:
2023-11-10T12:01:15.469 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-10T12:01:15.469 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-11-10T12:01:15.470 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-10T12:01:15.470 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-11-10T12:01:15.470 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server
2023-11-10T12:01:15.496 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: set os type and version on server
2023-11-10T12:01:15.497 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com'
2023-11-10T12:01:15.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T12:01:15.566 DEBUG:teuthology.orchestra.run.smithi111:> true
2023-11-10T12:01:15.634 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com'
2023-11-10T12:01:15.635 DEBUG:teuthology.orchestra.run.smithi111:> uname -m
2023-11-10T12:01:15.691 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64
2023-11-10T12:01:15.692 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release
2023-11-10T12:01:15.749 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Red Hat Enterprise Linux"
2023-11-10T12:01:15.749 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="8.6 (Ootpa)"
2023-11-10T12:01:15.749 INFO:teuthology.orchestra.run.smithi111.stdout:ID="rhel"
2023-11-10T12:01:15.749 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="fedora"
2023-11-10T12:01:15.750 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="8.6"
2023-11-10T12:01:15.750 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el8"
2023-11-10T12:01:15.750 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-11-10T12:01:15.750 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31"
2023-11-10T12:01:15.751 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-11-10T12:01:15.751 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.redhat.com/"
2023-11-10T12:01:15.751 INFO:teuthology.orchestra.run.smithi111.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-10T12:01:15.751 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-10T12:01:15.751 INFO:teuthology.orchestra.run.smithi111.stdout:
2023-11-10T12:01:15.752 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-10T12:01:15.752 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-11-10T12:01:15.752 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-10T12:01:15.752 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-11-10T12:01:15.753 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server
2023-11-10T12:01:15.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T12:01:15.864 INFO:teuthology.dispatcher.supervisor:Running job 7453868
2023-11-10T12:01:15.864 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-11-10_11:52:20-fs-rishabh-unqiue-fsnames-testing-default-smithi/7453868 --name rishabh-2023-11-10_11:52:20-fs-rishabh-unqiue-fsnames-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/suites/blogbench}} -- /home/teuthworker/archive/rishabh-2023-11-10_11:52:20-fs-rishabh-unqiue-fsnames-testing-default-smithi/7453868/orig.config.yaml
2023-11-10T12:01:15.868 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-11-10_11:52:20-fs-rishabh-unqiue-fsnames-testing-default-smithi/7453868
2023-11-10T12:01:15.868 INFO:teuthology.dispatcher.supervisor:Job PID: 1937683
2023-11-10T12:01:15.869 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-10T12:03:15.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T12:05:16.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T12:07:16.308 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T12:09:16.604 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T12:11:16.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T12:13:16.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T12:15:17.116 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T12:17:17.281 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T12:19:17.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T12:21:17.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T12:23:17.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T12:25:17.852 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T12:27:17.998 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T12:29:18.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T12:31:18.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T12:33:18.509 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T12:35:18.682 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T12:37:18.849 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T12:39:19.014 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T12:41:19.178 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T12:43:19.404 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T12:45:19.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T12:47:19.736 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T12:49:19.812 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T12:51:19.972 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T12:53:20.132 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T12:55:20.296 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T12:57:20.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T12:59:20.631 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T13:01:20.797 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T13:03:20.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T13:03:21.035 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-11-10T13:03:21.220 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi062 but it was locked by another job: /home/teuthworker/archive/rishabh-2023-11-10_12:45:42-fs-rishabh-unqiue-fsnames-testing-default-smithi/7453991
2023-11-10T13:03:21.221 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi103 but it was locked by another job: /home/teuthworker/archive/rishabh-2023-11-10_12:45:42-fs-rishabh-unqiue-fsnames-testing-default-smithi/7453992
2023-11-10T13:03:21.221 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi111 but it was locked by another job: /home/teuthworker/archive/rishabh-2023-11-10_12:45:42-fs-rishabh-unqiue-fsnames-testing-default-smithi/7453990