2023-10-02T17:56:02.912 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-02T17:56:02.913 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-02T17:56:03.086 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f70080d5e50>, signals=[15]) 2023-10-02T17:56:03.086 INFO:teuthology.lock.ops:Start node 'smithi031.front.sepia.ceph.com' reimaging 2023-10-02T17:56:03.087 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: reset os type and version on server 2023-10-02T17:56:03.087 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2023-10-02T17:56:03.110 INFO:teuthology.lock.ops:Start node 'smithi153.front.sepia.ceph.com' reimaging 2023-10-02T17:56:03.111 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: reset os type and version on server 2023-10-02T17:56:03.111 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2023-10-02T17:56:03.112 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /host {"name": "smithi031"} 2023-10-02T17:56:03.135 INFO:teuthology.lock.ops:Start node 'smithi179.front.sepia.ceph.com' reimaging 2023-10-02T17:56:03.135 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: reset os type and version on server 2023-10-02T17:56:03.136 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2023-10-02T17:56:03.137 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /host {"name": "smithi153"} 2023-10-02T17:56:03.160 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /host {"name": "smithi179"} 2023-10-02T17:56:03.190 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-10-02T17:56:03.209 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-10-02T17:56:03.223 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-10-02T17:56:03.230 DEBUG:teuthology.provision.fog.smithi031:Requesting image smithi_rhel_8.6 (ID 5) 2023-10-02T17:56:03.231 DEBUG:teuthology.provision.fog.smithi031:FOG request: PUT /host/136 {"imageID": 5} 2023-10-02T17:56:03.257 DEBUG:teuthology.provision.fog.smithi153:Requesting image smithi_rhel_8.6 (ID 5) 2023-10-02T17:56:03.257 DEBUG:teuthology.provision.fog.smithi153:FOG request: PUT /host/258 {"imageID": 5} 2023-10-02T17:56:03.267 DEBUG:teuthology.provision.fog.smithi179:Requesting image smithi_rhel_8.6 (ID 5) 2023-10-02T17:56:03.267 DEBUG:teuthology.provision.fog.smithi179:FOG request: PUT /host/284 {"imageID": 5} 2023-10-02T17:56:03.277 INFO:teuthology.provision.fog.smithi031:Scheduling deploy of rhel 8.6 2023-10-02T17:56:03.277 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-02T17:56:03.304 INFO:teuthology.provision.fog.smithi153:Scheduling deploy of rhel 8.6 2023-10-02T17:56:03.304 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-10-02T17:56:03.307 INFO:teuthology.provision.fog.smithi179:Scheduling deploy of rhel 8.6 2023-10-02T17:56:03.307 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-02T17:56:03.322 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /tasktype {"name": "deploy"} 2023-10-02T17:56:03.350 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /tasktype {"name": "deploy"} 2023-10-02T17:56:03.353 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /tasktype {"name": "deploy"} 2023-10-02T17:56:03.356 DEBUG:teuthology.provision.fog.smithi031:FOG request: POST /host/136/task {"taskTypeID": 1} 2023-10-02T17:56:03.383 DEBUG:teuthology.provision.fog.smithi179:FOG request: POST /host/284/task {"taskTypeID": 1} 2023-10-02T17:56:03.392 DEBUG:teuthology.provision.fog.smithi153:FOG request: POST /host/258/task {"taskTypeID": 1} 2023-10-02T17:56:03.427 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-02T17:56:03.471 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-02T17:56:03.480 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-10-02T17:56:03.522 INFO:teuthology.orchestra.console.smithi031:Power off 2023-10-02T17:56:03.522 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-02T17:56:03.543 DEBUG:teuthology.orchestra.console.smithi031:power off output: Chassis Power Control: Down/Off 2023-10-02T17:56:03.543 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-02T17:56:03.562 INFO:teuthology.orchestra.console.smithi153:Power off 2023-10-02T17:56:03.563 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-02T17:56:03.574 INFO:teuthology.orchestra.console.smithi179:Power off 2023-10-02T17:56:03.574 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-02T17:56:03.580 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-10-02T17:56:03.582 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off 2023-10-02T17:56:03.582 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-02T17:56:03.594 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off 2023-10-02T17:56:03.595 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-02T17:56:03.604 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2023-10-02T17:56:03.614 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-10-02T17:56:03.714 INFO:teuthology.orchestra.console.smithi179:Power off completed 2023-10-02T17:56:03.815 INFO:teuthology.orchestra.console.smithi179:Power on 2023-10-02T17:56:03.815 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-02T17:56:03.834 DEBUG:teuthology.orchestra.console.smithi179:power on output: Chassis Power Control: Up/On 2023-10-02T17:56:03.835 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-02T17:56:03.856 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-10-02T17:56:07.582 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-02T17:56:07.605 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-02T17:56:07.691 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-10-02T17:56:07.712 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2023-10-02T17:56:07.858 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-02T17:56:07.966 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-10-02T17:56:11.692 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-02T17:56:11.713 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-02T17:56:11.801 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-10-02T17:56:11.821 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2023-10-02T17:56:11.967 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-02T17:56:12.076 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2023-10-02T17:56:12.176 INFO:teuthology.orchestra.console.smithi179:Power on completed 2023-10-02T17:56:12.277 INFO:teuthology.provision.fog.smithi179:Waiting for deploy to finish 2023-10-02T17:56:12.277 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-02T17:56:15.806 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-02T17:56:15.822 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-02T17:56:15.914 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2023-10-02T17:56:15.930 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2023-10-02T17:56:16.015 INFO:teuthology.orchestra.console.smithi031:Power off completed 2023-10-02T17:56:16.031 INFO:teuthology.orchestra.console.smithi153:Power off completed 2023-10-02T17:56:16.116 INFO:teuthology.orchestra.console.smithi031:Power on 2023-10-02T17:56:16.117 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-02T17:56:16.132 INFO:teuthology.orchestra.console.smithi153:Power on 2023-10-02T17:56:16.132 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-02T17:56:16.140 DEBUG:teuthology.orchestra.console.smithi031:power on output: Chassis Power Control: Up/On 2023-10-02T17:56:16.140 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-02T17:56:16.151 DEBUG:teuthology.orchestra.console.smithi153:power on output: Chassis Power Control: Up/On 2023-10-02T17:56:16.152 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-02T17:56:16.159 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2023-10-02T17:56:16.171 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2023-10-02T17:56:20.161 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-02T17:56:20.171 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-02T17:56:20.269 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2023-10-02T17:56:20.278 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2023-10-02T17:56:24.275 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-02T17:56:24.281 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-02T17:56:24.383 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-10-02T17:56:24.389 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2023-10-02T17:56:24.484 INFO:teuthology.orchestra.console.smithi031:Power on completed 2023-10-02T17:56:24.490 INFO:teuthology.orchestra.console.smithi153:Power on completed 2023-10-02T17:56:24.585 INFO:teuthology.provision.fog.smithi031:Waiting for deploy to finish 2023-10-02T17:56:24.585 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-02T17:56:24.591 INFO:teuthology.provision.fog.smithi153:Waiting for deploy to finish 2023-10-02T17:56:24.591 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-10-02T17:56:27.344 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-02T17:56:39.656 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-02T17:56:39.658 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-10-02T17:56:42.418 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-02T17:56:54.734 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-10-02T17:56:54.736 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-02T17:56:57.493 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-02T17:57:09.810 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-10-02T17:57:09.811 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-02T17:57:12.572 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-02T17:57:24.882 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-10-02T17:57:24.883 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-02T17:57:27.634 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-02T17:57:39.944 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-10-02T17:57:39.946 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-02T17:57:42.702 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-02T17:57:55.022 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-02T17:57:55.024 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-10-02T17:57:57.766 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-02T17:58:10.094 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-10-02T17:58:10.096 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-02T17:58:12.832 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-02T17:58:25.170 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-02T17:58:25.172 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-10-02T17:58:27.909 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-02T17:58:40.258 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-02T17:58:40.259 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-10-02T17:58:42.982 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-02T17:58:55.346 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-02T17:58:55.348 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-10-02T17:58:55.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-02T17:58:58.046 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-10-02T17:58:58.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-02T17:59:01.178 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-10-02T17:59:07.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-02T17:59:10.234 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-10-02T17:59:10.414 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-10-02T17:59:10.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-02T17:59:13.562 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-10-02T17:59:13.790 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-10-02T17:59:16.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-02T17:59:19.290 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-10-02T17:59:19.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-02T17:59:19.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-02T17:59:22.622 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-10-02T17:59:22.842 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-10-02T17:59:25.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-02T17:59:28.346 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-10-02T17:59:28.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-02T17:59:28.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-02T17:59:31.674 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-10-02T17:59:31.898 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-10-02T17:59:34.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-02T17:59:37.403 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-10-02T17:59:37.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-02T17:59:37.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-02T17:59:40.731 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-10-02T17:59:43.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-02T17:59:46.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-02T17:59:49.786 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-10-02T17:59:55.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-02T17:59:56.284 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-10-02T17:59:58.875 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-10-02T18:00:02.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-02T18:00:04.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-02T18:00:05.342 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-10-02T18:00:11.349 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-02T18:00:11.658 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-02T18:00:11.659 DEBUG:teuthology.orchestra.run.smithi031:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-02T18:00:12.097 INFO:teuthology.provision.fog.smithi031:Node is ready 2023-10-02T18:00:12.098 DEBUG:teuthology.orchestra.run.smithi031:> hostname 2023-10-02T18:00:12.114 INFO:teuthology.orchestra.run.smithi031.stdout:smithi022 2023-10-02T18:00:12.114 DEBUG:teuthology.orchestra.run.smithi031:> grep smithi022 /etc/hosts 2023-10-02T18:00:12.171 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-10-02T18:00:12.171 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031 2023-10-02T18:00:12.466 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi022/smithi031/g' /etc/hosts 2023-10-02T18:00:12.495 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/172.21.15.22/172.21.15.31/g' /etc/hosts 2023-10-02T18:00:12.565 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi022/smithi031/g' /etc/hostname 2023-10-02T18:00:12.633 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031 2023-10-02T18:00:12.701 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2023-10-02T18:00:12.758 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="Red Hat Enterprise Linux" 2023-10-02T18:00:12.758 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="8.6 (Ootpa)" 2023-10-02T18:00:12.758 INFO:teuthology.orchestra.run.smithi031.stdout:ID="rhel" 2023-10-02T18:00:12.758 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="fedora" 2023-10-02T18:00:12.758 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="8.6" 2023-10-02T18:00:12.758 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el8" 2023-10-02T18:00:12.758 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-02T18:00:12.758 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31" 2023-10-02T18:00:12.759 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-02T18:00:12.759 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.redhat.com/" 2023-10-02T18:00:12.759 INFO:teuthology.orchestra.run.smithi031.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-02T18:00:12.759 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-02T18:00:12.759 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-02T18:00:12.759 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-02T18:00:12.759 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-02T18:00:12.759 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-02T18:00:12.759 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-02T18:00:12.760 INFO:teuthology.provision.fog.smithi031:Deploy complete! 2023-10-02T18:00:12.761 DEBUG:teuthology.parallel:result is None 2023-10-02T18:00:43.418 WARNING:teuthology.provision.fog.smithi179:timed out 2023-10-02T18:00:49.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-02T18:00:49.757 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-02T18:00:49.757 DEBUG:teuthology.orchestra.run.smithi179:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-02T18:00:50.046 INFO:teuthology.provision.fog.smithi179:Node is ready 2023-10-02T18:00:50.047 DEBUG:teuthology.orchestra.run.smithi179:> hostname 2023-10-02T18:00:50.065 INFO:teuthology.orchestra.run.smithi179.stdout:smithi179 2023-10-02T18:00:50.065 DEBUG:teuthology.orchestra.run.smithi179:> grep smithi179 /etc/hosts 2023-10-02T18:00:50.123 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.15.179 smithi179.front.sepia.ceph.com smithi179 2023-10-02T18:00:50.124 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179 2023-10-02T18:00:50.252 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179/smithi179/g' /etc/hosts 2023-10-02T18:00:50.280 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/172.21.15.179/172.21.15.179/g' /etc/hosts 2023-10-02T18:00:50.347 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179/smithi179/g' /etc/hostname 2023-10-02T18:00:50.416 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179 2023-10-02T18:00:50.482 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2023-10-02T18:00:50.539 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="Red Hat Enterprise Linux" 2023-10-02T18:00:50.539 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="8.6 (Ootpa)" 2023-10-02T18:00:50.539 INFO:teuthology.orchestra.run.smithi179.stdout:ID="rhel" 2023-10-02T18:00:50.539 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="fedora" 2023-10-02T18:00:50.539 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="8.6" 2023-10-02T18:00:50.539 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el8" 2023-10-02T18:00:50.539 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-02T18:00:50.539 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2023-10-02T18:00:50.539 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-02T18:00:50.539 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://www.redhat.com/" 2023-10-02T18:00:50.539 INFO:teuthology.orchestra.run.smithi179.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-02T18:00:50.539 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-02T18:00:50.540 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-02T18:00:50.540 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-02T18:00:50.540 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-02T18:00:50.540 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-02T18:00:50.540 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-02T18:00:50.540 INFO:teuthology.provision.fog.smithi179:Deploy complete! 2023-10-02T18:00:50.541 DEBUG:teuthology.parallel:result is None 2023-10-02T18:01:04.893 WARNING:teuthology.provision.fog.smithi153:timed out 2023-10-02T18:01:10.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-02T18:01:11.235 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-02T18:01:11.236 DEBUG:teuthology.orchestra.run.smithi153:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-02T18:01:11.551 INFO:teuthology.provision.fog.smithi153:Node is ready 2023-10-02T18:01:11.551 DEBUG:teuthology.orchestra.run.smithi153:> hostname 2023-10-02T18:01:11.570 INFO:teuthology.orchestra.run.smithi153.stdout:smithi153.front.sepia.ceph.com 2023-10-02T18:01:11.570 DEBUG:teuthology.orchestra.run.smithi153:> grep smithi153.front.sepia.ceph.com /etc/hosts 2023-10-02T18:01:11.628 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.15.153 smithi153.front.sepia.ceph.com smithi153 2023-10-02T18:01:11.628 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153 2023-10-02T18:01:11.757 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153.front.sepia.ceph.com/smithi153/g' /etc/hosts 2023-10-02T18:01:11.786 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/172.21.15.153/172.21.15.153/g' /etc/hosts 2023-10-02T18:01:11.854 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153.front.sepia.ceph.com/smithi153/g' /etc/hostname 2023-10-02T18:01:11.921 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153 2023-10-02T18:01:11.988 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2023-10-02T18:01:12.044 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="Red Hat Enterprise Linux" 2023-10-02T18:01:12.044 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="8.6 (Ootpa)" 2023-10-02T18:01:12.044 INFO:teuthology.orchestra.run.smithi153.stdout:ID="rhel" 2023-10-02T18:01:12.044 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="fedora" 2023-10-02T18:01:12.045 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="8.6" 2023-10-02T18:01:12.045 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el8" 2023-10-02T18:01:12.045 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-02T18:01:12.045 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31" 2023-10-02T18:01:12.045 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-02T18:01:12.045 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://www.redhat.com/" 2023-10-02T18:01:12.045 INFO:teuthology.orchestra.run.smithi153.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-02T18:01:12.045 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-02T18:01:12.045 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-02T18:01:12.045 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-02T18:01:12.045 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-02T18:01:12.045 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-02T18:01:12.046 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-02T18:01:12.046 INFO:teuthology.provision.fog.smithi153:Deploy complete! 2023-10-02T18:01:12.046 DEBUG:teuthology.parallel:result is None 2023-10-02T18:01:12.230 INFO:teuthology.lock.ops:Checking smithi031.front.sepia.ceph.com 2023-10-02T18:01:12.231 INFO:teuthology.lock.ops:Checking smithi153.front.sepia.ceph.com 2023-10-02T18:01:12.231 INFO:teuthology.lock.ops:Checking smithi179.front.sepia.ceph.com 2023-10-02T18:01:12.231 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-02T18:01:12.257 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: set os type and version on server 2023-10-02T18:01:12.257 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-10-02T18:01:12.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-02T18:01:12.325 DEBUG:teuthology.orchestra.run.smithi031:> true 2023-10-02T18:01:12.460 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-10-02T18:01:12.460 DEBUG:teuthology.orchestra.run.smithi031:> uname -m 2023-10-02T18:01:12.518 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64 2023-10-02T18:01:12.518 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2023-10-02T18:01:12.575 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="Red Hat Enterprise Linux" 2023-10-02T18:01:12.575 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="8.6 (Ootpa)" 2023-10-02T18:01:12.575 INFO:teuthology.orchestra.run.smithi031.stdout:ID="rhel" 2023-10-02T18:01:12.576 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="fedora" 2023-10-02T18:01:12.576 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="8.6" 2023-10-02T18:01:12.576 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el8" 2023-10-02T18:01:12.576 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-02T18:01:12.576 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31" 2023-10-02T18:01:12.576 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-02T18:01:12.576 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.redhat.com/" 2023-10-02T18:01:12.576 INFO:teuthology.orchestra.run.smithi031.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-02T18:01:12.576 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-02T18:01:12.576 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-02T18:01:12.577 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-02T18:01:12.577 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-02T18:01:12.577 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-02T18:01:12.577 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-02T18:01:12.577 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2023-10-02T18:01:12.597 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: set os type and version on server 2023-10-02T18:01:12.598 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-10-02T18:01:12.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-02T18:01:12.663 DEBUG:teuthology.orchestra.run.smithi153:> true 2023-10-02T18:01:12.731 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-10-02T18:01:12.731 DEBUG:teuthology.orchestra.run.smithi153:> uname -m 2023-10-02T18:01:12.787 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2023-10-02T18:01:12.788 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2023-10-02T18:01:12.844 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="Red Hat Enterprise Linux" 2023-10-02T18:01:12.844 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="8.6 (Ootpa)" 2023-10-02T18:01:12.844 INFO:teuthology.orchestra.run.smithi153.stdout:ID="rhel" 2023-10-02T18:01:12.844 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="fedora" 2023-10-02T18:01:12.845 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="8.6" 2023-10-02T18:01:12.845 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el8" 2023-10-02T18:01:12.845 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-02T18:01:12.845 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31" 2023-10-02T18:01:12.845 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-02T18:01:12.845 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://www.redhat.com/" 2023-10-02T18:01:12.845 INFO:teuthology.orchestra.run.smithi153.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-02T18:01:12.845 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-02T18:01:12.845 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-02T18:01:12.845 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-02T18:01:12.845 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-02T18:01:12.845 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-02T18:01:12.846 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-02T18:01:12.846 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2023-10-02T18:01:12.864 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: set os type and version on server 2023-10-02T18:01:12.864 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-10-02T18:01:12.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-02T18:01:12.931 DEBUG:teuthology.orchestra.run.smithi179:> true 2023-10-02T18:01:13.063 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-10-02T18:01:13.064 DEBUG:teuthology.orchestra.run.smithi179:> uname -m 2023-10-02T18:01:13.121 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64 2023-10-02T18:01:13.122 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2023-10-02T18:01:13.180 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="Red Hat Enterprise Linux" 2023-10-02T18:01:13.180 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="8.6 (Ootpa)" 2023-10-02T18:01:13.180 INFO:teuthology.orchestra.run.smithi179.stdout:ID="rhel" 2023-10-02T18:01:13.180 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="fedora" 2023-10-02T18:01:13.181 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="8.6" 2023-10-02T18:01:13.181 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el8" 2023-10-02T18:01:13.181 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-02T18:01:13.181 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2023-10-02T18:01:13.181 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-02T18:01:13.181 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://www.redhat.com/" 2023-10-02T18:01:13.181 INFO:teuthology.orchestra.run.smithi179.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-02T18:01:13.181 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-02T18:01:13.181 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-02T18:01:13.181 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-02T18:01:13.181 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-02T18:01:13.181 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-02T18:01:13.182 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-02T18:01:13.182 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2023-10-02T18:01:13.206 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-02T18:01:13.308 INFO:teuthology.dispatcher.supervisor:Running job 7408606 2023-10-02T18:01:13.308 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_choffman@teuthology --archive /home/teuthworker/archive/choffman-2023-10-02_17:48:08-fs:workload-wip-choffman-62793-distro-default-smithi/7408606 --name choffman-2023-10-02_17:48:08-fs:workload-wip-choffman-62793-distro-default-smithi --description fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/fs/misc}} -- /home/teuthworker/archive/choffman-2023-10-02_17:48:08-fs:workload-wip-choffman-62793-distro-default-smithi/7408606/orig.config.yaml 2023-10-02T18:01:13.311 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/choffman-2023-10-02_17:48:08-fs:workload-wip-choffman-62793-distro-default-smithi/7408606 2023-10-02T18:01:13.311 INFO:teuthology.dispatcher.supervisor:Job PID: 789781 2023-10-02T18:01:13.311 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-02T18:03:13.410 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-02T18:05:13.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-02T18:07:13.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-02T18:09:13.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-02T18:11:14.059 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-02T18:13:14.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-02T18:15:14.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-02T18:17:14.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-02T18:19:14.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-02T18:21:14.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-02T18:23:15.048 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-02T18:25:15.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-02T18:27:15.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-02T18:29:15.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-02T18:31:15.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-02T18:33:15.810 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-02T18:35:15.980 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-02T18:37:16.136 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-02T18:39:16.304 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-02T18:41:16.427 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-02T18:43:16.502 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-02T18:45:16.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-02T18:47:16.820 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-02T18:49:16.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-02T18:51:17.084 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-02T18:53:17.270 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-02T18:55:17.418 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-02T18:57:17.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-02T18:59:17.646 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-02T19:01:17.825 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-02T19:03:17.989 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-02T19:05:18.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-02T19:07:18.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-02T19:09:18.417 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-02T19:11:18.558 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-02T19:13:18.686 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-02T19:15:18.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-02T19:17:18.953 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-02T19:19:19.042 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-02T19:21:19.146 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-02T19:23:19.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-02T19:25:19.429 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-02T19:27:19.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-02T19:29:19.740 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-02T19:31:19.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-02T19:31:19.971 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-10-02T19:31:20.161 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-02T19:31:20.162 INFO:teuthology.nuke:Checking targets against current locks 2023-10-02T19:31:20.222 DEBUG:teuthology.nuke:shortname: smithi031 2023-10-02T19:31:20.223 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-02T19:31:20.248 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-10-02_17:48:08-fs:workload-wip-choffman-62793-distro-default-smithi/7408606', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-02 17:56:02.099711', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-02T19:31:20.249 DEBUG:teuthology.nuke:shortname: smithi153 2023-10-02T19:31:20.250 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-02T19:31:20.271 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-10-02_17:48:08-fs:workload-wip-choffman-62793-distro-default-smithi/7408606', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-02 17:56:02.101055', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-02T19:31:20.275 DEBUG:teuthology.nuke:shortname: smithi179 2023-10-02T19:31:20.276 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-02T19:31:20.303 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-10-02_17:48:08-fs:workload-wip-choffman-62793-distro-default-smithi/7408606', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-02 17:56:02.102246', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-02T19:31:20.311 INFO:teuthology.orchestra.console.smithi031:Power off 2023-10-02T19:31:20.313 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-02T19:31:20.334 DEBUG:teuthology.orchestra.console.smithi031:power off output: Chassis Power Control: Down/Off 2023-10-02T19:31:20.335 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-02T19:31:20.352 INFO:teuthology.orchestra.console.smithi153:Power off 2023-10-02T19:31:20.353 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-02T19:31:20.362 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2023-10-02T19:31:20.373 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off 2023-10-02T19:31:20.374 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-02T19:31:20.386 INFO:teuthology.orchestra.console.smithi179:Power off 2023-10-02T19:31:20.387 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-02T19:31:20.395 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2023-10-02T19:31:20.409 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off 2023-10-02T19:31:20.409 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-02T19:31:20.430 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-10-02T19:31:20.464 INFO:teuthology.orchestra.console.smithi031:Power off completed 2023-10-02T19:31:20.496 INFO:teuthology.orchestra.console.smithi153:Power off completed 2023-10-02T19:31:20.531 INFO:teuthology.orchestra.console.smithi179:Power off completed 2023-10-02T19:31:20.612 INFO:teuthology.lock.ops:unlocked: smithi031.front.sepia.ceph.com 2023-10-02T19:31:20.645 INFO:teuthology.lock.ops:unlocked: smithi153.front.sepia.ceph.com 2023-10-02T19:31:20.679 INFO:teuthology.lock.ops:unlocked: smithi179.front.sepia.ceph.com