2023-11-08T12:55:32.995 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-08T12:55:32.997 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T12:55:33.176 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8d2929d670>, signals=[15]) 2023-11-08T12:55:33.177 INFO:teuthology.lock.ops:Start node 'smithi029.front.sepia.ceph.com' reimaging 2023-11-08T12:55:33.179 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: reset os type and version on server 2023-11-08T12:55:33.179 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2023-11-08T12:55:33.213 INFO:teuthology.lock.ops:Start node 'smithi032.front.sepia.ceph.com' reimaging 2023-11-08T12:55:33.214 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: reset os type and version on server 2023-11-08T12:55:33.214 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2023-11-08T12:55:33.215 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /host {"name": "smithi029"} 2023-11-08T12:55:33.238 INFO:teuthology.lock.ops:Start node 'smithi060.front.sepia.ceph.com' reimaging 2023-11-08T12:55:33.238 INFO:teuthology.lock.ops:Updating [smithi060.front.sepia.ceph.com]: reset os type and version on server 2023-11-08T12:55:33.239 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server 2023-11-08T12:55:33.240 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /host {"name": "smithi032"} 2023-11-08T12:55:33.255 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /host {"name": "smithi060"} 2023-11-08T12:55:33.284 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-11-08T12:55:33.314 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-11-08T12:55:33.328 DEBUG:teuthology.provision.fog.smithi029:Requesting image smithi_rhel_8.6 (ID 5) 2023-11-08T12:55:33.328 DEBUG:teuthology.provision.fog.smithi029:FOG request: PUT /host/134 {"imageID": 5} 2023-11-08T12:55:33.340 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-11-08T12:55:33.359 DEBUG:teuthology.provision.fog.smithi032:Requesting image smithi_rhel_8.6 (ID 5) 2023-11-08T12:55:33.359 DEBUG:teuthology.provision.fog.smithi032:FOG request: PUT /host/137 {"imageID": 5} 2023-11-08T12:55:33.390 INFO:teuthology.provision.fog.smithi029:Scheduling deploy of rhel 8.6 2023-11-08T12:55:33.390 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-11-08T12:55:33.391 DEBUG:teuthology.provision.fog.smithi060:Requesting image smithi_rhel_8.6 (ID 5) 2023-11-08T12:55:33.392 DEBUG:teuthology.provision.fog.smithi060:FOG request: PUT /host/165 {"imageID": 5} 2023-11-08T12:55:33.415 INFO:teuthology.provision.fog.smithi032:Scheduling deploy of rhel 8.6 2023-11-08T12:55:33.415 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-11-08T12:55:33.432 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /tasktype {"name": "deploy"} 2023-11-08T12:55:33.448 INFO:teuthology.provision.fog.smithi060:Scheduling deploy of rhel 8.6 2023-11-08T12:55:33.449 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-11-08T12:55:33.463 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /tasktype {"name": "deploy"} 2023-11-08T12:55:33.468 DEBUG:teuthology.provision.fog.smithi029:FOG request: POST /host/134/task {"taskTypeID": 1} 2023-11-08T12:55:33.508 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /tasktype {"name": "deploy"} 2023-11-08T12:55:33.511 DEBUG:teuthology.provision.fog.smithi032:FOG request: POST /host/137/task {"taskTypeID": 1} 2023-11-08T12:55:33.519 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-11-08T12:55:33.543 DEBUG:teuthology.provision.fog.smithi060:FOG request: POST /host/165/task {"taskTypeID": 1} 2023-11-08T12:55:33.573 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-11-08T12:55:33.611 INFO:teuthology.orchestra.console.smithi029:Power off 2023-11-08T12:55:33.612 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-08T12:55:33.620 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-11-08T12:55:33.634 DEBUG:teuthology.orchestra.console.smithi029:power off output: Chassis Power Control: Down/Off 2023-11-08T12:55:33.634 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T12:55:33.651 INFO:teuthology.orchestra.console.smithi032:Power off 2023-11-08T12:55:33.651 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-08T12:55:33.660 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on 2023-11-08T12:55:33.674 DEBUG:teuthology.orchestra.console.smithi032:power off output: Chassis Power Control: Down/Off 2023-11-08T12:55:33.675 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T12:55:33.697 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on 2023-11-08T12:55:33.711 INFO:teuthology.orchestra.console.smithi060:Power off 2023-11-08T12:55:33.711 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-08T12:55:33.733 DEBUG:teuthology.orchestra.console.smithi060:power off output: Chassis Power Control: Down/Off 2023-11-08T12:55:33.734 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T12:55:33.757 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is on 2023-11-08T12:55:37.662 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T12:55:37.698 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T12:55:37.759 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T12:55:37.772 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on 2023-11-08T12:55:37.807 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on 2023-11-08T12:55:37.867 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is on 2023-11-08T12:55:41.774 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T12:55:41.808 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T12:55:41.869 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T12:55:41.884 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on 2023-11-08T12:55:41.918 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on 2023-11-08T12:55:41.978 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is off 2023-11-08T12:55:42.079 INFO:teuthology.orchestra.console.smithi060:Power off completed 2023-11-08T12:55:42.179 INFO:teuthology.orchestra.console.smithi060:Power on 2023-11-08T12:55:42.180 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-08T12:55:42.202 DEBUG:teuthology.orchestra.console.smithi060:power on output: Chassis Power Control: Up/On 2023-11-08T12:55:42.202 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T12:55:42.225 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is off 2023-11-08T12:55:45.886 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T12:55:45.919 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T12:55:45.995 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off 2023-11-08T12:55:46.029 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off 2023-11-08T12:55:46.096 INFO:teuthology.orchestra.console.smithi029:Power off completed 2023-11-08T12:55:46.130 INFO:teuthology.orchestra.console.smithi032:Power off completed 2023-11-08T12:55:46.198 INFO:teuthology.orchestra.console.smithi029:Power on 2023-11-08T12:55:46.198 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-08T12:55:46.221 DEBUG:teuthology.orchestra.console.smithi029:power on output: Chassis Power Control: Up/On 2023-11-08T12:55:46.221 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T12:55:46.229 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T12:55:46.236 INFO:teuthology.orchestra.console.smithi032:Power on 2023-11-08T12:55:46.237 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-08T12:55:46.246 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off 2023-11-08T12:55:46.257 DEBUG:teuthology.orchestra.console.smithi032:power on output: Chassis Power Control: Up/On 2023-11-08T12:55:46.258 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T12:55:46.279 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off 2023-11-08T12:55:46.338 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is off 2023-11-08T12:55:50.250 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T12:55:50.280 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T12:55:50.339 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T12:55:50.363 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on 2023-11-08T12:55:50.390 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on 2023-11-08T12:55:50.449 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is on 2023-11-08T12:55:50.464 INFO:teuthology.orchestra.console.smithi029:Power on completed 2023-11-08T12:55:50.491 INFO:teuthology.orchestra.console.smithi032:Power on completed 2023-11-08T12:55:50.550 INFO:teuthology.orchestra.console.smithi060:Power on completed 2023-11-08T12:55:50.565 INFO:teuthology.provision.fog.smithi029:Waiting for deploy to finish 2023-11-08T12:55:50.566 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-11-08T12:55:50.592 INFO:teuthology.provision.fog.smithi032:Waiting for deploy to finish 2023-11-08T12:55:50.592 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-11-08T12:55:50.650 INFO:teuthology.provision.fog.smithi060:Waiting for deploy to finish 2023-11-08T12:55:50.651 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-11-08T12:56:05.644 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-11-08T12:56:05.649 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-11-08T12:56:05.707 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-11-08T12:56:20.729 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-11-08T12:56:20.732 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-11-08T12:56:20.770 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-11-08T12:56:35.814 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-11-08T12:56:35.816 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-11-08T12:56:35.828 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-11-08T12:56:50.895 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-11-08T12:56:50.897 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-11-08T12:56:50.898 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-11-08T12:57:05.986 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-11-08T12:57:05.988 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-11-08T12:57:05.989 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-11-08T12:57:21.062 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-11-08T12:57:21.064 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-11-08T12:57:21.065 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-11-08T12:57:36.146 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-11-08T12:57:36.148 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-11-08T12:57:36.149 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-11-08T12:57:51.246 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-11-08T12:57:51.247 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-11-08T12:57:51.248 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-11-08T12:58:06.350 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-11-08T12:58:06.352 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-11-08T12:58:06.353 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-11-08T12:58:21.463 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-11-08T12:58:21.476 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-11-08T12:58:21.477 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-11-08T12:58:21.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T12:58:21.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T12:58:24.634 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60 2023-11-08T12:58:24.635 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-11-08T12:58:30.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T12:58:30.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T12:58:33.690 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60 2023-11-08T12:58:33.691 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-11-08T12:58:36.566 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-11-08T12:58:39.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T12:58:39.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T12:58:42.746 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60 2023-11-08T12:58:42.778 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-11-08T12:58:48.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T12:58:48.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T12:58:51.650 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-11-08T12:58:51.806 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60 2023-11-08T12:58:51.834 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-11-08T12:58:57.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T12:58:57.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T12:59:00.890 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60 2023-11-08T12:59:06.730 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-11-08T12:59:06.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T12:59:06.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T12:59:09.882 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2023-11-08T12:59:15.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T12:59:18.938 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2023-11-08T12:59:24.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T12:59:28.026 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2023-11-08T12:59:34.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T12:59:37.114 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2023-11-08T12:59:43.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T12:59:46.174 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2023-11-08T12:59:52.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T12:59:57.843 WARNING:teuthology.provision.fog.smithi032:timed out 2023-11-08T13:00:03.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T13:00:04.086 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-08T13:00:04.087 DEBUG:teuthology.orchestra.run.smithi032:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-08T13:00:04.367 INFO:teuthology.provision.fog.smithi032:Node is ready 2023-11-08T13:00:04.368 DEBUG:teuthology.orchestra.run.smithi032:> hostname 2023-11-08T13:00:04.387 INFO:teuthology.orchestra.run.smithi032.stdout:smithi032.front.sepia.ceph.com 2023-11-08T13:00:04.387 DEBUG:teuthology.orchestra.run.smithi032:> grep smithi032.front.sepia.ceph.com /etc/hosts 2023-11-08T13:00:04.445 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32 smithi032.front.sepia.ceph.com smithi032 2023-11-08T13:00:04.446 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname smithi032 2023-11-08T13:00:04.573 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/smithi032.front.sepia.ceph.com/smithi032/g' /etc/hosts 2023-11-08T13:00:04.603 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/172.21.15.32/172.21.15.32/g' /etc/hosts 2023-11-08T13:00:04.694 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/smithi032.front.sepia.ceph.com/smithi032/g' /etc/hostname 2023-11-08T13:00:04.822 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname smithi032 2023-11-08T13:00:04.856 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release 2023-11-08T13:00:04.914 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="Red Hat Enterprise Linux" 2023-11-08T13:00:04.915 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="8.6 (Ootpa)" 2023-11-08T13:00:04.915 INFO:teuthology.orchestra.run.smithi032.stdout:ID="rhel" 2023-11-08T13:00:04.915 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="fedora" 2023-11-08T13:00:04.915 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="8.6" 2023-11-08T13:00:04.915 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el8" 2023-11-08T13:00:04.916 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-08T13:00:04.916 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31" 2023-11-08T13:00:04.916 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-08T13:00:04.916 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://www.redhat.com/" 2023-11-08T13:00:04.916 INFO:teuthology.orchestra.run.smithi032.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-08T13:00:04.917 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-08T13:00:04.917 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-11-08T13:00:04.917 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-08T13:00:04.917 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-08T13:00:04.917 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-08T13:00:04.918 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-08T13:00:04.922 INFO:teuthology.provision.fog.smithi032:Deploy complete! 2023-11-08T13:00:04.923 DEBUG:teuthology.parallel:result is None 2023-11-08T13:00:06.894 WARNING:teuthology.provision.fog.smithi060:timed out 2023-11-08T13:00:12.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T13:00:13.240 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-08T13:00:13.241 DEBUG:teuthology.orchestra.run.smithi060:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-08T13:00:13.575 INFO:teuthology.provision.fog.smithi060:Node is ready 2023-11-08T13:00:13.575 DEBUG:teuthology.orchestra.run.smithi060:> hostname 2023-11-08T13:00:13.593 INFO:teuthology.orchestra.run.smithi060.stdout:smithi060.front.sepia.ceph.com 2023-11-08T13:00:13.594 DEBUG:teuthology.orchestra.run.smithi060:> grep smithi060.front.sepia.ceph.com /etc/hosts 2023-11-08T13:00:13.652 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60 smithi060.front.sepia.ceph.com smithi060 2023-11-08T13:00:13.653 DEBUG:teuthology.orchestra.run.smithi060:> sudo hostname smithi060 2023-11-08T13:00:13.775 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i -e 's/smithi060.front.sepia.ceph.com/smithi060/g' /etc/hosts 2023-11-08T13:00:13.806 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i -e 's/172.21.15.60/172.21.15.60/g' /etc/hosts 2023-11-08T13:00:13.875 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i -e 's/smithi060.front.sepia.ceph.com/smithi060/g' /etc/hostname 2023-11-08T13:00:13.944 DEBUG:teuthology.orchestra.run.smithi060:> sudo hostname smithi060 2023-11-08T13:00:14.012 DEBUG:teuthology.orchestra.run.smithi060:> cat /etc/os-release 2023-11-08T13:00:14.069 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="Red Hat Enterprise Linux" 2023-11-08T13:00:14.070 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="8.6 (Ootpa)" 2023-11-08T13:00:14.070 INFO:teuthology.orchestra.run.smithi060.stdout:ID="rhel" 2023-11-08T13:00:14.070 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE="fedora" 2023-11-08T13:00:14.070 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="8.6" 2023-11-08T13:00:14.070 INFO:teuthology.orchestra.run.smithi060.stdout:PLATFORM_ID="platform:el8" 2023-11-08T13:00:14.071 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-08T13:00:14.071 INFO:teuthology.orchestra.run.smithi060.stdout:ANSI_COLOR="0;31" 2023-11-08T13:00:14.071 INFO:teuthology.orchestra.run.smithi060.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-08T13:00:14.071 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://www.redhat.com/" 2023-11-08T13:00:14.071 INFO:teuthology.orchestra.run.smithi060.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-08T13:00:14.072 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-08T13:00:14.072 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-11-08T13:00:14.072 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-08T13:00:14.072 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-08T13:00:14.072 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-08T13:00:14.073 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-08T13:00:14.073 INFO:teuthology.provision.fog.smithi060:Deploy complete! 2023-11-08T13:00:14.074 DEBUG:teuthology.parallel:result is None 2023-11-08T13:00:52.219 WARNING:teuthology.provision.fog.smithi029:timed out 2023-11-08T13:00:58.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T13:00:58.551 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-08T13:00:58.552 DEBUG:teuthology.orchestra.run.smithi029:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-08T13:00:58.875 INFO:teuthology.provision.fog.smithi029:Node is ready 2023-11-08T13:00:58.876 DEBUG:teuthology.orchestra.run.smithi029:> hostname 2023-11-08T13:00:58.894 INFO:teuthology.orchestra.run.smithi029.stdout:smithi029.front.sepia.ceph.com 2023-11-08T13:00:58.895 DEBUG:teuthology.orchestra.run.smithi029:> grep smithi029.front.sepia.ceph.com /etc/hosts 2023-11-08T13:00:58.954 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29 smithi029.front.sepia.ceph.com smithi029 2023-11-08T13:00:58.954 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname smithi029 2023-11-08T13:00:59.094 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/smithi029.front.sepia.ceph.com/smithi029/g' /etc/hosts 2023-11-08T13:00:59.125 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/172.21.15.29/172.21.15.29/g' /etc/hosts 2023-11-08T13:00:59.195 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/smithi029.front.sepia.ceph.com/smithi029/g' /etc/hostname 2023-11-08T13:00:59.264 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname smithi029 2023-11-08T13:00:59.333 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2023-11-08T13:00:59.390 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="Red Hat Enterprise Linux" 2023-11-08T13:00:59.391 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="8.6 (Ootpa)" 2023-11-08T13:00:59.391 INFO:teuthology.orchestra.run.smithi029.stdout:ID="rhel" 2023-11-08T13:00:59.391 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="fedora" 2023-11-08T13:00:59.391 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="8.6" 2023-11-08T13:00:59.391 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el8" 2023-11-08T13:00:59.391 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-08T13:00:59.392 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31" 2023-11-08T13:00:59.392 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-08T13:00:59.392 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://www.redhat.com/" 2023-11-08T13:00:59.392 INFO:teuthology.orchestra.run.smithi029.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-08T13:00:59.392 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-08T13:00:59.393 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-11-08T13:00:59.393 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-08T13:00:59.393 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-08T13:00:59.393 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-08T13:00:59.393 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-08T13:00:59.394 INFO:teuthology.provision.fog.smithi029:Deploy complete! 2023-11-08T13:00:59.394 DEBUG:teuthology.parallel:result is None 2023-11-08T13:00:59.585 INFO:teuthology.lock.ops:Checking smithi029.front.sepia.ceph.com 2023-11-08T13:00:59.586 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-08T13:00:59.609 INFO:teuthology.lock.ops:Checking smithi032.front.sepia.ceph.com 2023-11-08T13:00:59.610 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-08T13:00:59.642 INFO:teuthology.lock.ops:Checking smithi060.front.sepia.ceph.com 2023-11-08T13:00:59.643 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-08T13:00:59.660 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: set os type and version on server 2023-11-08T13:00:59.661 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-11-08T13:00:59.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T13:00:59.727 DEBUG:teuthology.orchestra.run.smithi029:> true 2023-11-08T13:00:59.800 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-11-08T13:00:59.800 DEBUG:teuthology.orchestra.run.smithi029:> uname -m 2023-11-08T13:00:59.857 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64 2023-11-08T13:00:59.858 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2023-11-08T13:00:59.915 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="Red Hat Enterprise Linux" 2023-11-08T13:00:59.915 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="8.6 (Ootpa)" 2023-11-08T13:00:59.916 INFO:teuthology.orchestra.run.smithi029.stdout:ID="rhel" 2023-11-08T13:00:59.916 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="fedora" 2023-11-08T13:00:59.916 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="8.6" 2023-11-08T13:00:59.916 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el8" 2023-11-08T13:00:59.916 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-08T13:00:59.917 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31" 2023-11-08T13:00:59.917 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-08T13:00:59.917 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://www.redhat.com/" 2023-11-08T13:00:59.917 INFO:teuthology.orchestra.run.smithi029.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-08T13:00:59.917 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-08T13:00:59.918 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-11-08T13:00:59.918 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-08T13:00:59.918 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-08T13:00:59.918 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-08T13:00:59.918 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-08T13:00:59.919 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2023-11-08T13:00:59.943 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: set os type and version on server 2023-11-08T13:00:59.943 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2023-11-08T13:00:59.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T13:01:00.011 DEBUG:teuthology.orchestra.run.smithi032:> true 2023-11-08T13:01:00.101 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com' 2023-11-08T13:01:00.102 DEBUG:teuthology.orchestra.run.smithi032:> uname -m 2023-11-08T13:01:00.160 INFO:teuthology.orchestra.run.smithi032.stdout:x86_64 2023-11-08T13:01:00.160 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release 2023-11-08T13:01:00.218 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="Red Hat Enterprise Linux" 2023-11-08T13:01:00.218 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="8.6 (Ootpa)" 2023-11-08T13:01:00.218 INFO:teuthology.orchestra.run.smithi032.stdout:ID="rhel" 2023-11-08T13:01:00.219 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="fedora" 2023-11-08T13:01:00.219 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="8.6" 2023-11-08T13:01:00.219 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el8" 2023-11-08T13:01:00.219 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-08T13:01:00.219 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31" 2023-11-08T13:01:00.220 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-08T13:01:00.220 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://www.redhat.com/" 2023-11-08T13:01:00.220 INFO:teuthology.orchestra.run.smithi032.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-08T13:01:00.220 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-08T13:01:00.221 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-11-08T13:01:00.221 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-08T13:01:00.221 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-08T13:01:00.221 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-08T13:01:00.222 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-08T13:01:00.222 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2023-11-08T13:01:00.243 INFO:teuthology.lock.ops:Updating [smithi060.front.sepia.ceph.com]: set os type and version on server 2023-11-08T13:01:00.243 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2023-11-08T13:01:00.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T13:01:00.310 DEBUG:teuthology.orchestra.run.smithi060:> true 2023-11-08T13:01:00.445 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi060.front.sepia.ceph.com' 2023-11-08T13:01:00.445 DEBUG:teuthology.orchestra.run.smithi060:> uname -m 2023-11-08T13:01:00.503 INFO:teuthology.orchestra.run.smithi060.stdout:x86_64 2023-11-08T13:01:00.503 DEBUG:teuthology.orchestra.run.smithi060:> cat /etc/os-release 2023-11-08T13:01:00.561 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="Red Hat Enterprise Linux" 2023-11-08T13:01:00.561 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="8.6 (Ootpa)" 2023-11-08T13:01:00.561 INFO:teuthology.orchestra.run.smithi060.stdout:ID="rhel" 2023-11-08T13:01:00.562 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE="fedora" 2023-11-08T13:01:00.562 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="8.6" 2023-11-08T13:01:00.562 INFO:teuthology.orchestra.run.smithi060.stdout:PLATFORM_ID="platform:el8" 2023-11-08T13:01:00.562 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-08T13:01:00.562 INFO:teuthology.orchestra.run.smithi060.stdout:ANSI_COLOR="0;31" 2023-11-08T13:01:00.563 INFO:teuthology.orchestra.run.smithi060.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-08T13:01:00.563 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://www.redhat.com/" 2023-11-08T13:01:00.563 INFO:teuthology.orchestra.run.smithi060.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-08T13:01:00.563 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-08T13:01:00.563 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-11-08T13:01:00.563 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-08T13:01:00.564 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-08T13:01:00.564 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-08T13:01:00.564 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-08T13:01:00.565 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server 2023-11-08T13:01:00.593 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T13:01:00.685 INFO:teuthology.dispatcher.supervisor:Running job 7450502 2023-11-08T13:01:00.685 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-11-07_06:04:04-fs-wip-vshankar-testing-20231107.042705-testing-default-smithi/7450502 --name vshankar-2023-11-07_06:04:04-fs-wip-vshankar-testing-20231107.042705-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/fs/misc}} -- /home/teuthworker/archive/vshankar-2023-11-07_06:04:04-fs-wip-vshankar-testing-20231107.042705-testing-default-smithi/7450502/orig.config.yaml 2023-11-08T13:01:00.688 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-11-07_06:04:04-fs-wip-vshankar-testing-20231107.042705-testing-default-smithi/7450502 2023-11-08T13:01:00.689 INFO:teuthology.dispatcher.supervisor:Job PID: 3949975 2023-11-08T13:01:00.689 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-08T13:03:00.786 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T13:05:00.962 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T13:07:01.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T13:09:01.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T13:11:01.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T13:13:01.636 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T13:15:01.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T13:17:01.978 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T13:19:02.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T13:21:02.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T13:23:02.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T13:25:02.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T13:27:02.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T13:29:03.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T13:31:03.170 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T13:33:03.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T13:35:03.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T13:37:03.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T13:39:03.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T13:41:03.997 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T13:43:04.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T13:45:04.340 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T13:47:04.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T13:49:04.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T13:51:04.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T13:53:05.052 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T13:55:05.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T13:57:05.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T13:59:05.557 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T14:01:05.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T14:03:05.877 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T14:05:06.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T14:07:06.217 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T14:09:06.384 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T14:11:06.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T14:13:06.757 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T14:15:06.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T14:17:07.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T14:19:07.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T14:21:07.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T14:23:07.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T14:25:07.748 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T14:27:07.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T14:29:08.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T14:31:08.248 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T14:33:08.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T14:35:08.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T14:37:08.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T14:39:08.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T14:41:09.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T14:43:09.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T14:45:09.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T14:47:09.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T14:49:09.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T14:51:09.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T14:53:10.154 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T14:55:10.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T14:57:10.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T14:59:10.656 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T15:01:10.825 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T15:03:10.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T15:05:11.152 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T15:07:11.320 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T15:09:11.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T15:11:11.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T15:13:11.812 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T15:15:11.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T15:17:12.146 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T15:19:12.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T15:19:12.384 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-11-08T15:19:12.645 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-08T15:19:12.645 INFO:teuthology.nuke:Checking targets against current locks 2023-11-08T15:19:12.686 DEBUG:teuthology.nuke:shortname: smithi029 2023-11-08T15:19:12.687 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-08T15:19:12.715 DEBUG:teuthology.nuke:shortname: smithi032 2023-11-08T15:19:12.715 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-08T15:19:12.719 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi029.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-07_06:04:04-fs-wip-vshankar-testing-20231107.042705-testing-default-smithi/7450502', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-08 12:55:32.138656', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-08T15:19:12.742 DEBUG:teuthology.nuke:shortname: smithi060 2023-11-08T15:19:12.743 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-08T15:19:12.747 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi032.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-07_06:04:04-fs-wip-vshankar-testing-20231107.042705-testing-default-smithi/7450502', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-08 12:55:32.135688', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-08T15:19:12.777 INFO:teuthology.orchestra.console.smithi029:Power off 2023-11-08T15:19:12.778 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-08T15:19:12.787 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi060.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-07_06:04:04-fs-wip-vshankar-testing-20231107.042705-testing-default-smithi/7450502', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-08 12:55:32.137223', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-08T15:19:12.802 DEBUG:teuthology.orchestra.console.smithi029:power off output: Chassis Power Control: Down/Off 2023-11-08T15:19:12.803 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T15:19:12.817 INFO:teuthology.orchestra.console.smithi032:Power off 2023-11-08T15:19:12.818 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-08T15:19:12.827 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off 2023-11-08T15:19:12.839 DEBUG:teuthology.orchestra.console.smithi032:power off output: Chassis Power Control: Down/Off 2023-11-08T15:19:12.839 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T15:19:12.853 INFO:teuthology.orchestra.console.smithi060:Power off 2023-11-08T15:19:12.853 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-08T15:19:12.861 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off 2023-11-08T15:19:12.873 DEBUG:teuthology.orchestra.console.smithi060:power off output: Chassis Power Control: Down/Off 2023-11-08T15:19:12.874 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T15:19:12.894 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is off 2023-11-08T15:19:12.928 INFO:teuthology.orchestra.console.smithi029:Power off completed 2023-11-08T15:19:12.962 INFO:teuthology.orchestra.console.smithi032:Power off completed 2023-11-08T15:19:12.995 INFO:teuthology.orchestra.console.smithi060:Power off completed 2023-11-08T15:19:13.073 INFO:teuthology.lock.ops:unlocked: smithi029.front.sepia.ceph.com 2023-11-08T15:19:13.107 INFO:teuthology.lock.ops:unlocked: smithi032.front.sepia.ceph.com 2023-11-08T15:19:13.140 INFO:teuthology.lock.ops:unlocked: smithi060.front.sepia.ceph.com