2023-11-15T14:00:26.004 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-15T14:00:26.006 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T14:00:26.181 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fbea42cf670>, signals=[15]) 2023-11-15T14:00:26.182 INFO:teuthology.lock.ops:Start node 'smithi027.front.sepia.ceph.com' reimaging 2023-11-15T14:00:26.183 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: reset os type and version on server 2023-11-15T14:00:26.183 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2023-11-15T14:00:26.203 INFO:teuthology.lock.ops:Start node 'smithi067.front.sepia.ceph.com' reimaging 2023-11-15T14:00:26.204 INFO:teuthology.lock.ops:Updating [smithi067.front.sepia.ceph.com]: reset os type and version on server 2023-11-15T14:00:26.205 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server 2023-11-15T14:00:26.206 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /host {"name": "smithi027"} 2023-11-15T14:00:26.228 INFO:teuthology.lock.ops:Start node 'smithi132.front.sepia.ceph.com' reimaging 2023-11-15T14:00:26.228 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: reset os type and version on server 2023-11-15T14:00:26.229 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2023-11-15T14:00:26.230 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /host {"name": "smithi067"} 2023-11-15T14:00:26.253 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /host {"name": "smithi132"} 2023-11-15T14:00:26.285 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-11-15T14:00:26.304 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-11-15T14:00:26.329 DEBUG:teuthology.provision.fog.smithi027:Requesting image smithi_rhel_8.6 (ID 5) 2023-11-15T14:00:26.329 DEBUG:teuthology.provision.fog.smithi027:FOG request: PUT /host/132 {"imageID": 5} 2023-11-15T14:00:26.333 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-11-15T14:00:26.346 DEBUG:teuthology.provision.fog.smithi067:Requesting image smithi_rhel_8.6 (ID 5) 2023-11-15T14:00:26.347 DEBUG:teuthology.provision.fog.smithi067:FOG request: PUT /host/172 {"imageID": 5} 2023-11-15T14:00:26.374 INFO:teuthology.provision.fog.smithi027:Scheduling deploy of rhel 8.6 2023-11-15T14:00:26.374 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-11-15T14:00:26.387 DEBUG:teuthology.provision.fog.smithi132:Requesting image smithi_rhel_8.6 (ID 5) 2023-11-15T14:00:26.387 DEBUG:teuthology.provision.fog.smithi132:FOG request: PUT /host/237 {"imageID": 5} 2023-11-15T14:00:26.398 INFO:teuthology.provision.fog.smithi067:Scheduling deploy of rhel 8.6 2023-11-15T14:00:26.399 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-11-15T14:00:26.419 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /tasktype {"name": "deploy"} 2023-11-15T14:00:26.434 INFO:teuthology.provision.fog.smithi132:Scheduling deploy of rhel 8.6 2023-11-15T14:00:26.434 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-11-15T14:00:26.437 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /tasktype {"name": "deploy"} 2023-11-15T14:00:26.464 DEBUG:teuthology.provision.fog.smithi027:FOG request: POST /host/132/task {"taskTypeID": 1} 2023-11-15T14:00:26.473 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /tasktype {"name": "deploy"} 2023-11-15T14:00:26.481 DEBUG:teuthology.provision.fog.smithi067:FOG request: POST /host/172/task {"taskTypeID": 1} 2023-11-15T14:00:26.505 DEBUG:teuthology.provision.fog.smithi132:FOG request: POST /host/237/task {"taskTypeID": 1} 2023-11-15T14:00:26.519 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-11-15T14:00:26.528 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-11-15T14:00:26.551 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-11-15T14:00:26.610 INFO:teuthology.orchestra.console.smithi027:Power off 2023-11-15T14:00:26.611 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-15T14:00:26.625 INFO:teuthology.orchestra.console.smithi132:Power off 2023-11-15T14:00:26.625 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-15T14:00:26.639 INFO:teuthology.orchestra.console.smithi067:Power off 2023-11-15T14:00:26.640 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-15T14:00:26.648 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off 2023-11-15T14:00:26.648 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T14:00:26.655 DEBUG:teuthology.orchestra.console.smithi027:power off output: Chassis Power Control: Down/Off 2023-11-15T14:00:26.656 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T14:00:26.665 DEBUG:teuthology.orchestra.console.smithi067:power off output: Chassis Power Control: Down/Off 2023-11-15T14:00:26.666 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T14:00:26.677 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2023-11-15T14:00:26.680 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2023-11-15T14:00:26.689 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on 2023-11-15T14:00:30.682 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T14:00:30.690 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T14:00:30.697 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T14:00:30.792 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2023-11-15T14:00:30.800 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2023-11-15T14:00:30.806 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on 2023-11-15T14:00:34.798 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T14:00:34.806 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T14:00:34.815 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T14:00:34.908 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2023-11-15T14:00:34.917 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2023-11-15T14:00:34.927 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is off 2023-11-15T14:00:35.010 INFO:teuthology.orchestra.console.smithi132:Power off completed 2023-11-15T14:00:35.019 INFO:teuthology.orchestra.console.smithi027:Power off completed 2023-11-15T14:00:35.028 INFO:teuthology.orchestra.console.smithi067:Power off completed 2023-11-15T14:00:35.111 INFO:teuthology.orchestra.console.smithi132:Power on 2023-11-15T14:00:35.112 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-15T14:00:35.120 INFO:teuthology.orchestra.console.smithi027:Power on 2023-11-15T14:00:35.121 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-15T14:00:35.130 INFO:teuthology.orchestra.console.smithi067:Power on 2023-11-15T14:00:35.131 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-15T14:00:35.141 DEBUG:teuthology.orchestra.console.smithi132:power on output: Chassis Power Control: Up/On 2023-11-15T14:00:35.142 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T14:00:35.151 DEBUG:teuthology.orchestra.console.smithi027:power on output: Chassis Power Control: Up/On 2023-11-15T14:00:35.151 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T14:00:35.159 DEBUG:teuthology.orchestra.console.smithi067:power on output: Chassis Power Control: Up/On 2023-11-15T14:00:35.160 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T14:00:35.169 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2023-11-15T14:00:35.175 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2023-11-15T14:00:35.181 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is off 2023-11-15T14:00:39.170 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T14:00:39.178 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T14:00:39.187 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T14:00:39.280 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2023-11-15T14:00:39.288 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2023-11-15T14:00:39.296 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is off 2023-11-15T14:00:43.285 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T14:00:43.293 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T14:00:43.300 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T14:00:43.395 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2023-11-15T14:00:43.402 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2023-11-15T14:00:43.412 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on 2023-11-15T14:00:43.496 INFO:teuthology.orchestra.console.smithi132:Power on completed 2023-11-15T14:00:43.503 INFO:teuthology.orchestra.console.smithi027:Power on completed 2023-11-15T14:00:43.513 INFO:teuthology.orchestra.console.smithi067:Power on completed 2023-11-15T14:00:43.597 INFO:teuthology.provision.fog.smithi132:Waiting for deploy to finish 2023-11-15T14:00:43.598 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-11-15T14:00:43.604 INFO:teuthology.provision.fog.smithi027:Waiting for deploy to finish 2023-11-15T14:00:43.604 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-11-15T14:00:43.614 INFO:teuthology.provision.fog.smithi067:Waiting for deploy to finish 2023-11-15T14:00:43.615 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-11-15T14:00:58.658 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-11-15T14:00:58.660 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-11-15T14:00:58.664 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-11-15T14:01:13.730 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-11-15T14:01:13.732 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-11-15T14:01:13.733 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-11-15T14:01:28.811 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-11-15T14:01:28.813 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-11-15T14:01:28.814 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-11-15T14:01:43.882 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-11-15T14:01:43.884 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-11-15T14:01:43.885 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-11-15T14:01:58.954 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-11-15T14:01:58.956 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-11-15T14:01:58.957 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-11-15T14:02:14.030 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-11-15T14:02:14.032 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-11-15T14:02:14.033 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-11-15T14:02:29.110 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-11-15T14:02:29.111 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-11-15T14:02:29.112 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-11-15T14:02:44.194 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-11-15T14:02:44.196 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-11-15T14:02:44.197 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-11-15T14:02:59.268 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-11-15T14:02:59.270 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-11-15T14:02:59.271 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-11-15T14:03:14.342 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-11-15T14:03:14.343 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-11-15T14:03:14.344 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-11-15T14:03:14.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T14:03:17.498 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-11-15T14:03:23.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T14:03:26.590 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-11-15T14:03:29.404 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-11-15T14:03:29.417 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-11-15T14:03:29.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T14:03:32.506 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-11-15T14:03:32.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T14:03:35.642 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-11-15T14:03:38.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T14:03:41.566 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-11-15T14:03:41.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T14:03:44.474 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-11-15T14:03:44.702 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-11-15T14:03:47.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T14:03:50.650 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-11-15T14:03:50.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T14:03:53.786 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-11-15T14:03:56.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T14:03:59.529 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-11-15T14:03:59.706 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-11-15T14:03:59.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T14:04:02.842 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-11-15T14:04:05.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T14:04:08.762 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-11-15T14:04:08.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T14:04:11.902 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-11-15T14:04:14.598 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-11-15T14:04:14.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T14:04:14.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T14:04:17.722 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-11-15T14:04:17.822 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-11-15T14:04:17.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T14:04:23.729 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T14:04:23.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T14:04:26.810 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-11-15T14:04:32.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T14:04:35.866 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-11-15T14:04:41.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T14:04:44.926 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-11-15T14:04:50.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T14:04:54.010 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-11-15T14:05:00.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T14:05:03.066 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-11-15T14:05:09.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T14:05:12.126 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-11-15T14:05:17.908 WARNING:teuthology.provision.fog.smithi132:timed out 2023-11-15T14:05:18.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T14:05:21.210 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-11-15T14:05:23.830 WARNING:teuthology.provision.fog.smithi067:timed out 2023-11-15T14:05:23.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T14:05:24.513 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-15T14:05:24.514 DEBUG:teuthology.orchestra.run.smithi132:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-15T14:05:24.773 INFO:teuthology.provision.fog.smithi132:Node is ready 2023-11-15T14:05:24.773 DEBUG:teuthology.orchestra.run.smithi132:> hostname 2023-11-15T14:05:24.830 INFO:teuthology.orchestra.run.smithi132.stdout:smithi132 2023-11-15T14:05:24.830 DEBUG:teuthology.orchestra.run.smithi132:> grep smithi132 /etc/hosts 2023-11-15T14:05:24.888 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.15.132 smithi132.front.sepia.ceph.com smithi132 2023-11-15T14:05:24.888 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132 2023-11-15T14:05:24.995 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132/smithi132/g' /etc/hosts 2023-11-15T14:05:25.026 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/172.21.15.132/172.21.15.132/g' /etc/hosts 2023-11-15T14:05:25.093 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132/smithi132/g' /etc/hostname 2023-11-15T14:05:25.161 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132 2023-11-15T14:05:25.226 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2023-11-15T14:05:25.281 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="Red Hat Enterprise Linux" 2023-11-15T14:05:25.281 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8.6 (Ootpa)" 2023-11-15T14:05:25.282 INFO:teuthology.orchestra.run.smithi132.stdout:ID="rhel" 2023-11-15T14:05:25.282 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="fedora" 2023-11-15T14:05:25.282 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8.6" 2023-11-15T14:05:25.282 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8" 2023-11-15T14:05:25.283 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-15T14:05:25.283 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2023-11-15T14:05:25.283 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-15T14:05:25.283 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://www.redhat.com/" 2023-11-15T14:05:25.283 INFO:teuthology.orchestra.run.smithi132.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-15T14:05:25.284 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-15T14:05:25.284 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-15T14:05:25.284 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-15T14:05:25.284 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-15T14:05:25.284 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-15T14:05:25.285 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-15T14:05:25.285 INFO:teuthology.provision.fog.smithi132:Deploy complete! 2023-11-15T14:05:25.288 DEBUG:teuthology.parallel:result is None 2023-11-15T14:05:27.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T14:05:29.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T14:05:30.152 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-15T14:05:30.153 DEBUG:teuthology.orchestra.run.smithi067:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-15T14:05:30.266 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-11-15T14:05:30.439 INFO:teuthology.provision.fog.smithi067:Node is ready 2023-11-15T14:05:30.439 DEBUG:teuthology.orchestra.run.smithi067:> hostname 2023-11-15T14:05:30.459 INFO:teuthology.orchestra.run.smithi067.stdout:smithi067 2023-11-15T14:05:30.460 DEBUG:teuthology.orchestra.run.smithi067:> grep smithi067 /etc/hosts 2023-11-15T14:05:30.520 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67 smithi067.front.sepia.ceph.com smithi067 2023-11-15T14:05:30.521 DEBUG:teuthology.orchestra.run.smithi067:> sudo hostname smithi067 2023-11-15T14:05:30.637 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/smithi067/smithi067/g' /etc/hosts 2023-11-15T14:05:30.668 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/172.21.15.67/172.21.15.67/g' /etc/hosts 2023-11-15T14:05:30.738 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/smithi067/smithi067/g' /etc/hostname 2023-11-15T14:05:30.808 DEBUG:teuthology.orchestra.run.smithi067:> sudo hostname smithi067 2023-11-15T14:05:30.876 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release 2023-11-15T14:05:30.934 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="Red Hat Enterprise Linux" 2023-11-15T14:05:30.935 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="8.6 (Ootpa)" 2023-11-15T14:05:30.935 INFO:teuthology.orchestra.run.smithi067.stdout:ID="rhel" 2023-11-15T14:05:30.935 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="fedora" 2023-11-15T14:05:30.935 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="8.6" 2023-11-15T14:05:30.935 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el8" 2023-11-15T14:05:30.936 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-15T14:05:30.936 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31" 2023-11-15T14:05:30.936 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-15T14:05:30.936 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://www.redhat.com/" 2023-11-15T14:05:30.937 INFO:teuthology.orchestra.run.smithi067.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-15T14:05:30.937 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-15T14:05:30.937 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-15T14:05:30.937 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-15T14:05:30.937 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-15T14:05:30.938 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-15T14:05:30.938 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-15T14:05:30.938 INFO:teuthology.provision.fog.smithi067:Deploy complete! 2023-11-15T14:05:30.939 DEBUG:teuthology.parallel:result is None 2023-11-15T14:05:36.271 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T14:05:39.326 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-11-15T14:05:45.330 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T14:06:45.390 WARNING:teuthology.provision.fog.smithi027:timed out 2023-11-15T14:06:51.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T14:06:51.735 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-15T14:06:51.735 DEBUG:teuthology.orchestra.run.smithi027:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-15T14:06:52.047 INFO:teuthology.provision.fog.smithi027:Node is ready 2023-11-15T14:06:52.048 DEBUG:teuthology.orchestra.run.smithi027:> hostname 2023-11-15T14:06:52.066 INFO:teuthology.orchestra.run.smithi027.stdout:smithi027.front.sepia.ceph.com 2023-11-15T14:06:52.066 DEBUG:teuthology.orchestra.run.smithi027:> grep smithi027.front.sepia.ceph.com /etc/hosts 2023-11-15T14:06:52.125 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27 smithi027.front.sepia.ceph.com smithi027 2023-11-15T14:06:52.126 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname smithi027 2023-11-15T14:06:52.245 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/smithi027.front.sepia.ceph.com/smithi027/g' /etc/hosts 2023-11-15T14:06:52.275 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/172.21.15.27/172.21.15.27/g' /etc/hosts 2023-11-15T14:06:52.344 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/smithi027.front.sepia.ceph.com/smithi027/g' /etc/hostname 2023-11-15T14:06:52.414 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname smithi027 2023-11-15T14:06:52.480 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release 2023-11-15T14:06:52.538 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="Red Hat Enterprise Linux" 2023-11-15T14:06:52.539 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="8.6 (Ootpa)" 2023-11-15T14:06:52.539 INFO:teuthology.orchestra.run.smithi027.stdout:ID="rhel" 2023-11-15T14:06:52.539 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="fedora" 2023-11-15T14:06:52.540 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="8.6" 2023-11-15T14:06:52.540 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el8" 2023-11-15T14:06:52.540 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-15T14:06:52.540 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31" 2023-11-15T14:06:52.540 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-15T14:06:52.541 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://www.redhat.com/" 2023-11-15T14:06:52.541 INFO:teuthology.orchestra.run.smithi027.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-15T14:06:52.541 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-15T14:06:52.541 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-15T14:06:52.541 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-15T14:06:52.542 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-15T14:06:52.542 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-15T14:06:52.542 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-15T14:06:52.543 INFO:teuthology.provision.fog.smithi027:Deploy complete! 2023-11-15T14:06:52.543 DEBUG:teuthology.parallel:result is None 2023-11-15T14:06:52.735 INFO:teuthology.lock.ops:Checking smithi027.front.sepia.ceph.com 2023-11-15T14:06:52.736 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-15T14:06:52.762 INFO:teuthology.lock.ops:Checking smithi067.front.sepia.ceph.com 2023-11-15T14:06:52.763 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-15T14:06:52.787 INFO:teuthology.lock.ops:Checking smithi132.front.sepia.ceph.com 2023-11-15T14:06:52.787 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-15T14:06:52.814 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: set os type and version on server 2023-11-15T14:06:52.815 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-11-15T14:06:52.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T14:06:52.883 DEBUG:teuthology.orchestra.run.smithi027:> true 2023-11-15T14:06:52.951 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-11-15T14:06:52.952 DEBUG:teuthology.orchestra.run.smithi027:> uname -m 2023-11-15T14:06:53.009 INFO:teuthology.orchestra.run.smithi027.stdout:x86_64 2023-11-15T14:06:53.009 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release 2023-11-15T14:06:53.066 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="Red Hat Enterprise Linux" 2023-11-15T14:06:53.066 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="8.6 (Ootpa)" 2023-11-15T14:06:53.066 INFO:teuthology.orchestra.run.smithi027.stdout:ID="rhel" 2023-11-15T14:06:53.067 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="fedora" 2023-11-15T14:06:53.067 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="8.6" 2023-11-15T14:06:53.067 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el8" 2023-11-15T14:06:53.067 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-15T14:06:53.067 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31" 2023-11-15T14:06:53.068 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-15T14:06:53.068 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://www.redhat.com/" 2023-11-15T14:06:53.068 INFO:teuthology.orchestra.run.smithi027.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-15T14:06:53.068 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-15T14:06:53.068 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-15T14:06:53.069 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-15T14:06:53.069 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-15T14:06:53.069 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-15T14:06:53.069 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-15T14:06:53.070 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2023-11-15T14:06:53.095 INFO:teuthology.lock.ops:Updating [smithi067.front.sepia.ceph.com]: set os type and version on server 2023-11-15T14:06:53.096 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2023-11-15T14:06:53.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T14:06:53.164 DEBUG:teuthology.orchestra.run.smithi067:> true 2023-11-15T14:06:53.300 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi067.front.sepia.ceph.com' 2023-11-15T14:06:53.301 DEBUG:teuthology.orchestra.run.smithi067:> uname -m 2023-11-15T14:06:53.358 INFO:teuthology.orchestra.run.smithi067.stdout:x86_64 2023-11-15T14:06:53.359 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release 2023-11-15T14:06:53.416 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="Red Hat Enterprise Linux" 2023-11-15T14:06:53.417 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="8.6 (Ootpa)" 2023-11-15T14:06:53.417 INFO:teuthology.orchestra.run.smithi067.stdout:ID="rhel" 2023-11-15T14:06:53.417 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="fedora" 2023-11-15T14:06:53.417 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="8.6" 2023-11-15T14:06:53.418 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el8" 2023-11-15T14:06:53.418 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-15T14:06:53.418 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31" 2023-11-15T14:06:53.418 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-15T14:06:53.418 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://www.redhat.com/" 2023-11-15T14:06:53.419 INFO:teuthology.orchestra.run.smithi067.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-15T14:06:53.419 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-15T14:06:53.419 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-11-15T14:06:53.419 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-15T14:06:53.420 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-15T14:06:53.420 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-15T14:06:53.420 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-15T14:06:53.421 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server 2023-11-15T14:06:53.445 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: set os type and version on server 2023-11-15T14:06:53.445 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-11-15T14:06:53.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T14:06:53.513 DEBUG:teuthology.orchestra.run.smithi132:> true 2023-11-15T14:06:53.651 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-11-15T14:06:53.651 DEBUG:teuthology.orchestra.run.smithi132:> uname -m 2023-11-15T14:06:53.710 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64 2023-11-15T14:06:53.711 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2023-11-15T14:06:53.768 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="Red Hat Enterprise Linux" 2023-11-15T14:06:53.768 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8.6 (Ootpa)" 2023-11-15T14:06:53.768 INFO:teuthology.orchestra.run.smithi132.stdout:ID="rhel" 2023-11-15T14:06:53.769 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="fedora" 2023-11-15T14:06:53.769 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8.6" 2023-11-15T14:06:53.769 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8" 2023-11-15T14:06:53.769 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-15T14:06:53.770 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2023-11-15T14:06:53.770 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-15T14:06:53.770 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://www.redhat.com/" 2023-11-15T14:06:53.770 INFO:teuthology.orchestra.run.smithi132.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-15T14:06:53.770 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-15T14:06:53.771 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-15T14:06:53.771 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-15T14:06:53.771 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-15T14:06:53.771 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-15T14:06:53.771 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-15T14:06:53.772 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2023-11-15T14:06:53.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T14:06:53.903 INFO:teuthology.dispatcher.supervisor:Running job 7459077 2023-11-15T14:06:53.903 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-11-15_09:32:33-fs-wip-vshankar-testing2-2023-11-15-1128-reef-testing-default-smithi/7459077 --name vshankar-2023-11-15_09:32:33-fs-wip-vshankar-testing2-2023-11-15-1128-reef-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/postgres}} -- /home/teuthworker/archive/vshankar-2023-11-15_09:32:33-fs-wip-vshankar-testing2-2023-11-15-1128-reef-testing-default-smithi/7459077/orig.config.yaml 2023-11-15T14:06:53.906 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-11-15_09:32:33-fs-wip-vshankar-testing2-2023-11-15-1128-reef-testing-default-smithi/7459077 2023-11-15T14:06:53.907 INFO:teuthology.dispatcher.supervisor:Job PID: 3619669 2023-11-15T14:06:53.907 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-15T14:08:54.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T14:10:54.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T14:12:54.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T14:14:54.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T14:16:54.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T14:18:54.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T14:20:55.018 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T14:22:55.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T14:24:55.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T14:26:55.528 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T14:28:55.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T14:30:55.860 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T14:32:56.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T14:34:56.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T14:36:56.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T14:38:56.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T14:40:56.696 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T14:42:56.864 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T14:44:57.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T14:46:57.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T14:48:57.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T14:50:57.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T14:52:57.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T14:54:57.860 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T14:56:58.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T14:58:58.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T15:00:58.358 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T15:02:58.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T15:04:58.693 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T15:06:58.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T15:08:59.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T15:08:59.081 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-11-15T15:08:59.279 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-15T15:08:59.279 INFO:teuthology.nuke:Checking targets against current locks 2023-11-15T15:08:59.324 DEBUG:teuthology.nuke:shortname: smithi027 2023-11-15T15:08:59.324 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-15T15:08:59.350 DEBUG:teuthology.nuke:shortname: smithi067 2023-11-15T15:08:59.351 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-15T15:08:59.354 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi027.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-15_09:32:33-fs-wip-vshankar-testing2-2023-11-15-1128-reef-testing-default-smithi/7459077', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-15 14:00:25.102225', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-15T15:08:59.377 DEBUG:teuthology.nuke:shortname: smithi132 2023-11-15T15:08:59.378 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-15T15:08:59.382 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi067.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-15_09:32:33-fs-wip-vshankar-testing2-2023-11-15-1128-reef-testing-default-smithi/7459077', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-15 14:00:25.103707', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-15T15:08:59.404 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi132.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-15_09:32:33-fs-wip-vshankar-testing2-2023-11-15-1128-reef-testing-default-smithi/7459077', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-15 14:00:25.105012', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-15T15:08:59.413 INFO:teuthology.orchestra.console.smithi027:Power off 2023-11-15T15:08:59.414 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-15T15:08:59.443 DEBUG:teuthology.orchestra.console.smithi027:power off output: Chassis Power Control: Down/Off 2023-11-15T15:08:59.444 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T15:08:59.458 INFO:teuthology.orchestra.console.smithi067:Power off 2023-11-15T15:08:59.458 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-15T15:08:59.477 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2023-11-15T15:08:59.479 DEBUG:teuthology.orchestra.console.smithi067:power off output: Chassis Power Control: Down/Off 2023-11-15T15:08:59.480 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T15:08:59.495 INFO:teuthology.orchestra.console.smithi132:Power off 2023-11-15T15:08:59.496 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-15T15:08:59.504 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is off 2023-11-15T15:08:59.516 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off 2023-11-15T15:08:59.516 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T15:08:59.536 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2023-11-15T15:08:59.578 INFO:teuthology.orchestra.console.smithi027:Power off completed 2023-11-15T15:08:59.605 INFO:teuthology.orchestra.console.smithi067:Power off completed 2023-11-15T15:08:59.637 INFO:teuthology.orchestra.console.smithi132:Power off completed 2023-11-15T15:08:59.742 INFO:teuthology.lock.ops:unlocked: smithi027.front.sepia.ceph.com 2023-11-15T15:08:59.756 INFO:teuthology.lock.ops:unlocked: smithi067.front.sepia.ceph.com 2023-11-15T15:08:59.780 INFO:teuthology.lock.ops:unlocked: smithi132.front.sepia.ceph.com