2023-08-26T03:22:51.443 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-26T03:22:51.445 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-26T03:22:51.655 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5a1c073ee0>, signals=[15]) 2023-08-26T03:22:51.656 INFO:teuthology.lock.ops:Start node 'smithi019.front.sepia.ceph.com' reimaging 2023-08-26T03:22:51.657 INFO:teuthology.lock.ops:Updating [smithi019.front.sepia.ceph.com]: reset os type and version on server 2023-08-26T03:22:51.657 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server 2023-08-26T03:22:51.673 INFO:teuthology.lock.ops:Start node 'smithi098.front.sepia.ceph.com' reimaging 2023-08-26T03:22:51.673 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: reset os type and version on server 2023-08-26T03:22:51.673 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2023-08-26T03:22:51.675 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /host {"name": "smithi019"} 2023-08-26T03:22:51.913 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-26T03:22:51.953 DEBUG:teuthology.provision.fog.smithi019:Requesting image smithi_centos_8.stream (ID 3) 2023-08-26T03:22:51.953 DEBUG:teuthology.provision.fog.smithi019:FOG request: PUT /host/125 {"imageID": 3} 2023-08-26T03:22:52.001 INFO:teuthology.provision.fog.smithi019:Scheduling deploy of centos 8.stream 2023-08-26T03:22:52.001 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-08-26T03:22:52.037 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /tasktype {"name": "deploy"} 2023-08-26T03:22:52.068 DEBUG:teuthology.provision.fog.smithi019:FOG request: POST /host/125/task {"taskTypeID": 1} 2023-08-26T03:22:52.177 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-08-26T03:22:52.263 INFO:teuthology.orchestra.console.smithi019:Power off 2023-08-26T03:22:52.264 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-26T03:22:52.292 DEBUG:teuthology.orchestra.console.smithi019:power off output: Chassis Power Control: Down/Off 2023-08-26T03:22:52.292 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T03:22:52.314 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on 2023-08-26T03:22:53.473 INFO:teuthology.lock.ops:Start node 'smithi196.front.sepia.ceph.com' reimaging 2023-08-26T03:22:53.474 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: reset os type and version on server 2023-08-26T03:22:53.474 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2023-08-26T03:22:53.475 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /host {"name": "smithi098"} 2023-08-26T03:22:53.490 INFO:teuthology.lock.ops:Start node 'smithi203.front.sepia.ceph.com' reimaging 2023-08-26T03:22:53.490 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: reset os type and version on server 2023-08-26T03:22:53.490 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2023-08-26T03:22:53.491 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /host {"name": "smithi196"} 2023-08-26T03:22:53.515 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /host {"name": "smithi203"} 2023-08-26T03:22:53.549 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-26T03:22:53.555 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-26T03:22:53.580 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-26T03:22:53.588 DEBUG:teuthology.provision.fog.smithi098:Requesting image smithi_centos_8.stream (ID 3) 2023-08-26T03:22:53.588 DEBUG:teuthology.provision.fog.smithi098:FOG request: PUT /host/203 {"imageID": 3} 2023-08-26T03:22:53.591 DEBUG:teuthology.provision.fog.smithi196:Requesting image smithi_centos_8.stream (ID 3) 2023-08-26T03:22:53.592 DEBUG:teuthology.provision.fog.smithi196:FOG request: PUT /host/301 {"imageID": 3} 2023-08-26T03:22:53.614 DEBUG:teuthology.provision.fog.smithi203:Requesting image smithi_centos_8.stream (ID 3) 2023-08-26T03:22:53.614 DEBUG:teuthology.provision.fog.smithi203:FOG request: PUT /host/307 {"imageID": 3} 2023-08-26T03:22:53.659 INFO:teuthology.provision.fog.smithi098:Scheduling deploy of centos 8.stream 2023-08-26T03:22:53.659 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-26T03:22:53.662 INFO:teuthology.provision.fog.smithi196:Scheduling deploy of centos 8.stream 2023-08-26T03:22:53.663 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None 2023-08-26T03:22:53.672 INFO:teuthology.provision.fog.smithi203:Scheduling deploy of centos 8.stream 2023-08-26T03:22:53.672 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-26T03:22:53.728 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /tasktype {"name": "deploy"} 2023-08-26T03:22:53.733 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /tasktype {"name": "deploy"} 2023-08-26T03:22:53.740 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /tasktype {"name": "deploy"} 2023-08-26T03:22:53.768 DEBUG:teuthology.provision.fog.smithi196:FOG request: POST /host/301/task {"taskTypeID": 1} 2023-08-26T03:22:53.771 DEBUG:teuthology.provision.fog.smithi098:FOG request: POST /host/203/task {"taskTypeID": 1} 2023-08-26T03:22:53.775 DEBUG:teuthology.provision.fog.smithi203:FOG request: POST /host/307/task {"taskTypeID": 1} 2023-08-26T03:22:53.827 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None 2023-08-26T03:22:53.831 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-26T03:22:53.835 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-26T03:22:53.928 INFO:teuthology.orchestra.console.smithi098:Power off 2023-08-26T03:22:53.929 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-26T03:22:53.944 INFO:teuthology.orchestra.console.smithi196:Power off 2023-08-26T03:22:53.945 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-26T03:22:53.957 INFO:teuthology.orchestra.console.smithi203:Power off 2023-08-26T03:22:53.957 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-26T03:22:53.966 DEBUG:teuthology.orchestra.console.smithi196:power off output: Chassis Power Control: Down/Off 2023-08-26T03:22:53.966 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T03:22:53.975 DEBUG:teuthology.orchestra.console.smithi098:power off output: Chassis Power Control: Down/Off 2023-08-26T03:22:53.976 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T03:22:53.987 DEBUG:teuthology.orchestra.console.smithi203:power off output: Chassis Power Control: Down/Off 2023-08-26T03:22:53.988 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T03:22:53.997 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2023-08-26T03:22:54.000 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2023-08-26T03:22:54.010 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2023-08-26T03:22:56.318 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T03:22:56.427 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on 2023-08-26T03:22:58.000 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T03:22:58.007 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T03:22:58.016 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T03:22:58.110 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2023-08-26T03:22:58.118 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2023-08-26T03:22:58.126 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2023-08-26T03:23:00.432 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T03:23:00.541 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on 2023-08-26T03:23:02.112 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T03:23:02.120 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T03:23:02.127 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T03:23:02.222 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2023-08-26T03:23:02.229 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2023-08-26T03:23:02.236 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2023-08-26T03:23:02.330 INFO:teuthology.orchestra.console.smithi098:Power off completed 2023-08-26T03:23:02.337 INFO:teuthology.orchestra.console.smithi203:Power off completed 2023-08-26T03:23:02.431 INFO:teuthology.orchestra.console.smithi098:Power on 2023-08-26T03:23:02.432 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-26T03:23:02.441 INFO:teuthology.orchestra.console.smithi203:Power on 2023-08-26T03:23:02.442 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-26T03:23:02.451 DEBUG:teuthology.orchestra.console.smithi098:power on output: Chassis Power Control: Up/On 2023-08-26T03:23:02.451 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T03:23:02.460 DEBUG:teuthology.orchestra.console.smithi203:power on output: Chassis Power Control: Up/On 2023-08-26T03:23:02.461 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T03:23:02.469 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2023-08-26T03:23:02.479 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2023-08-26T03:23:04.545 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T03:23:04.656 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off 2023-08-26T03:23:04.757 INFO:teuthology.orchestra.console.smithi019:Power off completed 2023-08-26T03:23:04.858 INFO:teuthology.orchestra.console.smithi019:Power on 2023-08-26T03:23:04.859 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-26T03:23:04.880 DEBUG:teuthology.orchestra.console.smithi019:power on output: Chassis Power Control: Up/On 2023-08-26T03:23:04.881 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T03:23:04.901 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off 2023-08-26T03:23:06.224 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T03:23:06.335 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off 2023-08-26T03:23:06.436 INFO:teuthology.orchestra.console.smithi196:Power off completed 2023-08-26T03:23:06.470 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T03:23:06.480 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T03:23:06.536 INFO:teuthology.orchestra.console.smithi196:Power on 2023-08-26T03:23:06.537 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-26T03:23:06.561 DEBUG:teuthology.orchestra.console.smithi196:power on output: Chassis Power Control: Up/On 2023-08-26T03:23:06.562 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T03:23:06.582 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2023-08-26T03:23:06.583 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off 2023-08-26T03:23:06.591 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2023-08-26T03:23:08.904 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T03:23:09.014 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off 2023-08-26T03:23:10.584 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T03:23:10.593 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T03:23:10.601 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T03:23:10.695 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2023-08-26T03:23:10.703 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off 2023-08-26T03:23:10.747 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2023-08-26T03:23:10.797 INFO:teuthology.orchestra.console.smithi098:Power on completed 2023-08-26T03:23:10.848 INFO:teuthology.orchestra.console.smithi203:Power on completed 2023-08-26T03:23:10.898 INFO:teuthology.provision.fog.smithi098:Waiting for deploy to finish 2023-08-26T03:23:10.898 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-26T03:23:10.949 INFO:teuthology.provision.fog.smithi203:Waiting for deploy to finish 2023-08-26T03:23:10.950 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-26T03:23:13.016 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T03:23:13.125 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on 2023-08-26T03:23:13.226 INFO:teuthology.orchestra.console.smithi019:Power on completed 2023-08-26T03:23:13.327 INFO:teuthology.provision.fog.smithi019:Waiting for deploy to finish 2023-08-26T03:23:13.327 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-08-26T03:23:14.705 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T03:23:14.816 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2023-08-26T03:23:14.917 INFO:teuthology.orchestra.console.smithi196:Power on completed 2023-08-26T03:23:15.017 INFO:teuthology.provision.fog.smithi196:Waiting for deploy to finish 2023-08-26T03:23:15.018 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None 2023-08-26T03:23:26.215 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-26T03:23:26.216 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-26T03:23:28.631 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-08-26T03:23:30.488 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None 2023-08-26T03:23:41.462 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-26T03:23:41.463 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-26T03:23:43.852 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-08-26T03:23:45.710 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None 2023-08-26T03:23:56.751 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-26T03:23:56.753 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-26T03:23:59.106 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-08-26T03:24:00.946 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None 2023-08-26T03:24:12.048 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-26T03:24:12.049 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-26T03:24:14.332 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-08-26T03:24:16.172 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None 2023-08-26T03:24:27.328 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-26T03:24:27.329 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-26T03:24:29.566 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-08-26T03:24:31.496 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None 2023-08-26T03:24:42.580 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-26T03:24:42.581 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-26T03:24:44.848 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-08-26T03:24:46.856 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None 2023-08-26T03:24:57.892 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-26T03:24:57.900 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-26T03:25:00.178 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-08-26T03:25:02.236 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None 2023-08-26T03:25:13.402 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-26T03:25:13.427 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-26T03:25:15.635 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-08-26T03:25:17.742 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None 2023-08-26T03:25:29.713 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-26T03:25:29.802 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-26T03:25:34.704 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-08-26T03:25:35.204 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None 2023-08-26T03:25:45.238 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-26T03:25:45.312 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-26T03:25:51.558 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-08-26T03:25:53.152 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None 2023-08-26T03:26:00.904 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-26T03:26:00.906 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-26T03:26:06.920 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-08-26T03:26:08.952 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None 2023-08-26T03:26:10.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T03:26:24.960 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-26T03:26:24.961 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-26T03:26:25.885 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None 2023-08-26T03:26:29.232 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19 2023-08-26T03:26:35.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T03:26:38.288 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19 2023-08-26T03:26:44.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T03:26:44.331 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-26T03:26:44.975 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-26T03:26:45.451 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None 2023-08-26T03:26:47.344 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19 2023-08-26T03:26:53.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T03:27:04.012 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-26T03:27:04.620 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-26T03:27:04.969 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None 2023-08-26T03:27:22.531 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-26T03:27:23.485 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-26T03:27:23.992 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None 2023-08-26T03:27:38.210 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-26T03:27:38.902 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-26T03:27:41.780 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None 2023-08-26T03:27:53.360 WARNING:teuthology.provision.fog.smithi019:timed out 2023-08-26T03:27:53.775 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-26T03:27:54.451 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-26T03:27:58.660 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None 2023-08-26T03:27:59.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T03:27:59.607 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-26T03:27:59.608 DEBUG:teuthology.orchestra.run.smithi019:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-26T03:27:59.871 INFO:teuthology.provision.fog.smithi019:Node is ready 2023-08-26T03:27:59.871 DEBUG:teuthology.orchestra.run.smithi019:> hostname 2023-08-26T03:27:59.890 INFO:teuthology.orchestra.run.smithi019.stdout:smithi019.front.sepia.ceph.com 2023-08-26T03:27:59.891 DEBUG:teuthology.orchestra.run.smithi019:> grep smithi019.front.sepia.ceph.com /etc/hosts 2023-08-26T03:27:59.951 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19 smithi019.front.sepia.ceph.com smithi019 2023-08-26T03:27:59.951 DEBUG:teuthology.orchestra.run.smithi019:> sudo hostname smithi019 2023-08-26T03:28:00.067 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i -e 's/smithi019.front.sepia.ceph.com/smithi019/g' /etc/hosts 2023-08-26T03:28:00.098 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i -e 's/172.21.15.19/172.21.15.19/g' /etc/hosts 2023-08-26T03:28:00.172 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i -e 's/smithi019.front.sepia.ceph.com/smithi019/g' /etc/hostname 2023-08-26T03:28:00.242 DEBUG:teuthology.orchestra.run.smithi019:> sudo hostname smithi019 2023-08-26T03:28:00.310 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release 2023-08-26T03:28:00.369 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="CentOS Stream" 2023-08-26T03:28:00.369 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="8" 2023-08-26T03:28:00.369 INFO:teuthology.orchestra.run.smithi019.stdout:ID="centos" 2023-08-26T03:28:00.369 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE="rhel fedora" 2023-08-26T03:28:00.370 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="8" 2023-08-26T03:28:00.370 INFO:teuthology.orchestra.run.smithi019.stdout:PLATFORM_ID="platform:el8" 2023-08-26T03:28:00.370 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-26T03:28:00.370 INFO:teuthology.orchestra.run.smithi019.stdout:ANSI_COLOR="0;31" 2023-08-26T03:28:00.370 INFO:teuthology.orchestra.run.smithi019.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-26T03:28:00.370 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://centos.org/" 2023-08-26T03:28:00.370 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-26T03:28:00.371 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-26T03:28:00.371 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-26T03:28:00.371 INFO:teuthology.provision.fog.smithi019:Deploy complete! 2023-08-26T03:28:00.372 DEBUG:teuthology.parallel:result is None 2023-08-26T03:28:09.228 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-26T03:28:09.800 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-26T03:28:15.148 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None 2023-08-26T03:28:24.680 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-26T03:28:25.159 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-26T03:28:31.312 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None 2023-08-26T03:28:40.056 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-26T03:28:40.415 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-26T03:28:46.689 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None 2023-08-26T03:28:46.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T03:28:50.000 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2023-08-26T03:28:55.430 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-26T03:28:55.772 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-26T03:28:56.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T03:28:59.056 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2023-08-26T03:29:05.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T03:29:08.112 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2023-08-26T03:29:10.672 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-26T03:29:10.986 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-26T03:29:14.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T03:29:17.168 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2023-08-26T03:29:23.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T03:29:25.845 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-26T03:29:26.224 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2023-08-26T03:29:26.281 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-26T03:29:32.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T03:29:41.037 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-26T03:29:41.449 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-26T03:29:56.262 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-26T03:29:56.705 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-26T03:30:11.470 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-26T03:30:11.900 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-26T03:30:26.668 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-26T03:30:27.057 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-26T03:30:27.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T03:30:30.228 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-08-26T03:30:32.232 WARNING:teuthology.provision.fog.smithi196:timed out 2023-08-26T03:30:36.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T03:30:38.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T03:30:38.476 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-26T03:30:38.477 DEBUG:teuthology.orchestra.run.smithi196:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-26T03:30:38.721 INFO:teuthology.provision.fog.smithi196:Node is ready 2023-08-26T03:30:38.722 DEBUG:teuthology.orchestra.run.smithi196:> hostname 2023-08-26T03:30:38.741 INFO:teuthology.orchestra.run.smithi196.stdout:smithi196.front.sepia.ceph.com 2023-08-26T03:30:38.742 DEBUG:teuthology.orchestra.run.smithi196:> grep smithi196.front.sepia.ceph.com /etc/hosts 2023-08-26T03:30:38.801 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.15.196 smithi196.front.sepia.ceph.com smithi196 2023-08-26T03:30:38.802 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196 2023-08-26T03:30:38.918 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi196.front.sepia.ceph.com/smithi196/g' /etc/hosts 2023-08-26T03:30:38.949 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/172.21.15.196/172.21.15.196/g' /etc/hosts 2023-08-26T03:30:39.018 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi196.front.sepia.ceph.com/smithi196/g' /etc/hostname 2023-08-26T03:30:39.087 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196 2023-08-26T03:30:39.155 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release 2023-08-26T03:30:39.213 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Stream" 2023-08-26T03:30:39.214 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="8" 2023-08-26T03:30:39.214 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos" 2023-08-26T03:30:39.214 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora" 2023-08-26T03:30:39.214 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="8" 2023-08-26T03:30:39.214 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el8" 2023-08-26T03:30:39.214 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-26T03:30:39.215 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31" 2023-08-26T03:30:39.215 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-26T03:30:39.215 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://centos.org/" 2023-08-26T03:30:39.215 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-26T03:30:39.215 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-26T03:30:39.215 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-26T03:30:39.215 INFO:teuthology.provision.fog.smithi196:Deploy complete! 2023-08-26T03:30:39.216 DEBUG:teuthology.parallel:result is None 2023-08-26T03:30:39.312 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-08-26T03:30:41.824 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-26T03:30:45.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T03:30:48.372 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-08-26T03:30:54.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T03:30:56.967 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-26T03:30:57.460 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-08-26T03:31:03.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T03:31:06.544 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-08-26T03:31:12.112 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-26T03:31:12.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T03:31:15.600 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-08-26T03:31:21.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T03:31:24.656 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-08-26T03:31:27.224 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-26T03:31:30.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T03:31:42.336 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-26T03:31:48.976 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-08-26T03:31:54.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T03:31:57.431 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-26T03:31:58.032 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-08-26T03:32:04.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T03:32:06.245 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-26T03:32:06.246 DEBUG:teuthology.orchestra.run.smithi098:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-26T03:32:12.490 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-26T03:32:27.562 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-08-26T03:32:27.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T03:32:30.672 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-08-26T03:32:31.205 INFO:teuthology.provision.fog.smithi098:Node is ready 2023-08-26T03:32:31.206 DEBUG:teuthology.orchestra.run.smithi098:> hostname 2023-08-26T03:32:31.230 INFO:teuthology.orchestra.run.smithi098.stdout:smithi098.front.sepia.ceph.com 2023-08-26T03:32:31.230 DEBUG:teuthology.orchestra.run.smithi098:> grep smithi098.front.sepia.ceph.com /etc/hosts 2023-08-26T03:32:31.291 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98 smithi098.front.sepia.ceph.com smithi098 2023-08-26T03:32:31.292 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098 2023-08-26T03:32:31.417 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hosts 2023-08-26T03:32:31.451 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/172.21.15.98/172.21.15.98/g' /etc/hosts 2023-08-26T03:32:31.522 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hostname 2023-08-26T03:32:31.592 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098 2023-08-26T03:32:31.661 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2023-08-26T03:32:31.720 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream" 2023-08-26T03:32:31.720 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="8" 2023-08-26T03:32:31.720 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos" 2023-08-26T03:32:31.721 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora" 2023-08-26T03:32:31.721 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="8" 2023-08-26T03:32:31.721 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el8" 2023-08-26T03:32:31.721 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-26T03:32:31.721 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2023-08-26T03:32:31.722 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-26T03:32:31.722 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/" 2023-08-26T03:32:31.722 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-26T03:32:31.722 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-26T03:32:31.722 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-26T03:32:31.723 INFO:teuthology.provision.fog.smithi098:Deploy complete! 2023-08-26T03:32:31.723 DEBUG:teuthology.parallel:result is None 2023-08-26T03:32:36.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T03:32:39.728 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-08-26T03:32:45.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T03:32:48.788 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-08-26T03:32:54.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T03:32:57.876 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-08-26T03:33:03.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T03:33:06.960 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-08-26T03:33:12.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T03:33:16.020 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-08-26T03:33:22.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T03:33:25.104 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-08-26T03:33:31.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T03:33:49.556 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-08-26T03:33:55.561 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T03:33:58.640 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-08-26T03:34:04.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T03:34:07.696 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-08-26T03:34:13.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T03:34:13.945 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-26T03:34:13.945 DEBUG:teuthology.orchestra.run.smithi203:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-26T03:34:34.176 INFO:teuthology.provision.fog.smithi203:Node is ready 2023-08-26T03:34:34.176 DEBUG:teuthology.orchestra.run.smithi203:> hostname 2023-08-26T03:34:34.200 INFO:teuthology.orchestra.run.smithi203.stdout:smithi203.front.sepia.ceph.com 2023-08-26T03:34:34.201 DEBUG:teuthology.orchestra.run.smithi203:> grep smithi203.front.sepia.ceph.com /etc/hosts 2023-08-26T03:34:34.260 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.15.203 smithi203.front.sepia.ceph.com smithi203 2023-08-26T03:34:34.261 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203 2023-08-26T03:34:34.389 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hosts 2023-08-26T03:34:34.421 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/172.21.15.203/172.21.15.203/g' /etc/hosts 2023-08-26T03:34:34.490 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hostname 2023-08-26T03:34:34.559 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203 2023-08-26T03:34:34.627 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release 2023-08-26T03:34:34.686 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream" 2023-08-26T03:34:34.686 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="8" 2023-08-26T03:34:34.686 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos" 2023-08-26T03:34:34.686 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora" 2023-08-26T03:34:34.687 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="8" 2023-08-26T03:34:34.687 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el8" 2023-08-26T03:34:34.687 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-26T03:34:34.687 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31" 2023-08-26T03:34:34.688 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-26T03:34:34.688 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/" 2023-08-26T03:34:34.688 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-26T03:34:34.688 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-26T03:34:34.689 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-26T03:34:34.689 INFO:teuthology.provision.fog.smithi203:Deploy complete! 2023-08-26T03:34:34.690 DEBUG:teuthology.parallel:result is None 2023-08-26T03:34:34.949 INFO:teuthology.lock.ops:Checking smithi019.front.sepia.ceph.com 2023-08-26T03:34:34.950 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-26T03:34:34.972 INFO:teuthology.lock.ops:Checking smithi098.front.sepia.ceph.com 2023-08-26T03:34:34.972 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-26T03:34:34.997 INFO:teuthology.lock.ops:Checking smithi196.front.sepia.ceph.com 2023-08-26T03:34:34.997 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-26T03:34:35.013 INFO:teuthology.lock.ops:Checking smithi203.front.sepia.ceph.com 2023-08-26T03:34:35.014 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-26T03:34:35.032 INFO:teuthology.lock.ops:Updating [smithi019.front.sepia.ceph.com]: set os type and version on server 2023-08-26T03:34:35.032 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2023-08-26T03:34:35.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T03:34:35.104 DEBUG:teuthology.orchestra.run.smithi019:> true 2023-08-26T03:34:35.252 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com' 2023-08-26T03:34:35.252 DEBUG:teuthology.orchestra.run.smithi019:> uname -m 2023-08-26T03:34:35.312 INFO:teuthology.orchestra.run.smithi019.stdout:x86_64 2023-08-26T03:34:35.313 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release 2023-08-26T03:34:35.371 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="CentOS Stream" 2023-08-26T03:34:35.372 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="8" 2023-08-26T03:34:35.373 INFO:teuthology.orchestra.run.smithi019.stdout:ID="centos" 2023-08-26T03:34:35.373 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE="rhel fedora" 2023-08-26T03:34:35.373 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="8" 2023-08-26T03:34:35.374 INFO:teuthology.orchestra.run.smithi019.stdout:PLATFORM_ID="platform:el8" 2023-08-26T03:34:35.374 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-26T03:34:35.374 INFO:teuthology.orchestra.run.smithi019.stdout:ANSI_COLOR="0;31" 2023-08-26T03:34:35.375 INFO:teuthology.orchestra.run.smithi019.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-26T03:34:35.375 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://centos.org/" 2023-08-26T03:34:35.375 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-26T03:34:35.375 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-26T03:34:35.376 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-26T03:34:35.376 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server 2023-08-26T03:34:35.397 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: set os type and version on server 2023-08-26T03:34:35.397 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-08-26T03:34:35.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T03:34:35.465 DEBUG:teuthology.orchestra.run.smithi098:> true 2023-08-26T03:34:35.605 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-08-26T03:34:35.605 DEBUG:teuthology.orchestra.run.smithi098:> uname -m 2023-08-26T03:34:35.664 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2023-08-26T03:34:35.664 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2023-08-26T03:34:35.724 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream" 2023-08-26T03:34:35.724 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="8" 2023-08-26T03:34:35.724 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos" 2023-08-26T03:34:35.724 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora" 2023-08-26T03:34:35.724 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="8" 2023-08-26T03:34:35.725 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el8" 2023-08-26T03:34:35.725 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-26T03:34:35.725 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2023-08-26T03:34:35.725 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-26T03:34:35.725 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/" 2023-08-26T03:34:35.725 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-26T03:34:35.725 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-26T03:34:35.726 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-26T03:34:35.726 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2023-08-26T03:34:35.772 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: set os type and version on server 2023-08-26T03:34:35.773 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2023-08-26T03:34:35.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T03:34:35.844 DEBUG:teuthology.orchestra.run.smithi196:> true 2023-08-26T03:34:35.979 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com' 2023-08-26T03:34:35.980 DEBUG:teuthology.orchestra.run.smithi196:> uname -m 2023-08-26T03:34:36.039 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64 2023-08-26T03:34:36.039 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release 2023-08-26T03:34:36.099 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Stream" 2023-08-26T03:34:36.099 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="8" 2023-08-26T03:34:36.100 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos" 2023-08-26T03:34:36.100 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora" 2023-08-26T03:34:36.100 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="8" 2023-08-26T03:34:36.101 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el8" 2023-08-26T03:34:36.101 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-26T03:34:36.101 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31" 2023-08-26T03:34:36.101 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-26T03:34:36.102 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://centos.org/" 2023-08-26T03:34:36.102 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-26T03:34:36.103 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-26T03:34:36.103 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-26T03:34:36.104 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2023-08-26T03:34:36.130 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: set os type and version on server 2023-08-26T03:34:36.130 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2023-08-26T03:34:36.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T03:34:36.198 DEBUG:teuthology.orchestra.run.smithi203:> true 2023-08-26T03:34:36.270 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com' 2023-08-26T03:34:36.271 DEBUG:teuthology.orchestra.run.smithi203:> uname -m 2023-08-26T03:34:36.331 INFO:teuthology.orchestra.run.smithi203.stdout:x86_64 2023-08-26T03:34:36.332 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release 2023-08-26T03:34:36.394 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream" 2023-08-26T03:34:36.394 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="8" 2023-08-26T03:34:36.394 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos" 2023-08-26T03:34:36.394 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora" 2023-08-26T03:34:36.394 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="8" 2023-08-26T03:34:36.395 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el8" 2023-08-26T03:34:36.395 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-26T03:34:36.395 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31" 2023-08-26T03:34:36.395 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-26T03:34:36.395 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/" 2023-08-26T03:34:36.395 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-26T03:34:36.395 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-26T03:34:36.395 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-26T03:34:36.396 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2023-08-26T03:34:36.422 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-26T03:34:36.519 INFO:teuthology.dispatcher.supervisor:Running job 7381410 2023-08-26T03:34:36.520 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-08-25_20:21:26-rados-wip-yuri5-testing-2023-08-25-1127-pacific-distro-default-smithi/7381410 --name yuriw-2023-08-25_20:21:26-rados-wip-yuri5-testing-2023-08-25-1127-pacific-distro-default-smithi --description rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} -- /home/teuthworker/archive/yuriw-2023-08-25_20:21:26-rados-wip-yuri5-testing-2023-08-25-1127-pacific-distro-default-smithi/7381410/orig.config.yaml 2023-08-26T03:34:36.523 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-08-25_20:21:26-rados-wip-yuri5-testing-2023-08-25-1127-pacific-distro-default-smithi/7381410 2023-08-26T03:34:36.524 INFO:teuthology.dispatcher.supervisor:Job PID: 25086 2023-08-26T03:34:36.525 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-26T03:36:36.625 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-26T03:38:36.801 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-26T03:40:36.993 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-26T03:42:37.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-26T03:44:37.334 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-26T03:46:37.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-26T03:48:37.653 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-26T03:50:37.825 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-26T03:52:37.993 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-26T03:54:38.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-26T03:56:38.328 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-26T03:58:38.485 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-26T04:00:38.649 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-26T04:02:38.846 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-26T04:04:39.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-26T04:06:39.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-26T04:06:39.171 ERROR:teuthology.dispatcher.supervisor:Child exited with code 127 2023-08-26T04:06:39.308 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-26T04:06:39.308 INFO:teuthology.nuke:Checking targets against current locks 2023-08-26T04:06:39.355 DEBUG:teuthology.nuke:shortname: smithi019 2023-08-26T04:06:39.356 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-26T04:06:39.374 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi019.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-25_20:21:26-rados-wip-yuri5-testing-2023-08-25-1127-pacific-distro-default-smithi/7381410', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-26 03:22:50.585978', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF8WAcW9vDcfLh97ULo+A9blUpx6YvZjZHmS2ibqePOvfmZY+rka9b9VhXfnbW7H9Kfd0x2zJj2C+xOwRKQ1LMw='} 2023-08-26T04:06:39.380 DEBUG:teuthology.nuke:shortname: smithi098 2023-08-26T04:06:39.380 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-26T04:06:39.401 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-25_20:21:26-rados-wip-yuri5-testing-2023-08-25-1127-pacific-distro-default-smithi/7381410', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-26 03:22:50.584415', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGMjILKB2t+dMEu4d0CwSNS3kNFIQBwFjT9EytEuHcoqPd7EQtIWAkEjA7sivRovqbyyWWvufW+P/l0vpukPu0g='} 2023-08-26T04:06:39.402 DEBUG:teuthology.nuke:shortname: smithi196 2023-08-26T04:06:39.403 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-26T04:06:39.419 DEBUG:teuthology.nuke:shortname: smithi203 2023-08-26T04:06:39.419 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-26T04:06:39.427 INFO:teuthology.orchestra.console.smithi019:Power off 2023-08-26T04:06:39.428 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-26T04:06:39.436 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi196.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-25_20:21:26-rados-wip-yuri5-testing-2023-08-25-1127-pacific-distro-default-smithi/7381410', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-26 03:22:50.588328', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8yJ6zH7UdVbWICZ/8jfUMLe93VTMyPWvwWZtUIETgXkAJN4qHi9jTXwQ9DwwPfhHtvw6TlvNyS6k5AEmZfrniqf4jVBEcVD8P3xHBvddw5xLmwooKjzRdJqxgtSN7hHAhVUOk8sKVeyGkR63RwBSoZCtuM/inNmFDJvQwmVepjYR7jN86lWgpiaZ1dzvG3ogfKpQvN4rlvfQpzhkBwU8Y5xKcAflJL5tkJbuOz7TjCC3NAyeR4PgAtloDcwlR7Z5BWKaUIWKnQJWFFWbyfDktqmmRTphzfoi25b8BqTk7dVuvgta2YnkbXJp6HS7GtVGkO25IoZfcJfs7YcYMLtyy9HhUE/k9ufwM1EpPcVUFo1F2AlCsh2kwqh/SX04UD82iheXg9PqjIqCqUPQlPXxhjXPSQR1rwJOOJR/yXAQiQ5DwUr9R1yEM3cSFlEYa7Avvysj5Cj2/DM8RqH5tVAEQWOMmJl+mM4tBHeCcVeEptid9XM9Nsy6PVJf0WeHJX2M='} 2023-08-26T04:06:39.449 DEBUG:teuthology.orchestra.console.smithi019:power off output: Chassis Power Control: Down/Off 2023-08-26T04:06:39.450 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T04:06:39.463 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi203.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-25_20:21:26-rados-wip-yuri5-testing-2023-08-25-1127-pacific-distro-default-smithi/7381410', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-26 03:22:50.587144', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNjH51xQlvYkYL7mavZ7vB6QYpsL9VdLPLNPLKJBt6mcChx85FXTLDq5oCFbQ49YAb0fTg1F58mJb7FUynl5C9k='} 2023-08-26T04:06:39.472 INFO:teuthology.orchestra.console.smithi098:Power off 2023-08-26T04:06:39.473 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-26T04:06:39.482 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on 2023-08-26T04:06:39.493 DEBUG:teuthology.orchestra.console.smithi098:power off output: Chassis Power Control: Down/Off 2023-08-26T04:06:39.493 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T04:06:39.506 INFO:teuthology.orchestra.console.smithi196:Power off 2023-08-26T04:06:39.507 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-26T04:06:39.519 INFO:teuthology.orchestra.console.smithi203:Power off 2023-08-26T04:06:39.520 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-26T04:06:39.527 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2023-08-26T04:06:39.535 DEBUG:teuthology.orchestra.console.smithi196:power off output: Chassis Power Control: Down/Off 2023-08-26T04:06:39.535 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T04:06:39.543 DEBUG:teuthology.orchestra.console.smithi203:power off output: Chassis Power Control: Down/Off 2023-08-26T04:06:39.544 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T04:06:39.555 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2023-08-26T04:06:39.565 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2023-08-26T04:06:43.483 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T04:06:43.528 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T04:06:43.556 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T04:06:43.565 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T04:06:43.594 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on 2023-08-26T04:06:43.637 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2023-08-26T04:06:43.666 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2023-08-26T04:06:43.675 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2023-08-26T04:06:47.599 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T04:06:47.638 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T04:06:47.667 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T04:06:47.676 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T04:06:47.709 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off 2023-08-26T04:06:47.749 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2023-08-26T04:06:47.777 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2023-08-26T04:06:47.785 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2023-08-26T04:06:47.810 INFO:teuthology.orchestra.console.smithi019:Power off completed 2023-08-26T04:06:47.850 INFO:teuthology.orchestra.console.smithi098:Power off completed 2023-08-26T04:06:47.885 INFO:teuthology.orchestra.console.smithi203:Power off completed 2023-08-26T04:06:47.960 INFO:teuthology.lock.ops:unlocked: smithi019.front.sepia.ceph.com 2023-08-26T04:06:47.993 INFO:teuthology.lock.ops:unlocked: smithi098.front.sepia.ceph.com 2023-08-26T04:06:48.026 INFO:teuthology.lock.ops:unlocked: smithi203.front.sepia.ceph.com 2023-08-26T04:06:51.780 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T04:06:51.890 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off 2023-08-26T04:06:51.991 INFO:teuthology.orchestra.console.smithi196:Power off completed 2023-08-26T04:06:52.143 INFO:teuthology.lock.ops:unlocked: smithi196.front.sepia.ceph.com