2023-07-29T19:23:30.585 INFO:root:teuthology version: 0.0.1.dev172+g6114016 2023-07-29T19:23:30.586 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T19:23:30.781 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f552c8ecdc0>, signals=[15]) 2023-07-29T19:23:30.782 INFO:teuthology.lock.ops:Start node 'smithi026.front.sepia.ceph.com' reimaging 2023-07-29T19:23:30.783 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: reset os type and version on server 2023-07-29T19:23:30.783 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2023-07-29T19:23:30.967 INFO:teuthology.lock.ops:Start node 'smithi116.front.sepia.ceph.com' reimaging 2023-07-29T19:23:30.967 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: reset os type and version on server 2023-07-29T19:23:30.968 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2023-07-29T19:23:30.969 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /host {"name": "smithi026"} 2023-07-29T19:23:31.012 INFO:teuthology.lock.ops:Start node 'smithi203.front.sepia.ceph.com' reimaging 2023-07-29T19:23:31.012 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: reset os type and version on server 2023-07-29T19:23:31.013 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2023-07-29T19:23:31.014 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /host {"name": "smithi116"} 2023-07-29T19:23:31.037 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /host {"name": "smithi203"} 2023-07-29T19:23:31.056 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-29T19:23:31.085 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-29T19:23:31.091 DEBUG:teuthology.provision.fog.smithi026:Requesting image smithi_centos_8.stream (ID 3) 2023-07-29T19:23:31.092 DEBUG:teuthology.provision.fog.smithi026:FOG request: PUT /host/131 {"imageID": 3} 2023-07-29T19:23:31.109 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-29T19:23:31.120 DEBUG:teuthology.provision.fog.smithi116:Requesting image smithi_centos_8.stream (ID 3) 2023-07-29T19:23:31.120 DEBUG:teuthology.provision.fog.smithi116:FOG request: PUT /host/221 {"imageID": 3} 2023-07-29T19:23:31.144 INFO:teuthology.provision.fog.smithi026:Scheduling deploy of centos 8.stream 2023-07-29T19:23:31.144 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-29T19:23:31.147 DEBUG:teuthology.provision.fog.smithi203:Requesting image smithi_centos_8.stream (ID 3) 2023-07-29T19:23:31.147 DEBUG:teuthology.provision.fog.smithi203:FOG request: PUT /host/307 {"imageID": 3} 2023-07-29T19:23:31.170 INFO:teuthology.provision.fog.smithi116:Scheduling deploy of centos 8.stream 2023-07-29T19:23:31.171 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-07-29T19:23:31.189 INFO:teuthology.provision.fog.smithi203:Scheduling deploy of centos 8.stream 2023-07-29T19:23:31.189 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-29T19:23:31.193 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /tasktype {"name": "deploy"} 2023-07-29T19:23:31.210 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /tasktype {"name": "deploy"} 2023-07-29T19:23:31.228 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /tasktype {"name": "deploy"} 2023-07-29T19:23:31.232 DEBUG:teuthology.provision.fog.smithi026:FOG request: POST /host/131/task {"taskTypeID": 1} 2023-07-29T19:23:31.246 DEBUG:teuthology.provision.fog.smithi116:FOG request: POST /host/221/task {"taskTypeID": 1} 2023-07-29T19:23:31.280 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-29T19:23:31.282 DEBUG:teuthology.provision.fog.smithi203:FOG request: POST /host/307/task {"taskTypeID": 1} 2023-07-29T19:23:31.302 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-07-29T19:23:31.338 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-29T19:23:31.368 INFO:teuthology.orchestra.console.smithi026:Power off 2023-07-29T19:23:31.369 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-29T19:23:31.396 INFO:teuthology.orchestra.console.smithi116:Power off 2023-07-29T19:23:31.396 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-29T19:23:31.405 DEBUG:teuthology.orchestra.console.smithi026:power off output: Chassis Power Control: Down/Off 2023-07-29T19:23:31.405 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T19:23:31.418 DEBUG:teuthology.orchestra.console.smithi116:power off output: Chassis Power Control: Down/Off 2023-07-29T19:23:31.418 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T19:23:31.428 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2023-07-29T19:23:31.439 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on 2023-07-29T19:23:31.445 INFO:teuthology.orchestra.console.smithi203:Power off 2023-07-29T19:23:31.446 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-29T19:23:31.468 DEBUG:teuthology.orchestra.console.smithi203:power off output: Chassis Power Control: Down/Off 2023-07-29T19:23:31.469 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T19:23:31.488 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2023-07-29T19:23:35.432 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T19:23:35.440 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T19:23:35.490 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T19:23:35.543 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2023-07-29T19:23:35.551 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on 2023-07-29T19:23:35.600 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2023-07-29T19:23:39.548 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T19:23:39.556 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T19:23:39.601 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T19:23:39.658 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2023-07-29T19:23:39.665 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2023-07-29T19:23:39.712 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2023-07-29T19:23:39.766 INFO:teuthology.orchestra.console.smithi116:Power off completed 2023-07-29T19:23:39.867 INFO:teuthology.orchestra.console.smithi116:Power on 2023-07-29T19:23:39.867 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-29T19:23:39.889 DEBUG:teuthology.orchestra.console.smithi116:power on output: Chassis Power Control: Up/On 2023-07-29T19:23:39.890 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T19:23:39.911 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2023-07-29T19:23:43.663 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T19:23:43.713 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T19:23:43.773 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off 2023-07-29T19:23:43.823 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2023-07-29T19:23:43.875 INFO:teuthology.orchestra.console.smithi026:Power off completed 2023-07-29T19:23:43.912 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T19:23:43.924 INFO:teuthology.orchestra.console.smithi203:Power off completed 2023-07-29T19:23:43.976 INFO:teuthology.orchestra.console.smithi026:Power on 2023-07-29T19:23:43.977 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-29T19:23:44.003 DEBUG:teuthology.orchestra.console.smithi026:power on output: Chassis Power Control: Up/On 2023-07-29T19:23:44.003 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T19:23:44.022 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2023-07-29T19:23:44.025 INFO:teuthology.orchestra.console.smithi203:Power on 2023-07-29T19:23:44.026 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-29T19:23:44.034 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off 2023-07-29T19:23:44.046 DEBUG:teuthology.orchestra.console.smithi203:power on output: Chassis Power Control: Up/On 2023-07-29T19:23:44.046 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T19:23:44.067 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2023-07-29T19:23:48.028 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T19:23:48.036 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T19:23:48.069 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T19:23:48.145 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2023-07-29T19:23:48.178 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2023-07-29T19:23:48.223 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on 2023-07-29T19:23:48.247 INFO:teuthology.orchestra.console.smithi026:Power on completed 2023-07-29T19:23:48.278 INFO:teuthology.orchestra.console.smithi203:Power on completed 2023-07-29T19:23:48.324 INFO:teuthology.orchestra.console.smithi116:Power on completed 2023-07-29T19:23:48.348 INFO:teuthology.provision.fog.smithi026:Waiting for deploy to finish 2023-07-29T19:23:48.348 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-29T19:23:48.379 INFO:teuthology.provision.fog.smithi203:Waiting for deploy to finish 2023-07-29T19:23:48.380 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-29T19:23:48.425 INFO:teuthology.provision.fog.smithi116:Waiting for deploy to finish 2023-07-29T19:23:48.425 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-07-29T19:24:03.432 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-29T19:24:03.441 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-29T19:24:03.476 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-07-29T19:24:18.508 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-29T19:24:18.509 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-29T19:24:18.533 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-07-29T19:24:33.576 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-29T19:24:33.577 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-29T19:24:33.585 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-07-29T19:24:48.648 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-29T19:24:48.649 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-07-29T19:24:48.650 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-29T19:25:03.716 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-29T19:25:03.718 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-29T19:25:03.719 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-07-29T19:25:18.784 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-29T19:25:18.786 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-29T19:25:18.787 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-07-29T19:25:33.863 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-29T19:25:33.864 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-29T19:25:33.865 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-07-29T19:25:48.936 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-29T19:25:48.938 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-29T19:25:48.939 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-07-29T19:26:03.999 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-29T19:26:04.000 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-07-29T19:26:04.001 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-29T19:26:19.066 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-07-29T19:26:19.068 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-29T19:26:19.069 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-29T19:26:19.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T19:26:34.137 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-29T19:26:34.138 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-07-29T19:26:34.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T19:26:34.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T19:26:34.476 ERROR:teuthology.orchestra.connection:Error authenticating with smithi203.front.sepia.ceph.com: Authentication failed. 2023-07-29T19:26:34.478 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-29T19:26:34.478 DEBUG:teuthology.orchestra.run.smithi203:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-29T19:26:34.479 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T19:26:37.684 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-07-29T19:26:43.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T19:26:46.736 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-07-29T19:26:52.528 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-07-29T19:26:52.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T19:26:55.796 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-07-29T19:26:58.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T19:27:01.584 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-07-29T19:27:01.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T19:27:04.848 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-07-29T19:27:07.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T19:27:10.640 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-07-29T19:27:10.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T19:27:13.904 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-07-29T19:27:16.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T19:27:19.696 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-07-29T19:27:19.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T19:27:22.960 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-07-29T19:27:25.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T19:27:28.962 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T19:27:32.016 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-07-29T19:27:38.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T19:28:25.700 WARNING:teuthology.provision.fog.smithi116:timed out 2023-07-29T19:28:31.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T19:28:31.892 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-29T19:28:31.893 DEBUG:teuthology.orchestra.run.smithi116:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-29T19:28:32.145 INFO:teuthology.provision.fog.smithi116:Node is ready 2023-07-29T19:28:32.145 DEBUG:teuthology.orchestra.run.smithi116:> hostname 2023-07-29T19:28:32.205 INFO:teuthology.orchestra.run.smithi116.stdout:smithi116.front.sepia.ceph.com 2023-07-29T19:28:32.206 DEBUG:teuthology.orchestra.run.smithi116:> grep smithi116.front.sepia.ceph.com /etc/hosts 2023-07-29T19:28:32.263 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.15.116 smithi116.front.sepia.ceph.com smithi116 2023-07-29T19:28:32.264 DEBUG:teuthology.orchestra.run.smithi116:> sudo hostname smithi116 2023-07-29T19:28:32.357 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/smithi116.front.sepia.ceph.com/smithi116/g' /etc/hosts 2023-07-29T19:28:32.386 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/172.21.15.116/172.21.15.116/g' /etc/hosts 2023-07-29T19:28:32.454 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/smithi116.front.sepia.ceph.com/smithi116/g' /etc/hostname 2023-07-29T19:28:32.521 DEBUG:teuthology.orchestra.run.smithi116:> sudo hostname smithi116 2023-07-29T19:28:32.587 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2023-07-29T19:28:32.645 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="CentOS Stream" 2023-07-29T19:28:32.645 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="8" 2023-07-29T19:28:32.645 INFO:teuthology.orchestra.run.smithi116.stdout:ID="centos" 2023-07-29T19:28:32.646 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="rhel fedora" 2023-07-29T19:28:32.646 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="8" 2023-07-29T19:28:32.646 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el8" 2023-07-29T19:28:32.646 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-29T19:28:32.646 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2023-07-29T19:28:32.646 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-29T19:28:32.646 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://centos.org/" 2023-07-29T19:28:32.646 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-29T19:28:32.647 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-29T19:28:32.647 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-29T19:28:32.648 INFO:teuthology.provision.fog.smithi116:Deploy complete! 2023-07-29T19:28:32.649 DEBUG:teuthology.parallel:result is None 2023-07-29T19:28:38.019 WARNING:teuthology.provision.fog.smithi026:timed out 2023-07-29T19:28:44.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T19:28:44.241 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-29T19:28:44.242 DEBUG:teuthology.orchestra.run.smithi026:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-29T19:28:44.516 INFO:teuthology.provision.fog.smithi026:Node is ready 2023-07-29T19:28:44.516 DEBUG:teuthology.orchestra.run.smithi026:> hostname 2023-07-29T19:28:44.537 INFO:teuthology.orchestra.run.smithi026.stdout:smithi026.front.sepia.ceph.com 2023-07-29T19:28:44.537 DEBUG:teuthology.orchestra.run.smithi026:> grep smithi026.front.sepia.ceph.com /etc/hosts 2023-07-29T19:28:44.599 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26 smithi026.front.sepia.ceph.com smithi026 2023-07-29T19:28:44.600 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026 2023-07-29T19:28:44.712 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hosts 2023-07-29T19:28:44.744 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/172.21.15.26/172.21.15.26/g' /etc/hosts 2023-07-29T19:28:44.816 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hostname 2023-07-29T19:28:44.889 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026 2023-07-29T19:28:44.960 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2023-07-29T19:28:45.021 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="CentOS Stream" 2023-07-29T19:28:45.022 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="8" 2023-07-29T19:28:45.022 INFO:teuthology.orchestra.run.smithi026.stdout:ID="centos" 2023-07-29T19:28:45.022 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="rhel fedora" 2023-07-29T19:28:45.022 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="8" 2023-07-29T19:28:45.022 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el8" 2023-07-29T19:28:45.023 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-29T19:28:45.023 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31" 2023-07-29T19:28:45.023 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-29T19:28:45.023 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://centos.org/" 2023-07-29T19:28:45.023 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-29T19:28:45.024 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-29T19:28:45.024 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-29T19:28:45.024 INFO:teuthology.provision.fog.smithi026:Deploy complete! 2023-07-29T19:28:45.025 DEBUG:teuthology.parallel:result is None 2023-07-29T19:29:09.232 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-29T19:29:09.233 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi203 2023-07-29T19:29:18.240 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2023-07-29T19:29:18.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T19:29:18.573 DEBUG:teuthology.orchestra.run.smithi203:> true 2023-07-29T19:29:18.839 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com' 2023-07-29T19:29:18.839 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-29T19:29:18.840 DEBUG:teuthology.orchestra.run.smithi203:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-29T19:29:18.858 INFO:teuthology.provision.fog.smithi203:Node is ready 2023-07-29T19:29:18.859 DEBUG:teuthology.orchestra.run.smithi203:> hostname 2023-07-29T19:29:18.917 INFO:teuthology.orchestra.run.smithi203.stdout:smithi203.front.sepia.ceph.com 2023-07-29T19:29:18.918 DEBUG:teuthology.orchestra.run.smithi203:> grep smithi203.front.sepia.ceph.com /etc/hosts 2023-07-29T19:29:18.977 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.15.203 smithi203.front.sepia.ceph.com smithi203 2023-07-29T19:29:18.977 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203 2023-07-29T19:29:19.087 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hosts 2023-07-29T19:29:19.116 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/172.21.15.203/172.21.15.203/g' /etc/hosts 2023-07-29T19:29:19.184 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hostname 2023-07-29T19:29:19.251 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203 2023-07-29T19:29:19.318 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release 2023-07-29T19:29:19.376 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream" 2023-07-29T19:29:19.377 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="8" 2023-07-29T19:29:19.377 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos" 2023-07-29T19:29:19.377 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora" 2023-07-29T19:29:19.377 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="8" 2023-07-29T19:29:19.377 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el8" 2023-07-29T19:29:19.377 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-29T19:29:19.377 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31" 2023-07-29T19:29:19.378 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-29T19:29:19.378 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/" 2023-07-29T19:29:19.378 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-29T19:29:19.378 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-29T19:29:19.378 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-29T19:29:19.379 INFO:teuthology.provision.fog.smithi203:Deploy complete! 2023-07-29T19:29:19.379 DEBUG:teuthology.parallel:result is None 2023-07-29T19:29:19.567 INFO:teuthology.lock.ops:Checking smithi026.front.sepia.ceph.com 2023-07-29T19:29:19.567 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-29T19:29:19.591 INFO:teuthology.lock.ops:Checking smithi116.front.sepia.ceph.com 2023-07-29T19:29:19.591 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-29T19:29:19.607 INFO:teuthology.lock.ops:Checking smithi203.front.sepia.ceph.com 2023-07-29T19:29:19.608 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-29T19:29:19.627 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: set os type and version on server 2023-07-29T19:29:19.627 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-07-29T19:29:19.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T19:29:19.695 DEBUG:teuthology.orchestra.run.smithi026:> true 2023-07-29T19:29:19.836 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-07-29T19:29:19.836 DEBUG:teuthology.orchestra.run.smithi026:> uname -m 2023-07-29T19:29:19.895 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64 2023-07-29T19:29:19.896 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2023-07-29T19:29:19.954 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="CentOS Stream" 2023-07-29T19:29:19.955 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="8" 2023-07-29T19:29:19.955 INFO:teuthology.orchestra.run.smithi026.stdout:ID="centos" 2023-07-29T19:29:19.955 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="rhel fedora" 2023-07-29T19:29:19.955 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="8" 2023-07-29T19:29:19.955 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el8" 2023-07-29T19:29:19.956 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-29T19:29:19.956 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31" 2023-07-29T19:29:19.956 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-29T19:29:19.956 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://centos.org/" 2023-07-29T19:29:19.956 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-29T19:29:19.956 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-29T19:29:19.956 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-29T19:29:19.957 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2023-07-29T19:29:19.983 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: set os type and version on server 2023-07-29T19:29:19.983 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-07-29T19:29:19.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T19:29:20.054 DEBUG:teuthology.orchestra.run.smithi116:> true 2023-07-29T19:29:20.195 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-07-29T19:29:20.195 DEBUG:teuthology.orchestra.run.smithi116:> uname -m 2023-07-29T19:29:20.254 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64 2023-07-29T19:29:20.254 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2023-07-29T19:29:20.313 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="CentOS Stream" 2023-07-29T19:29:20.313 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="8" 2023-07-29T19:29:20.313 INFO:teuthology.orchestra.run.smithi116.stdout:ID="centos" 2023-07-29T19:29:20.314 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="rhel fedora" 2023-07-29T19:29:20.314 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="8" 2023-07-29T19:29:20.314 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el8" 2023-07-29T19:29:20.314 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-29T19:29:20.314 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2023-07-29T19:29:20.314 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-29T19:29:20.315 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://centos.org/" 2023-07-29T19:29:20.315 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-29T19:29:20.315 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-29T19:29:20.315 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-29T19:29:20.315 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2023-07-29T19:29:20.341 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: set os type and version on server 2023-07-29T19:29:20.341 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2023-07-29T19:29:20.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T19:29:20.407 DEBUG:teuthology.orchestra.run.smithi203:> true 2023-07-29T19:29:20.480 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com' 2023-07-29T19:29:20.480 DEBUG:teuthology.orchestra.run.smithi203:> uname -m 2023-07-29T19:29:20.539 INFO:teuthology.orchestra.run.smithi203.stdout:x86_64 2023-07-29T19:29:20.539 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release 2023-07-29T19:29:20.598 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream" 2023-07-29T19:29:20.599 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="8" 2023-07-29T19:29:20.599 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos" 2023-07-29T19:29:20.599 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora" 2023-07-29T19:29:20.599 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="8" 2023-07-29T19:29:20.599 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el8" 2023-07-29T19:29:20.600 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-29T19:29:20.600 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31" 2023-07-29T19:29:20.600 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-29T19:29:20.600 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/" 2023-07-29T19:29:20.600 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-29T19:29:20.600 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-29T19:29:20.600 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-29T19:29:20.601 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2023-07-29T19:29:20.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T19:29:20.762 INFO:teuthology.dispatcher.supervisor:Running job 7357283 2023-07-29T19:29:20.763 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-29_15:47:48-rbd-reef-release-testing-default-smithi/7357283 --name yuriw-2023-07-29_15:47:48-rbd-reef-release-testing-default-smithi --description rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-stupid qemu/xfstests supported-random-distro$/{centos_8} workloads/dynamic_features} -- /home/teuthworker/archive/yuriw-2023-07-29_15:47:48-rbd-reef-release-testing-default-smithi/7357283/orig.config.yaml 2023-07-29T19:29:20.766 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-07-29_15:47:48-rbd-reef-release-testing-default-smithi/7357283 2023-07-29T19:29:20.766 INFO:teuthology.dispatcher.supervisor:Job PID: 15315 2023-07-29T19:29:20.767 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-29T19:31:20.768 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T19:33:20.846 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T19:35:21.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T19:37:21.176 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T19:39:21.353 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T19:41:21.532 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T19:43:21.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T19:45:21.885 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T19:47:22.044 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T19:47:22.125 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2023-07-29T19:47:22.240 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-29T19:47:22.240 INFO:teuthology.nuke:Checking targets against current locks 2023-07-29T19:47:22.299 DEBUG:teuthology.nuke:shortname: smithi026 2023-07-29T19:47:22.299 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-29T19:47:22.322 DEBUG:teuthology.nuke:shortname: smithi116 2023-07-29T19:47:22.322 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-29T19:47:22.327 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi026.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-29_15:47:48-rbd-reef-release-testing-default-smithi/7357283', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-29 19:23:29.730713', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA9o/HO9MAqyjACzwmIQw0BoUoOaOqTOkg+Q5O5SfplzOnMXWhURxK/1fwYOadSpI0xYXbjKjK+VA7TT7H/6FLI='} 2023-07-29T19:47:22.353 DEBUG:teuthology.nuke:shortname: smithi203 2023-07-29T19:47:22.353 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-29T19:47:22.357 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi116.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-29_15:47:48-rbd-reef-release-testing-default-smithi/7357283', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-29 19:23:29.734047', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt/z+EKzOKne2bH3OQT+tzCLozkhUyEn6AQPgWEWk8pzpcXb1NZgKgY+2WNdh6nrlmvPY/TD1tI0rGq0izU4fMAbfFinR5vrLYu4TbI0l45DVkPIXOXsun2+lHgAZgbxFoNpPNGi0y2c4RPsxskULou13YmzjLWuxZmIVJjRAl5s7KCTfy6Od8qS9c+GT179Ugr4PaMLS3Y4QH0vlDiC/+7b7oHOE9ou0jUm0KOJDGjVljmzcMuo4X6/I5kI16RATUvNca0Z4LNhlGhSaFQkIdX8oYJ3sWmxZ0FzPnR6SWDPAUPBxbP4SHjObDvhB0GsywWv4jlHrdMH6HM1ZY9SmOSnKCXM/VPv8RYVgb9IbflWupk6eM+GAi5+Cq60NXTJRvGnCUqOLzJJM7oG5uPpeab9WKdJtMCZMqqjX2f1qgTyna5uKpYhPcoFhs38phVVt8Gkb7xtGOU9ejn5eI1J1C93Y2dJQmecHW3KMo511THDKGMxH4dPr8Qq9VPr5LyPc='} 2023-07-29T19:47:22.381 INFO:teuthology.orchestra.console.smithi026:Power off 2023-07-29T19:47:22.382 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-29T19:47:22.394 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi203.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-29_15:47:48-rbd-reef-release-testing-default-smithi/7357283', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-29 19:23:29.732787', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrYhfaGf5ltwCE7LMo//UnAXvrGr7NUTFcxrlhQhdVQUwRs5QvfxZQuyF5FxXfj5Ue3JTFKMQ3JTLWoI7UNdlDjZvBaauFKByoCvVsqXhj982nM4TurT36rAGUIqPP+YVuNPjv2RcESZmd/e97AQYHOrvMBzYuhRq2xbS24LNry6hmDPmBZUilg0zBAFWszoCCAy2dk4V9AVQbVpkalZuiJk8EspEWnUlW5JcWjmlK19Vq2/XctOhKlNfEkjDurWecWbqLUIDYTAPdJmBJX9Rv1j5REtj7GZZIob119dQpyDzCAjiGmzGU6N2FdEyxTMtBkxdzX9jr1T68v7ZM3Sqq8S37Hl+DJnyiNmrjUujqzy7nX1skyJMwL8t7pE03pz7I9IV9BnsZR+DqM9NYW0Chw1749b5X0/IaVcTSwcWZvyWNtNzgG3D732xv5Dmfe3U1r/z/QzbbKUwVHM1VKVdg4MJUaEZGPBiI0u4bi/s+IBsKvLt54yopiJV4EgVgy/M='} 2023-07-29T19:47:22.406 DEBUG:teuthology.orchestra.console.smithi026:power off output: Chassis Power Control: Down/Off 2023-07-29T19:47:22.407 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T19:47:22.424 INFO:teuthology.orchestra.console.smithi116:Power off 2023-07-29T19:47:22.424 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-29T19:47:22.444 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2023-07-29T19:47:22.445 DEBUG:teuthology.orchestra.console.smithi116:power off output: Chassis Power Control: Down/Off 2023-07-29T19:47:22.445 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T19:47:22.464 INFO:teuthology.orchestra.console.smithi203:Power off 2023-07-29T19:47:22.465 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-29T19:47:22.475 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on 2023-07-29T19:47:22.485 DEBUG:teuthology.orchestra.console.smithi203:power off output: Chassis Power Control: Down/Off 2023-07-29T19:47:22.485 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T19:47:22.506 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2023-07-29T19:47:26.448 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T19:47:26.476 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T19:47:26.507 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T19:47:26.560 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2023-07-29T19:47:26.588 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on 2023-07-29T19:47:26.619 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2023-07-29T19:47:30.564 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T19:47:30.590 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T19:47:30.621 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T19:47:30.674 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2023-07-29T19:47:30.699 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on 2023-07-29T19:47:30.731 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2023-07-29T19:47:34.676 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T19:47:34.701 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T19:47:34.732 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T19:47:34.786 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off 2023-07-29T19:47:34.811 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2023-07-29T19:47:34.842 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2023-07-29T19:47:34.888 INFO:teuthology.orchestra.console.smithi026:Power off completed 2023-07-29T19:47:34.912 INFO:teuthology.orchestra.console.smithi116:Power off completed 2023-07-29T19:47:34.942 INFO:teuthology.orchestra.console.smithi203:Power off completed 2023-07-29T19:47:35.034 ERROR:teuthology.lock.ops:failed to unlock smithi026.front.sepia.ceph.com. reason: Cannot unlock an already-unlocked node 2023-07-29T19:47:35.051 ERROR:teuthology.lock.ops:failed to unlock smithi116.front.sepia.ceph.com. reason: Cannot unlock an already-unlocked node 2023-07-29T19:47:35.080 ERROR:teuthology.lock.ops:failed to unlock smithi203.front.sepia.ceph.com. reason: Cannot unlock an already-unlocked node