2023-08-31T14:29:03.098 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556 2023-08-31T14:29:03.100 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T14:29:03.230 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa827e49c10>, signals=[15]) 2023-08-31T14:29:03.231 INFO:teuthology.lock.ops:Start node 'smithi092.front.sepia.ceph.com' reimaging 2023-08-31T14:29:03.232 INFO:teuthology.lock.ops:Updating [smithi092.front.sepia.ceph.com]: reset os type and version on server 2023-08-31T14:29:03.232 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2023-08-31T14:29:03.259 INFO:teuthology.lock.ops:Start node 'smithi118.front.sepia.ceph.com' reimaging 2023-08-31T14:29:03.260 INFO:teuthology.lock.ops:Updating [smithi118.front.sepia.ceph.com]: reset os type and version on server 2023-08-31T14:29:03.260 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2023-08-31T14:29:03.261 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /host {"name": "smithi092"} 2023-08-31T14:29:03.284 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /host {"name": "smithi118"} 2023-08-31T14:29:03.322 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-08-31T14:29:03.361 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-08-31T14:29:03.376 DEBUG:teuthology.provision.fog.smithi092:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-08-31T14:29:03.376 DEBUG:teuthology.provision.fog.smithi092:FOG request: PUT /host/197 {"imageID": 6} 2023-08-31T14:29:03.410 DEBUG:teuthology.provision.fog.smithi118:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-08-31T14:29:03.410 DEBUG:teuthology.provision.fog.smithi118:FOG request: PUT /host/223 {"imageID": 6} 2023-08-31T14:29:03.427 INFO:teuthology.provision.fog.smithi092:Scheduling deploy of ubuntu 22.04 2023-08-31T14:29:03.427 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-08-31T14:29:03.448 INFO:teuthology.provision.fog.smithi118:Scheduling deploy of ubuntu 22.04 2023-08-31T14:29:03.449 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-08-31T14:29:03.541 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /tasktype {"name": "deploy"} 2023-08-31T14:29:03.576 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /tasktype {"name": "deploy"} 2023-08-31T14:29:03.580 DEBUG:teuthology.provision.fog.smithi092:FOG request: POST /host/197/task {"taskTypeID": 1} 2023-08-31T14:29:03.627 DEBUG:teuthology.provision.fog.smithi118:FOG request: POST /host/223/task {"taskTypeID": 1} 2023-08-31T14:29:03.637 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-08-31T14:29:03.677 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-08-31T14:29:03.782 INFO:teuthology.orchestra.console.smithi092:Power off 2023-08-31T14:29:03.783 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-31T14:29:03.802 DEBUG:teuthology.orchestra.console.smithi092:power off output: Chassis Power Control: Down/Off 2023-08-31T14:29:03.803 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T14:29:03.827 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off 2023-08-31T14:29:03.851 INFO:teuthology.orchestra.console.smithi118:Power off 2023-08-31T14:29:03.852 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-31T14:29:03.871 DEBUG:teuthology.orchestra.console.smithi118:power off output: Chassis Power Control: Down/Off 2023-08-31T14:29:03.872 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T14:29:03.894 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on 2023-08-31T14:29:03.928 INFO:teuthology.orchestra.console.smithi092:Power off completed 2023-08-31T14:29:04.029 INFO:teuthology.orchestra.console.smithi092:Power on 2023-08-31T14:29:04.029 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-31T14:29:04.049 DEBUG:teuthology.orchestra.console.smithi092:power on output: Chassis Power Control: Up/On 2023-08-31T14:29:04.050 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T14:29:04.072 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off 2023-08-31T14:29:07.898 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T14:29:08.006 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on 2023-08-31T14:29:08.073 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T14:29:08.181 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off 2023-08-31T14:29:12.011 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T14:29:12.119 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off 2023-08-31T14:29:12.183 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T14:29:12.220 INFO:teuthology.orchestra.console.smithi118:Power off completed 2023-08-31T14:29:12.291 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2023-08-31T14:29:12.321 INFO:teuthology.orchestra.console.smithi118:Power on 2023-08-31T14:29:12.322 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-31T14:29:12.343 DEBUG:teuthology.orchestra.console.smithi118:power on output: Chassis Power Control: Up/On 2023-08-31T14:29:12.343 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T14:29:12.364 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off 2023-08-31T14:29:12.392 INFO:teuthology.orchestra.console.smithi092:Power on completed 2023-08-31T14:29:12.493 INFO:teuthology.provision.fog.smithi092:Waiting for deploy to finish 2023-08-31T14:29:12.493 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-08-31T14:29:16.369 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T14:29:16.477 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off 2023-08-31T14:29:20.482 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T14:29:20.705 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on 2023-08-31T14:29:20.806 INFO:teuthology.orchestra.console.smithi118:Power on completed 2023-08-31T14:29:20.907 INFO:teuthology.provision.fog.smithi118:Waiting for deploy to finish 2023-08-31T14:29:20.907 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-08-31T14:29:27.672 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-08-31T14:29:36.105 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-08-31T14:29:42.827 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-08-31T14:29:51.279 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-08-31T14:29:58.009 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-08-31T14:30:06.478 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-08-31T14:30:13.181 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-08-31T14:30:21.654 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-08-31T14:30:28.388 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-08-31T14:30:36.872 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-08-31T14:30:43.568 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-08-31T14:30:52.085 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-08-31T14:30:58.761 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-08-31T14:31:07.295 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-08-31T14:31:13.976 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-08-31T14:31:43.039 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-08-31T14:31:43.269 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-08-31T14:31:59.942 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-08-31T14:32:01.133 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-08-31T14:32:15.190 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-08-31T14:32:17.907 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-08-31T14:32:30.538 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-08-31T14:32:35.450 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-08-31T14:32:45.859 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-08-31T14:32:52.006 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-08-31T14:33:01.109 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-08-31T14:33:08.390 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-08-31T14:33:16.361 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-08-31T14:33:24.290 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-08-31T14:33:31.593 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-08-31T14:33:39.528 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-08-31T14:33:46.786 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-08-31T14:33:54.690 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-08-31T14:34:01.981 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-08-31T14:34:09.813 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-08-31T14:34:17.137 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-08-31T14:34:24.978 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-08-31T14:34:32.278 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-08-31T14:34:40.124 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-08-31T14:34:47.422 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-08-31T14:34:55.297 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-08-31T14:35:02.562 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-08-31T14:35:10.402 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-08-31T14:35:17.678 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-08-31T14:35:25.526 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-08-31T14:35:32.810 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-08-31T14:35:40.637 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-08-31T14:35:47.917 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-08-31T14:35:55.750 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-08-31T14:36:03.011 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-08-31T14:36:10.842 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-08-31T14:36:18.107 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-08-31T14:36:25.934 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-08-31T14:36:33.190 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-08-31T14:36:41.020 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-08-31T14:36:48.258 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-08-31T14:36:56.086 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-08-31T14:37:03.331 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-08-31T14:37:11.143 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-08-31T14:37:11.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T14:37:14.266 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-08-31T14:37:18.401 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-08-31T14:37:20.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T14:37:23.322 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-08-31T14:37:29.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T14:37:32.378 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-08-31T14:37:33.457 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-08-31T14:37:33.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T14:37:36.570 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-08-31T14:37:38.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T14:37:41.434 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-08-31T14:37:42.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T14:37:45.626 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-08-31T14:37:47.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T14:37:50.490 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-08-31T14:37:51.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T14:37:54.686 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-08-31T14:37:56.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T14:37:59.546 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-08-31T14:38:00.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T14:38:03.770 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-08-31T14:38:05.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T14:38:09.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T14:38:12.858 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-08-31T14:38:15.706 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-08-31T14:38:18.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T14:38:21.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T14:38:21.918 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-08-31T14:38:24.762 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-08-31T14:38:27.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T14:38:30.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T14:38:31.002 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-08-31T14:38:33.818 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-08-31T14:38:37.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T14:38:39.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T14:38:39.824 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-08-31T14:38:45.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T14:38:45.832 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-08-31T14:38:51.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T14:38:51.841 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-08-31T14:38:57.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T14:38:57.848 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-08-31T14:39:03.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T14:39:04.065 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-31T14:39:04.066 DEBUG:teuthology.orchestra.run.smithi092:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-31T14:39:04.480 INFO:teuthology.provision.fog.smithi092:Node is ready 2023-08-31T14:39:04.480 DEBUG:teuthology.orchestra.run.smithi092:> hostname 2023-08-31T14:39:04.525 INFO:teuthology.orchestra.run.smithi092.stdout:smithi092.front.sepia.ceph.com 2023-08-31T14:39:04.525 DEBUG:teuthology.orchestra.run.smithi092:> grep smithi092.front.sepia.ceph.com /etc/hosts 2023-08-31T14:39:04.574 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92 smithi092.front.sepia.ceph.com smithi092 2023-08-31T14:39:04.575 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname smithi092 2023-08-31T14:39:04.701 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/smithi092.front.sepia.ceph.com/smithi092/g' /etc/hosts 2023-08-31T14:39:04.715 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/172.21.15.92/172.21.15.92/g' /etc/hosts 2023-08-31T14:39:04.768 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/smithi092.front.sepia.ceph.com/smithi092/g' /etc/hostname 2023-08-31T14:39:04.825 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname smithi092 2023-08-31T14:39:04.879 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2023-08-31T14:39:04.929 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-31T14:39:04.929 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="Ubuntu" 2023-08-31T14:39:04.929 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="22.04" 2023-08-31T14:39:04.930 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-31T14:39:04.930 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_CODENAME=jammy 2023-08-31T14:39:04.930 INFO:teuthology.orchestra.run.smithi092.stdout:ID=ubuntu 2023-08-31T14:39:04.930 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE=debian 2023-08-31T14:39:04.930 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-31T14:39:04.931 INFO:teuthology.orchestra.run.smithi092.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-31T14:39:04.931 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-31T14:39:04.931 INFO:teuthology.orchestra.run.smithi092.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-31T14:39:04.931 INFO:teuthology.orchestra.run.smithi092.stdout:UBUNTU_CODENAME=jammy 2023-08-31T14:39:04.932 INFO:teuthology.provision.fog.smithi092:Deploy complete! 2023-08-31T14:39:04.934 DEBUG:teuthology.parallel:result is None 2023-08-31T14:39:37.038 WARNING:teuthology.provision.fog.smithi118:timed out 2023-08-31T14:39:43.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T14:39:43.238 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-31T14:39:43.238 DEBUG:teuthology.orchestra.run.smithi118:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-31T14:39:43.712 INFO:teuthology.provision.fog.smithi118:Node is ready 2023-08-31T14:39:43.712 DEBUG:teuthology.orchestra.run.smithi118:> hostname 2023-08-31T14:39:43.758 INFO:teuthology.orchestra.run.smithi118.stdout:smithi118.front.sepia.ceph.com 2023-08-31T14:39:43.759 DEBUG:teuthology.orchestra.run.smithi118:> grep smithi118.front.sepia.ceph.com /etc/hosts 2023-08-31T14:39:43.807 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118 smithi118.front.sepia.ceph.com smithi118 2023-08-31T14:39:43.807 DEBUG:teuthology.orchestra.run.smithi118:> sudo hostname smithi118 2023-08-31T14:39:43.934 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/smithi118.front.sepia.ceph.com/smithi118/g' /etc/hosts 2023-08-31T14:39:43.947 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/172.21.15.118/172.21.15.118/g' /etc/hosts 2023-08-31T14:39:44.002 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/smithi118.front.sepia.ceph.com/smithi118/g' /etc/hostname 2023-08-31T14:39:44.063 DEBUG:teuthology.orchestra.run.smithi118:> sudo hostname smithi118 2023-08-31T14:39:44.122 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2023-08-31T14:39:44.174 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-31T14:39:44.175 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="Ubuntu" 2023-08-31T14:39:44.175 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="22.04" 2023-08-31T14:39:44.175 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-31T14:39:44.175 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_CODENAME=jammy 2023-08-31T14:39:44.176 INFO:teuthology.orchestra.run.smithi118.stdout:ID=ubuntu 2023-08-31T14:39:44.176 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE=debian 2023-08-31T14:39:44.176 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-31T14:39:44.177 INFO:teuthology.orchestra.run.smithi118.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-31T14:39:44.177 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-31T14:39:44.177 INFO:teuthology.orchestra.run.smithi118.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-31T14:39:44.177 INFO:teuthology.orchestra.run.smithi118.stdout:UBUNTU_CODENAME=jammy 2023-08-31T14:39:44.178 INFO:teuthology.provision.fog.smithi118:Deploy complete! 2023-08-31T14:39:44.179 DEBUG:teuthology.parallel:result is None 2023-08-31T14:39:44.360 INFO:teuthology.lock.ops:Checking smithi092.front.sepia.ceph.com 2023-08-31T14:39:44.361 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-31T14:39:44.388 INFO:teuthology.lock.ops:Checking smithi118.front.sepia.ceph.com 2023-08-31T14:39:44.388 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-31T14:39:44.413 INFO:teuthology.lock.ops:Updating [smithi092.front.sepia.ceph.com]: set os type and version on server 2023-08-31T14:39:44.414 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-08-31T14:39:44.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T14:39:44.491 DEBUG:teuthology.orchestra.run.smithi092:> true 2023-08-31T14:39:44.714 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-08-31T14:39:44.714 DEBUG:teuthology.orchestra.run.smithi092:> uname -m 2023-08-31T14:39:44.759 INFO:teuthology.orchestra.run.smithi092.stdout:x86_64 2023-08-31T14:39:44.760 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2023-08-31T14:39:44.807 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-31T14:39:44.807 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="Ubuntu" 2023-08-31T14:39:44.808 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="22.04" 2023-08-31T14:39:44.808 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-31T14:39:44.808 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_CODENAME=jammy 2023-08-31T14:39:44.808 INFO:teuthology.orchestra.run.smithi092.stdout:ID=ubuntu 2023-08-31T14:39:44.808 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE=debian 2023-08-31T14:39:44.809 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-31T14:39:44.809 INFO:teuthology.orchestra.run.smithi092.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-31T14:39:44.809 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-31T14:39:44.809 INFO:teuthology.orchestra.run.smithi092.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-31T14:39:44.809 INFO:teuthology.orchestra.run.smithi092.stdout:UBUNTU_CODENAME=jammy 2023-08-31T14:39:44.810 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2023-08-31T14:39:44.830 INFO:teuthology.lock.ops:Updating [smithi118.front.sepia.ceph.com]: set os type and version on server 2023-08-31T14:39:44.830 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-08-31T14:39:44.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T14:39:44.907 DEBUG:teuthology.orchestra.run.smithi118:> true 2023-08-31T14:39:45.033 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-08-31T14:39:45.033 DEBUG:teuthology.orchestra.run.smithi118:> uname -m 2023-08-31T14:39:45.078 INFO:teuthology.orchestra.run.smithi118.stdout:x86_64 2023-08-31T14:39:45.079 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2023-08-31T14:39:45.130 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-31T14:39:45.130 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="Ubuntu" 2023-08-31T14:39:45.130 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="22.04" 2023-08-31T14:39:45.131 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-31T14:39:45.131 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_CODENAME=jammy 2023-08-31T14:39:45.131 INFO:teuthology.orchestra.run.smithi118.stdout:ID=ubuntu 2023-08-31T14:39:45.131 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE=debian 2023-08-31T14:39:45.131 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-31T14:39:45.132 INFO:teuthology.orchestra.run.smithi118.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-31T14:39:45.132 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-31T14:39:45.132 INFO:teuthology.orchestra.run.smithi118.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-31T14:39:45.132 INFO:teuthology.orchestra.run.smithi118.stdout:UBUNTU_CODENAME=jammy 2023-08-31T14:39:45.133 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2023-08-31T14:39:45.154 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T14:39:45.244 INFO:teuthology.dispatcher.supervisor:Running job 7385487 2023-08-31T14:39:45.245 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/virtualenv/bin/teuthology -v --owner scheduled_ivancich@teuthology --archive /home/teuthworker/archive/ivancich-2023-08-31_14:27:53-rgw-wip-eric-testing-1-distro-default-smithi/7385487 --name ivancich-2023-08-31_14:27:53-rgw-wip-eric-testing-1-distro-default-smithi --description rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_multipart_upload} -- /home/teuthworker/archive/ivancich-2023-08-31_14:27:53-rgw-wip-eric-testing-1-distro-default-smithi/7385487/orig.config.yaml 2023-08-31T14:39:45.247 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/ivancich-2023-08-31_14:27:53-rgw-wip-eric-testing-1-distro-default-smithi/7385487 2023-08-31T14:39:45.248 INFO:teuthology.dispatcher.supervisor:Job PID: 3900325 2023-08-31T14:39:45.248 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-31T14:41:45.346 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T14:41:45.424 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-31T14:41:45.518 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-31T14:41:45.519 INFO:teuthology.nuke:Checking targets against current locks 2023-08-31T14:41:45.571 DEBUG:teuthology.nuke:shortname: smithi092 2023-08-31T14:41:45.571 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-31T14:41:45.595 DEBUG:teuthology.nuke:shortname: smithi118 2023-08-31T14:41:45.595 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-31T14:41:45.596 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi092.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/ivancich-2023-08-31_14:27:53-rgw-wip-eric-testing-1-distro-default-smithi/7385487', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-31 14:29:02.330360', 'locked_by': 'scheduled_ivancich@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIH+mAj8LAWRuzuE20QxrsvMYfTk8IcB0LvWPhDBCpQ1q'} 2023-08-31T14:41:45.616 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/ivancich-2023-08-31_14:27:53-rgw-wip-eric-testing-1-distro-default-smithi/7385487', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-31 14:29:02.331925', 'locked_by': 'scheduled_ivancich@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPcEjPGcYml8uX1SOsytn5flglHCYNX6mYQW67fVXZA6'} 2023-08-31T14:41:45.655 INFO:teuthology.orchestra.console.smithi092:Power off 2023-08-31T14:41:45.655 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-31T14:41:45.679 DEBUG:teuthology.orchestra.console.smithi092:power off output: Chassis Power Control: Down/Off 2023-08-31T14:41:45.680 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T14:41:45.695 INFO:teuthology.orchestra.console.smithi118:Power off 2023-08-31T14:41:45.696 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-31T14:41:45.705 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off 2023-08-31T14:41:45.715 DEBUG:teuthology.orchestra.console.smithi118:power off output: Chassis Power Control: Down/Off 2023-08-31T14:41:45.716 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T14:41:45.740 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off 2023-08-31T14:41:45.807 INFO:teuthology.orchestra.console.smithi092:Power off completed 2023-08-31T14:41:45.842 INFO:teuthology.orchestra.console.smithi118:Power off completed 2023-08-31T14:41:45.965 INFO:teuthology.lock.ops:unlocked: smithi092.front.sepia.ceph.com 2023-08-31T14:41:45.997 INFO:teuthology.lock.ops:unlocked: smithi118.front.sepia.ceph.com