2023-10-18T22:35:37.656 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-18T22:35:37.658 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T22:35:37.862 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f32125b5d30>, signals=[15]) 2023-10-18T22:35:37.864 INFO:teuthology.lock.ops:Start node 'smithi003.front.sepia.ceph.com' reimaging 2023-10-18T22:35:37.864 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: reset os type and version on server 2023-10-18T22:35:37.865 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2023-10-18T22:35:37.889 INFO:teuthology.lock.ops:Start node 'smithi083.front.sepia.ceph.com' reimaging 2023-10-18T22:35:37.889 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: reset os type and version on server 2023-10-18T22:35:37.890 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2023-10-18T22:35:37.891 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /host {"name": "smithi003"} 2023-10-18T22:35:37.914 INFO:teuthology.lock.ops:Start node 'smithi151.front.sepia.ceph.com' reimaging 2023-10-18T22:35:37.914 INFO:teuthology.lock.ops:Updating [smithi151.front.sepia.ceph.com]: reset os type and version on server 2023-10-18T22:35:37.914 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2023-10-18T22:35:37.916 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /host {"name": "smithi083"} 2023-10-18T22:35:37.940 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /host {"name": "smithi151"} 2023-10-18T22:35:37.984 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-18T22:35:37.987 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-18T22:35:38.004 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-18T22:35:38.026 DEBUG:teuthology.provision.fog.smithi083:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-18T22:35:38.026 DEBUG:teuthology.provision.fog.smithi083:FOG request: PUT /host/188 {"imageID": 2} 2023-10-18T22:35:38.033 DEBUG:teuthology.provision.fog.smithi003:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-18T22:35:38.034 DEBUG:teuthology.provision.fog.smithi003:FOG request: PUT /host/109 {"imageID": 2} 2023-10-18T22:35:38.039 DEBUG:teuthology.provision.fog.smithi151:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-18T22:35:38.040 DEBUG:teuthology.provision.fog.smithi151:FOG request: PUT /host/256 {"imageID": 2} 2023-10-18T22:35:38.079 INFO:teuthology.provision.fog.smithi151:Scheduling deploy of ubuntu 20.04 2023-10-18T22:35:38.079 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-18T22:35:38.082 INFO:teuthology.provision.fog.smithi003:Scheduling deploy of ubuntu 20.04 2023-10-18T22:35:38.083 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-18T22:35:38.085 INFO:teuthology.provision.fog.smithi083:Scheduling deploy of ubuntu 20.04 2023-10-18T22:35:38.086 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-10-18T22:35:38.145 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /tasktype {"name": "deploy"} 2023-10-18T22:35:38.149 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /tasktype {"name": "deploy"} 2023-10-18T22:35:38.152 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /tasktype {"name": "deploy"} 2023-10-18T22:35:38.186 DEBUG:teuthology.provision.fog.smithi151:FOG request: POST /host/256/task {"taskTypeID": 1} 2023-10-18T22:35:38.190 DEBUG:teuthology.provision.fog.smithi003:FOG request: POST /host/109/task {"taskTypeID": 1} 2023-10-18T22:35:38.191 DEBUG:teuthology.provision.fog.smithi083:FOG request: POST /host/188/task {"taskTypeID": 1} 2023-10-18T22:35:38.267 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-10-18T22:35:38.279 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-18T22:35:38.281 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-18T22:35:38.351 INFO:teuthology.orchestra.console.smithi083:Power off 2023-10-18T22:35:38.352 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-18T22:35:38.367 INFO:teuthology.orchestra.console.smithi003:Power off 2023-10-18T22:35:38.368 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-18T22:35:38.381 DEBUG:teuthology.orchestra.console.smithi083:power off output: Chassis Power Control: Down/Off 2023-10-18T22:35:38.382 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T22:35:38.389 DEBUG:teuthology.orchestra.console.smithi003:power off output: Chassis Power Control: Down/Off 2023-10-18T22:35:38.390 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T22:35:38.402 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is off 2023-10-18T22:35:38.412 INFO:teuthology.orchestra.console.smithi151:Power off 2023-10-18T22:35:38.413 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-18T22:35:38.423 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2023-10-18T22:35:38.437 DEBUG:teuthology.orchestra.console.smithi151:power off output: Chassis Power Control: Down/Off 2023-10-18T22:35:38.438 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T22:35:38.462 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off 2023-10-18T22:35:38.505 INFO:teuthology.orchestra.console.smithi083:Power off completed 2023-10-18T22:35:38.524 INFO:teuthology.orchestra.console.smithi003:Power off completed 2023-10-18T22:35:38.563 INFO:teuthology.orchestra.console.smithi151:Power off completed 2023-10-18T22:35:38.606 INFO:teuthology.orchestra.console.smithi083:Power on 2023-10-18T22:35:38.607 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-18T22:35:38.625 INFO:teuthology.orchestra.console.smithi003:Power on 2023-10-18T22:35:38.626 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-18T22:35:38.636 DEBUG:teuthology.orchestra.console.smithi083:power on output: Chassis Power Control: Up/On 2023-10-18T22:35:38.637 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T22:35:38.650 DEBUG:teuthology.orchestra.console.smithi003:power on output: Chassis Power Control: Up/On 2023-10-18T22:35:38.650 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T22:35:38.663 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is off 2023-10-18T22:35:38.665 INFO:teuthology.orchestra.console.smithi151:Power on 2023-10-18T22:35:38.665 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-18T22:35:38.673 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2023-10-18T22:35:38.685 DEBUG:teuthology.orchestra.console.smithi151:power on output: Chassis Power Control: Up/On 2023-10-18T22:35:38.685 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T22:35:38.708 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off 2023-10-18T22:35:42.666 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T22:35:42.674 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T22:35:42.709 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T22:35:42.776 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is off 2023-10-18T22:35:42.783 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2023-10-18T22:35:42.819 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2023-10-18T22:35:42.920 INFO:teuthology.orchestra.console.smithi151:Power on completed 2023-10-18T22:35:43.021 INFO:teuthology.provision.fog.smithi151:Waiting for deploy to finish 2023-10-18T22:35:43.021 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-18T22:35:46.778 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T22:35:46.785 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T22:35:46.887 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on 2023-10-18T22:35:46.893 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2023-10-18T22:35:46.989 INFO:teuthology.orchestra.console.smithi083:Power on completed 2023-10-18T22:35:46.995 INFO:teuthology.orchestra.console.smithi003:Power on completed 2023-10-18T22:35:47.091 INFO:teuthology.provision.fog.smithi083:Waiting for deploy to finish 2023-10-18T22:35:47.091 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-10-18T22:35:47.096 INFO:teuthology.provision.fog.smithi003:Waiting for deploy to finish 2023-10-18T22:35:47.096 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-18T22:35:58.129 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-18T22:36:02.202 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-10-18T22:36:02.207 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-18T22:36:13.250 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-18T22:36:17.306 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-10-18T22:36:17.314 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-18T22:36:28.354 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-18T22:36:32.422 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-18T22:36:32.425 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-10-18T22:36:43.462 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-18T22:36:47.530 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-18T22:36:47.540 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-10-18T22:36:58.598 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-18T22:37:02.668 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-18T22:37:02.669 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-10-18T22:37:13.718 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-18T22:37:17.790 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-10-18T22:37:17.792 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-18T22:37:28.838 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-18T22:37:32.887 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-10-18T22:37:32.929 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-18T22:37:43.956 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-18T22:37:47.990 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-10-18T22:37:48.031 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-18T22:37:59.090 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-18T22:38:03.102 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-10-18T22:38:03.147 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-18T22:38:27.410 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-10-18T22:38:27.741 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-18T22:38:27.989 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-18T22:38:42.570 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-10-18T22:38:42.855 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-18T22:38:43.181 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-18T22:38:57.686 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-10-18T22:38:57.975 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-18T22:38:58.294 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-18T22:39:12.809 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-10-18T22:39:13.093 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-18T22:39:13.430 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-18T22:39:27.934 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-10-18T22:39:28.199 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-18T22:39:28.558 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-18T22:39:43.058 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-10-18T22:39:43.316 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-18T22:39:43.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T22:39:43.658 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-18T22:39:58.168 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-10-18T22:39:58.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T22:39:58.755 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-18T22:40:01.914 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-10-18T22:40:07.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T22:40:10.974 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-10-18T22:40:13.845 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-18T22:40:16.762 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-10-18T22:40:16.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T22:40:20.027 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-10-18T22:40:22.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T22:40:25.818 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-10-18T22:40:26.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T22:40:28.922 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-18T22:40:31.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T22:40:34.874 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-10-18T22:40:40.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T22:40:43.930 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-10-18T22:40:43.998 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-18T22:40:49.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T22:40:59.078 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-18T22:40:59.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T22:41:17.694 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-10-18T22:41:23.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T22:41:26.033 WARNING:teuthology.provision.fog.smithi003:timed out 2023-10-18T22:41:26.778 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-10-18T22:41:32.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T22:41:32.245 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-18T22:41:32.246 DEBUG:teuthology.orchestra.run.smithi003:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-18T22:41:32.689 INFO:teuthology.provision.fog.smithi003:Node is ready 2023-10-18T22:41:32.689 DEBUG:teuthology.orchestra.run.smithi003:> hostname 2023-10-18T22:41:32.737 INFO:teuthology.orchestra.run.smithi003.stdout:smithi003.front.sepia.ceph.com 2023-10-18T22:41:32.737 DEBUG:teuthology.orchestra.run.smithi003:> grep smithi003.front.sepia.ceph.com /etc/hosts 2023-10-18T22:41:32.744 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3 smithi003.front.sepia.ceph.com smithi003 2023-10-18T22:41:32.744 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2023-10-18T22:41:32.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T22:41:32.832 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hosts 2023-10-18T22:41:32.849 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/172.21.15.3/172.21.15.3/g' /etc/hosts 2023-10-18T22:41:32.864 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hostname 2023-10-18T22:41:32.879 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2023-10-18T22:41:32.934 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2023-10-18T22:41:32.939 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="Ubuntu" 2023-10-18T22:41:32.939 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-18T22:41:32.939 INFO:teuthology.orchestra.run.smithi003.stdout:ID=ubuntu 2023-10-18T22:41:32.939 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE=debian 2023-10-18T22:41:32.940 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-18T22:41:32.940 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="20.04" 2023-10-18T22:41:32.940 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-18T22:41:32.940 INFO:teuthology.orchestra.run.smithi003.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-18T22:41:32.940 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-18T22:41:32.941 INFO:teuthology.orchestra.run.smithi003.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-18T22:41:32.941 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_CODENAME=focal 2023-10-18T22:41:32.941 INFO:teuthology.orchestra.run.smithi003.stdout:UBUNTU_CODENAME=focal 2023-10-18T22:41:32.941 INFO:teuthology.provision.fog.smithi003:Deploy complete! 2023-10-18T22:41:32.943 DEBUG:teuthology.parallel:result is None 2023-10-18T22:41:35.834 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-10-18T22:41:41.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T22:41:44.890 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-10-18T22:41:49.938 WARNING:teuthology.provision.fog.smithi083:timed out 2023-10-18T22:41:50.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T22:41:55.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T22:41:56.149 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-18T22:41:56.149 DEBUG:teuthology.orchestra.run.smithi083:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-18T22:41:56.621 INFO:teuthology.provision.fog.smithi083:Node is ready 2023-10-18T22:41:56.621 DEBUG:teuthology.orchestra.run.smithi083:> hostname 2023-10-18T22:41:56.627 INFO:teuthology.orchestra.run.smithi083.stdout:smithi083.front.sepia.ceph.com 2023-10-18T22:41:56.628 DEBUG:teuthology.orchestra.run.smithi083:> grep smithi083.front.sepia.ceph.com /etc/hosts 2023-10-18T22:41:56.678 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83 smithi083.front.sepia.ceph.com smithi083 2023-10-18T22:41:56.679 DEBUG:teuthology.orchestra.run.smithi083:> sudo hostname smithi083 2023-10-18T22:41:56.766 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/smithi083.front.sepia.ceph.com/smithi083/g' /etc/hosts 2023-10-18T22:41:56.783 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/172.21.15.83/172.21.15.83/g' /etc/hosts 2023-10-18T22:41:56.794 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/smithi083.front.sepia.ceph.com/smithi083/g' /etc/hostname 2023-10-18T22:41:56.852 DEBUG:teuthology.orchestra.run.smithi083:> sudo hostname smithi083 2023-10-18T22:41:56.868 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release 2023-10-18T22:41:56.873 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="Ubuntu" 2023-10-18T22:41:56.874 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-18T22:41:56.874 INFO:teuthology.orchestra.run.smithi083.stdout:ID=ubuntu 2023-10-18T22:41:56.874 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE=debian 2023-10-18T22:41:56.875 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-18T22:41:56.875 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="20.04" 2023-10-18T22:41:56.875 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-18T22:41:56.875 INFO:teuthology.orchestra.run.smithi083.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-18T22:41:56.875 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-18T22:41:56.876 INFO:teuthology.orchestra.run.smithi083.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-18T22:41:56.876 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_CODENAME=focal 2023-10-18T22:41:56.876 INFO:teuthology.orchestra.run.smithi083.stdout:UBUNTU_CODENAME=focal 2023-10-18T22:41:56.877 INFO:teuthology.provision.fog.smithi083:Deploy complete! 2023-10-18T22:41:56.877 DEBUG:teuthology.parallel:result is None 2023-10-18T22:42:50.946 WARNING:teuthology.provision.fog.smithi151:timed out 2023-10-18T22:42:56.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T22:42:57.149 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-18T22:42:57.150 DEBUG:teuthology.orchestra.run.smithi151:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-18T22:42:57.644 INFO:teuthology.provision.fog.smithi151:Node is ready 2023-10-18T22:42:57.644 DEBUG:teuthology.orchestra.run.smithi151:> hostname 2023-10-18T22:42:57.650 INFO:teuthology.orchestra.run.smithi151.stdout:smithi151.front.sepia.ceph.com 2023-10-18T22:42:57.651 DEBUG:teuthology.orchestra.run.smithi151:> grep smithi151.front.sepia.ceph.com /etc/hosts 2023-10-18T22:42:57.657 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151 smithi151.front.sepia.ceph.com smithi151 2023-10-18T22:42:57.658 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname smithi151 2023-10-18T22:42:57.744 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/smithi151.front.sepia.ceph.com/smithi151/g' /etc/hosts 2023-10-18T22:42:57.759 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/172.21.15.151/172.21.15.151/g' /etc/hosts 2023-10-18T22:42:57.776 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/smithi151.front.sepia.ceph.com/smithi151/g' /etc/hostname 2023-10-18T22:42:57.791 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname smithi151 2023-10-18T22:42:57.803 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2023-10-18T22:42:57.808 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="Ubuntu" 2023-10-18T22:42:57.808 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-18T22:42:57.808 INFO:teuthology.orchestra.run.smithi151.stdout:ID=ubuntu 2023-10-18T22:42:57.809 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE=debian 2023-10-18T22:42:57.809 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-18T22:42:57.809 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="20.04" 2023-10-18T22:42:57.809 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-18T22:42:57.809 INFO:teuthology.orchestra.run.smithi151.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-18T22:42:57.810 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-18T22:42:57.810 INFO:teuthology.orchestra.run.smithi151.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-18T22:42:57.810 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_CODENAME=focal 2023-10-18T22:42:57.810 INFO:teuthology.orchestra.run.smithi151.stdout:UBUNTU_CODENAME=focal 2023-10-18T22:42:57.811 INFO:teuthology.provision.fog.smithi151:Deploy complete! 2023-10-18T22:42:57.811 DEBUG:teuthology.parallel:result is None 2023-10-18T22:42:58.138 INFO:teuthology.lock.ops:Checking smithi003.front.sepia.ceph.com 2023-10-18T22:42:58.138 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-18T22:42:58.160 INFO:teuthology.lock.ops:Checking smithi083.front.sepia.ceph.com 2023-10-18T22:42:58.161 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-18T22:42:58.184 INFO:teuthology.lock.ops:Checking smithi151.front.sepia.ceph.com 2023-10-18T22:42:58.185 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-18T22:42:58.211 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: set os type and version on server 2023-10-18T22:42:58.212 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-10-18T22:42:58.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T22:42:58.263 DEBUG:teuthology.orchestra.run.smithi003:> true 2023-10-18T22:42:58.474 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-10-18T22:42:58.474 DEBUG:teuthology.orchestra.run.smithi003:> uname -m 2023-10-18T22:42:58.482 INFO:teuthology.orchestra.run.smithi003.stdout:x86_64 2023-10-18T22:42:58.483 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2023-10-18T22:42:58.489 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="Ubuntu" 2023-10-18T22:42:58.489 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-18T22:42:58.490 INFO:teuthology.orchestra.run.smithi003.stdout:ID=ubuntu 2023-10-18T22:42:58.490 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE=debian 2023-10-18T22:42:58.490 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-18T22:42:58.491 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="20.04" 2023-10-18T22:42:58.491 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-18T22:42:58.491 INFO:teuthology.orchestra.run.smithi003.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-18T22:42:58.491 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-18T22:42:58.492 INFO:teuthology.orchestra.run.smithi003.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-18T22:42:58.492 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_CODENAME=focal 2023-10-18T22:42:58.492 INFO:teuthology.orchestra.run.smithi003.stdout:UBUNTU_CODENAME=focal 2023-10-18T22:42:58.493 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2023-10-18T22:42:58.518 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: set os type and version on server 2023-10-18T22:42:58.518 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-10-18T22:42:58.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T22:42:58.575 DEBUG:teuthology.orchestra.run.smithi083:> true 2023-10-18T22:42:58.787 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-10-18T22:42:58.788 DEBUG:teuthology.orchestra.run.smithi083:> uname -m 2023-10-18T22:42:58.795 INFO:teuthology.orchestra.run.smithi083.stdout:x86_64 2023-10-18T22:42:58.796 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release 2023-10-18T22:42:58.847 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="Ubuntu" 2023-10-18T22:42:58.847 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-18T22:42:58.847 INFO:teuthology.orchestra.run.smithi083.stdout:ID=ubuntu 2023-10-18T22:42:58.847 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE=debian 2023-10-18T22:42:58.848 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-18T22:42:58.848 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="20.04" 2023-10-18T22:42:58.848 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-18T22:42:58.848 INFO:teuthology.orchestra.run.smithi083.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-18T22:42:58.848 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-18T22:42:58.849 INFO:teuthology.orchestra.run.smithi083.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-18T22:42:58.849 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_CODENAME=focal 2023-10-18T22:42:58.849 INFO:teuthology.orchestra.run.smithi083.stdout:UBUNTU_CODENAME=focal 2023-10-18T22:42:58.850 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2023-10-18T22:42:58.867 INFO:teuthology.lock.ops:Updating [smithi151.front.sepia.ceph.com]: set os type and version on server 2023-10-18T22:42:58.868 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-10-18T22:42:58.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T22:42:58.919 DEBUG:teuthology.orchestra.run.smithi151:> true 2023-10-18T22:42:59.043 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-10-18T22:42:59.044 DEBUG:teuthology.orchestra.run.smithi151:> uname -m 2023-10-18T22:42:59.050 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64 2023-10-18T22:42:59.051 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2023-10-18T22:42:59.058 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="Ubuntu" 2023-10-18T22:42:59.058 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-18T22:42:59.058 INFO:teuthology.orchestra.run.smithi151.stdout:ID=ubuntu 2023-10-18T22:42:59.058 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE=debian 2023-10-18T22:42:59.059 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-18T22:42:59.059 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="20.04" 2023-10-18T22:42:59.059 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-18T22:42:59.059 INFO:teuthology.orchestra.run.smithi151.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-18T22:42:59.059 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-18T22:42:59.060 INFO:teuthology.orchestra.run.smithi151.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-18T22:42:59.060 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_CODENAME=focal 2023-10-18T22:42:59.060 INFO:teuthology.orchestra.run.smithi151.stdout:UBUNTU_CODENAME=focal 2023-10-18T22:42:59.060 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2023-10-18T22:42:59.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T22:42:59.193 INFO:teuthology.dispatcher.supervisor:Running job 7431693 2023-10-18T22:42:59.194 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-18_22:26:57-upgrade:quincy-p2p-quincy-distro-default-smithi/7431693 --name yuriw-2023-10-18_22:26:57-upgrade:quincy-p2p-quincy-distro-default-smithi --description upgrade:quincy-p2p/quincy-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/quincy 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-final-workload/{rbd-python snaps-many-objects} objectstore/bluestore-bitmap supported-all-distro/ubuntu_latest thrashosds-health} -- /home/teuthworker/archive/yuriw-2023-10-18_22:26:57-upgrade:quincy-p2p-quincy-distro-default-smithi/7431693/orig.config.yaml 2023-10-18T22:42:59.197 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-10-18_22:26:57-upgrade:quincy-p2p-quincy-distro-default-smithi/7431693 2023-10-18T22:42:59.198 INFO:teuthology.dispatcher.supervisor:Job PID: 4022242 2023-10-18T22:42:59.198 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-18T22:44:59.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T22:46:59.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T22:48:59.630 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T22:50:59.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T22:52:59.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T22:55:00.115 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T22:57:00.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T22:59:00.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T23:01:00.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T23:03:00.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T23:05:00.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T23:07:01.044 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T23:09:01.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T23:11:01.371 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T23:13:01.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T23:15:01.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T23:17:01.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T23:19:02.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T23:21:02.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T23:23:02.323 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T23:25:02.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T23:27:02.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T23:29:02.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T23:31:02.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T23:33:03.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T23:35:03.336 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T23:37:03.512 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T23:39:03.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T23:41:03.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T23:43:04.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T23:45:04.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T23:47:04.340 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T23:49:04.504 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T23:51:04.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T23:53:04.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T23:55:05.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T23:57:05.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T23:59:05.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T00:01:05.509 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T00:03:05.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T00:05:05.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T00:07:06.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T00:09:06.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T00:11:06.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T00:13:06.436 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T00:15:06.604 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T00:17:06.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T00:19:06.933 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T00:21:07.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T00:23:07.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T00:25:07.434 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T00:27:07.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T00:29:07.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T00:31:07.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T00:33:08.115 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T00:35:08.282 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T00:37:08.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T00:39:08.604 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T00:41:08.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T00:43:08.998 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T00:45:09.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T00:47:09.304 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T00:49:09.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T00:51:09.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T00:53:09.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T00:55:09.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T00:57:10.186 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T00:59:10.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T01:01:10.507 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T01:03:10.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T01:05:10.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T01:07:10.998 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T01:09:11.144 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T01:11:11.306 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T01:13:11.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T01:15:11.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T01:17:11.782 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T01:19:11.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T01:21:12.090 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T01:23:12.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T01:25:12.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T01:27:12.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T01:29:12.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T01:31:12.920 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T01:33:13.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T01:35:13.262 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T01:37:13.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T01:39:13.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T01:41:13.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T01:43:14.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T01:45:14.232 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T01:47:14.427 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T01:49:14.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T01:51:14.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T01:53:14.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T01:55:15.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T01:55:15.138 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-19T01:55:15.388 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-19T01:55:15.389 INFO:teuthology.nuke:Checking targets against current locks 2023-10-19T01:55:15.438 DEBUG:teuthology.nuke:shortname: smithi003 2023-10-19T01:55:15.439 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-19T01:55:15.470 DEBUG:teuthology.nuke:shortname: smithi083 2023-10-19T01:55:15.471 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-19T01:55:15.472 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi003.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-18_22:26:57-upgrade:quincy-p2p-quincy-distro-default-smithi/7431693', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-18 22:35:36.747683', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-19T01:55:15.494 DEBUG:teuthology.nuke:shortname: smithi151 2023-10-19T01:55:15.494 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-19T01:55:15.498 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi083.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-18_22:26:57-upgrade:quincy-p2p-quincy-distro-default-smithi/7431693', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-18 22:35:36.746116', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-19T01:55:15.521 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-18_22:26:57-upgrade:quincy-p2p-quincy-distro-default-smithi/7431693', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-18 22:35:36.744733', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-19T01:55:15.530 INFO:teuthology.orchestra.console.smithi003:Power off 2023-10-19T01:55:15.531 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-19T01:55:15.554 DEBUG:teuthology.orchestra.console.smithi003:power off output: Chassis Power Control: Down/Off 2023-10-19T01:55:15.555 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T01:55:15.577 INFO:teuthology.orchestra.console.smithi083:Power off 2023-10-19T01:55:15.577 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-19T01:55:15.586 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2023-10-19T01:55:15.599 DEBUG:teuthology.orchestra.console.smithi083:power off output: Chassis Power Control: Down/Off 2023-10-19T01:55:15.599 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T01:55:15.614 INFO:teuthology.orchestra.console.smithi151:Power off 2023-10-19T01:55:15.614 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-19T01:55:15.625 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is off 2023-10-19T01:55:15.637 DEBUG:teuthology.orchestra.console.smithi151:power off output: Chassis Power Control: Down/Off 2023-10-19T01:55:15.637 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T01:55:15.688 INFO:teuthology.orchestra.console.smithi003:Power off completed 2023-10-19T01:55:15.689 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off 2023-10-19T01:55:15.726 INFO:teuthology.orchestra.console.smithi083:Power off completed 2023-10-19T01:55:15.792 INFO:teuthology.orchestra.console.smithi151:Power off completed 2023-10-19T01:55:15.838 INFO:teuthology.lock.ops:unlocked: smithi003.front.sepia.ceph.com 2023-10-19T01:55:15.871 INFO:teuthology.lock.ops:unlocked: smithi083.front.sepia.ceph.com 2023-10-19T01:55:15.946 INFO:teuthology.lock.ops:unlocked: smithi151.front.sepia.ceph.com