2023-09-15T11:38:53.513 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-15T11:38:53.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-15T11:38:53.638 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7afe709b80>, signals=[15]) 2023-09-15T11:38:53.639 INFO:teuthology.lock.ops:Start node 'smithi002.front.sepia.ceph.com' reimaging 2023-09-15T11:38:53.641 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: reset os type and version on server 2023-09-15T11:38:53.641 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2023-09-15T11:38:53.695 INFO:teuthology.lock.ops:Start node 'smithi017.front.sepia.ceph.com' reimaging 2023-09-15T11:38:53.695 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: reset os type and version on server 2023-09-15T11:38:53.696 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2023-09-15T11:38:53.697 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /host {"name": "smithi002"} 2023-09-15T11:38:53.762 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /host {"name": "smithi017"} 2023-09-15T11:38:53.765 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-09-15T11:38:53.806 DEBUG:teuthology.provision.fog.smithi002:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-09-15T11:38:53.807 DEBUG:teuthology.provision.fog.smithi002:FOG request: PUT /host/108 {"imageID": 2} 2023-09-15T11:38:53.815 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-09-15T11:38:53.848 INFO:teuthology.provision.fog.smithi002:Scheduling deploy of ubuntu 20.04 2023-09-15T11:38:53.848 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-15T11:38:53.851 DEBUG:teuthology.provision.fog.smithi017:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-09-15T11:38:53.852 DEBUG:teuthology.provision.fog.smithi017:FOG request: PUT /host/123 {"imageID": 2} 2023-09-15T11:38:53.900 INFO:teuthology.provision.fog.smithi017:Scheduling deploy of ubuntu 20.04 2023-09-15T11:38:53.901 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-15T11:38:53.945 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /tasktype {"name": "deploy"} 2023-09-15T11:38:53.983 DEBUG:teuthology.provision.fog.smithi002:FOG request: POST /host/108/task {"taskTypeID": 1} 2023-09-15T11:38:54.020 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /tasktype {"name": "deploy"} 2023-09-15T11:38:54.044 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-15T11:38:54.056 DEBUG:teuthology.provision.fog.smithi017:FOG request: POST /host/123/task {"taskTypeID": 1} 2023-09-15T11:38:54.100 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-15T11:38:54.206 INFO:teuthology.orchestra.console.smithi002:Power off 2023-09-15T11:38:54.207 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-15T11:38:54.227 DEBUG:teuthology.orchestra.console.smithi002:power off output: Chassis Power Control: Down/Off 2023-09-15T11:38:54.227 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-15T11:38:54.246 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off 2023-09-15T11:38:54.263 INFO:teuthology.orchestra.console.smithi017:Power off 2023-09-15T11:38:54.264 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-15T11:38:54.284 DEBUG:teuthology.orchestra.console.smithi017:power off output: Chassis Power Control: Down/Off 2023-09-15T11:38:54.284 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-15T11:38:54.305 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on 2023-09-15T11:38:54.347 INFO:teuthology.orchestra.console.smithi002:Power off completed 2023-09-15T11:38:54.448 INFO:teuthology.orchestra.console.smithi002:Power on 2023-09-15T11:38:54.448 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-15T11:38:54.467 DEBUG:teuthology.orchestra.console.smithi002:power on output: Chassis Power Control: Up/On 2023-09-15T11:38:54.468 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-15T11:38:54.487 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off 2023-09-15T11:38:58.310 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-15T11:38:58.419 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on 2023-09-15T11:38:58.489 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-15T11:38:58.598 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is on 2023-09-15T11:38:58.699 INFO:teuthology.orchestra.console.smithi002:Power on completed 2023-09-15T11:38:58.800 INFO:teuthology.provision.fog.smithi002:Waiting for deploy to finish 2023-09-15T11:38:58.800 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-15T11:39:02.422 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-15T11:39:02.529 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2023-09-15T11:39:02.630 INFO:teuthology.orchestra.console.smithi017:Power off completed 2023-09-15T11:39:02.731 INFO:teuthology.orchestra.console.smithi017:Power on 2023-09-15T11:39:02.731 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-15T11:39:02.751 DEBUG:teuthology.orchestra.console.smithi017:power on output: Chassis Power Control: Up/On 2023-09-15T11:39:02.752 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-15T11:39:02.771 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2023-09-15T11:39:06.776 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-15T11:39:06.884 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2023-09-15T11:39:10.889 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-15T11:39:10.998 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on 2023-09-15T11:39:11.099 INFO:teuthology.orchestra.console.smithi017:Power on completed 2023-09-15T11:39:11.199 INFO:teuthology.provision.fog.smithi017:Waiting for deploy to finish 2023-09-15T11:39:11.200 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-15T11:39:13.955 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-15T11:39:26.394 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-15T11:39:29.152 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-15T11:39:41.576 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-15T11:39:44.342 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-15T11:39:56.776 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-15T11:39:59.519 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-15T11:40:11.986 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-15T11:40:14.691 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-15T11:40:27.174 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-15T11:40:29.896 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-15T11:40:42.390 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-15T11:40:45.106 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-15T11:41:19.038 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-15T11:41:21.118 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-15T11:41:37.209 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-15T11:41:38.922 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-15T11:41:54.814 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-15T11:41:55.872 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-15T11:42:10.234 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-15T11:42:12.794 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-15T11:42:25.549 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-15T11:42:29.378 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-15T11:42:41.369 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-15T11:42:45.747 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-15T11:42:57.039 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-15T11:43:01.557 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-15T11:43:12.859 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-15T11:43:17.884 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-15T11:43:29.818 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-15T11:43:33.590 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-15T11:43:45.807 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-15T11:43:48.848 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-15T11:44:01.286 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-15T11:44:04.110 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-15T11:44:16.760 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-15T11:44:19.371 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-15T11:44:32.394 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-15T11:44:34.632 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-15T11:44:34.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T11:44:37.947 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-09-15T11:44:43.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T11:44:47.034 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-09-15T11:44:47.829 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-15T11:44:53.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T11:44:56.122 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-09-15T11:45:02.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T11:45:03.090 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-15T11:45:05.210 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-09-15T11:45:11.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T11:45:14.298 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-09-15T11:45:18.318 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-15T11:45:20.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T11:45:33.546 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-15T11:45:48.761 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-15T11:46:03.938 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-15T11:46:19.070 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-15T11:46:19.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T11:46:20.305 WARNING:teuthology.provision.fog.smithi002:timed out 2023-09-15T11:46:22.238 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2023-09-15T11:46:26.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T11:46:26.515 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-15T11:46:26.516 DEBUG:teuthology.orchestra.run.smithi002:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-15T11:46:27.005 INFO:teuthology.provision.fog.smithi002:Node is ready 2023-09-15T11:46:27.006 DEBUG:teuthology.orchestra.run.smithi002:> hostname 2023-09-15T11:46:27.013 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002.front.sepia.ceph.com 2023-09-15T11:46:27.014 DEBUG:teuthology.orchestra.run.smithi002:> grep smithi002.front.sepia.ceph.com /etc/hosts 2023-09-15T11:46:27.065 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2 smithi002.front.sepia.ceph.com smithi002 2023-09-15T11:46:27.065 DEBUG:teuthology.orchestra.run.smithi002:> sudo hostname smithi002 2023-09-15T11:46:27.149 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/smithi002.front.sepia.ceph.com/smithi002/g' /etc/hosts 2023-09-15T11:46:27.167 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/172.21.15.2/172.21.15.2/g' /etc/hosts 2023-09-15T11:46:27.226 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/smithi002.front.sepia.ceph.com/smithi002/g' /etc/hostname 2023-09-15T11:46:27.237 DEBUG:teuthology.orchestra.run.smithi002:> sudo hostname smithi002 2023-09-15T11:46:27.250 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release 2023-09-15T11:46:27.299 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="Ubuntu" 2023-09-15T11:46:27.299 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-09-15T11:46:27.300 INFO:teuthology.orchestra.run.smithi002.stdout:ID=ubuntu 2023-09-15T11:46:27.300 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE=debian 2023-09-15T11:46:27.300 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-09-15T11:46:27.300 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="20.04" 2023-09-15T11:46:27.300 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-15T11:46:27.301 INFO:teuthology.orchestra.run.smithi002.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-15T11:46:27.301 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-15T11:46:27.301 INFO:teuthology.orchestra.run.smithi002.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-15T11:46:27.301 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_CODENAME=focal 2023-09-15T11:46:27.301 INFO:teuthology.orchestra.run.smithi002.stdout:UBUNTU_CODENAME=focal 2023-09-15T11:46:27.302 INFO:teuthology.provision.fog.smithi002:Deploy complete! 2023-09-15T11:46:27.303 DEBUG:teuthology.parallel:result is None 2023-09-15T11:46:28.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T11:46:31.322 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2023-09-15T11:46:37.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T11:46:40.378 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2023-09-15T11:46:46.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T11:46:49.466 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2023-09-15T11:46:55.473 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T11:46:58.554 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2023-09-15T11:47:04.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T11:47:07.610 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2023-09-15T11:47:13.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T11:48:13.675 WARNING:teuthology.provision.fog.smithi017:timed out 2023-09-15T11:48:19.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T11:48:19.890 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-15T11:48:19.890 DEBUG:teuthology.orchestra.run.smithi017:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-15T11:48:20.338 INFO:teuthology.provision.fog.smithi017:Node is ready 2023-09-15T11:48:20.338 DEBUG:teuthology.orchestra.run.smithi017:> hostname 2023-09-15T11:48:20.345 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017.front.sepia.ceph.com 2023-09-15T11:48:20.346 DEBUG:teuthology.orchestra.run.smithi017:> grep smithi017.front.sepia.ceph.com /etc/hosts 2023-09-15T11:48:20.396 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17 smithi017.front.sepia.ceph.com smithi017 2023-09-15T11:48:20.397 DEBUG:teuthology.orchestra.run.smithi017:> sudo hostname smithi017 2023-09-15T11:48:20.493 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/smithi017.front.sepia.ceph.com/smithi017/g' /etc/hosts 2023-09-15T11:48:20.509 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/172.21.15.17/172.21.15.17/g' /etc/hosts 2023-09-15T11:48:20.566 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/smithi017.front.sepia.ceph.com/smithi017/g' /etc/hostname 2023-09-15T11:48:20.582 DEBUG:teuthology.orchestra.run.smithi017:> sudo hostname smithi017 2023-09-15T11:48:20.596 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release 2023-09-15T11:48:20.648 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="Ubuntu" 2023-09-15T11:48:20.648 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-09-15T11:48:20.648 INFO:teuthology.orchestra.run.smithi017.stdout:ID=ubuntu 2023-09-15T11:48:20.649 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE=debian 2023-09-15T11:48:20.649 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-09-15T11:48:20.649 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="20.04" 2023-09-15T11:48:20.649 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-15T11:48:20.650 INFO:teuthology.orchestra.run.smithi017.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-15T11:48:20.650 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-15T11:48:20.650 INFO:teuthology.orchestra.run.smithi017.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-15T11:48:20.650 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_CODENAME=focal 2023-09-15T11:48:20.650 INFO:teuthology.orchestra.run.smithi017.stdout:UBUNTU_CODENAME=focal 2023-09-15T11:48:20.651 INFO:teuthology.provision.fog.smithi017:Deploy complete! 2023-09-15T11:48:20.651 DEBUG:teuthology.parallel:result is None 2023-09-15T11:48:20.950 INFO:teuthology.lock.ops:Checking smithi002.front.sepia.ceph.com 2023-09-15T11:48:20.950 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-15T11:48:20.974 INFO:teuthology.lock.ops:Checking smithi017.front.sepia.ceph.com 2023-09-15T11:48:20.974 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-15T11:48:21.000 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: set os type and version on server 2023-09-15T11:48:21.000 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2023-09-15T11:48:21.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T11:48:21.049 DEBUG:teuthology.orchestra.run.smithi002:> true 2023-09-15T11:48:21.259 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2023-09-15T11:48:21.260 DEBUG:teuthology.orchestra.run.smithi002:> uname -m 2023-09-15T11:48:21.267 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64 2023-09-15T11:48:21.267 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release 2023-09-15T11:48:21.274 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="Ubuntu" 2023-09-15T11:48:21.274 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-09-15T11:48:21.274 INFO:teuthology.orchestra.run.smithi002.stdout:ID=ubuntu 2023-09-15T11:48:21.275 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE=debian 2023-09-15T11:48:21.275 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-09-15T11:48:21.275 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="20.04" 2023-09-15T11:48:21.275 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-15T11:48:21.275 INFO:teuthology.orchestra.run.smithi002.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-15T11:48:21.276 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-15T11:48:21.276 INFO:teuthology.orchestra.run.smithi002.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-15T11:48:21.276 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_CODENAME=focal 2023-09-15T11:48:21.276 INFO:teuthology.orchestra.run.smithi002.stdout:UBUNTU_CODENAME=focal 2023-09-15T11:48:21.277 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2023-09-15T11:48:21.299 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: set os type and version on server 2023-09-15T11:48:21.299 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2023-09-15T11:48:21.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T11:48:21.343 DEBUG:teuthology.orchestra.run.smithi017:> true 2023-09-15T11:48:21.459 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2023-09-15T11:48:21.460 DEBUG:teuthology.orchestra.run.smithi017:> uname -m 2023-09-15T11:48:21.466 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64 2023-09-15T11:48:21.467 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release 2023-09-15T11:48:21.473 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="Ubuntu" 2023-09-15T11:48:21.474 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-09-15T11:48:21.474 INFO:teuthology.orchestra.run.smithi017.stdout:ID=ubuntu 2023-09-15T11:48:21.474 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE=debian 2023-09-15T11:48:21.475 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-09-15T11:48:21.475 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="20.04" 2023-09-15T11:48:21.475 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-15T11:48:21.475 INFO:teuthology.orchestra.run.smithi017.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-15T11:48:21.475 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-15T11:48:21.476 INFO:teuthology.orchestra.run.smithi017.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-15T11:48:21.476 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_CODENAME=focal 2023-09-15T11:48:21.476 INFO:teuthology.orchestra.run.smithi017.stdout:UBUNTU_CODENAME=focal 2023-09-15T11:48:21.477 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2023-09-15T11:48:21.498 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-15T11:48:21.585 INFO:teuthology.dispatcher.supervisor:Running job 7396936 2023-09-15T11:48:21.586 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_rfriedma@teuthology --archive /home/teuthworker/archive/rfriedma-2023-09-15_11:34:08-rados:thrash-wip-rf-squeue2-distro-default-smithi/7396936 --name rfriedma-2023-09-15_11:34:08-rados:thrash-wip-rf-squeue2-distro-default-smithi --description rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04} thrashers/none thrashosds-health workloads/dedup-io-mixed} -- /home/teuthworker/archive/rfriedma-2023-09-15_11:34:08-rados:thrash-wip-rf-squeue2-distro-default-smithi/7396936/orig.config.yaml 2023-09-15T11:48:21.588 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rfriedma-2023-09-15_11:34:08-rados:thrash-wip-rf-squeue2-distro-default-smithi/7396936 2023-09-15T11:48:21.589 INFO:teuthology.dispatcher.supervisor:Job PID: 707837 2023-09-15T11:48:21.589 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-15T11:50:21.690 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-15T11:52:21.864 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-15T11:54:22.036 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-15T11:56:22.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-15T11:58:22.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-15T12:00:22.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-15T12:02:22.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-15T12:02:22.813 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-09-15T12:02:22.921 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-15T12:02:22.921 INFO:teuthology.nuke:Checking targets against current locks 2023-09-15T12:02:22.971 DEBUG:teuthology.nuke:shortname: smithi002 2023-09-15T12:02:22.972 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-15T12:02:22.987 DEBUG:teuthology.nuke:shortname: smithi017 2023-09-15T12:02:22.987 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-15T12:02:22.992 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi002.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rfriedma-2023-09-15_11:34:08-rados:thrash-wip-rf-squeue2-distro-default-smithi/7396936', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-15 11:38:52.750474', 'locked_by': 'scheduled_rfriedma@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-09-15T12:02:23.007 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi017.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rfriedma-2023-09-15_11:34:08-rados:thrash-wip-rf-squeue2-distro-default-smithi/7396936', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-15 11:38:52.751841', 'locked_by': 'scheduled_rfriedma@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-09-15T12:02:23.035 INFO:teuthology.orchestra.console.smithi002:Power off 2023-09-15T12:02:23.036 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-15T12:02:23.048 INFO:teuthology.orchestra.console.smithi017:Power off 2023-09-15T12:02:23.049 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-15T12:02:23.057 DEBUG:teuthology.orchestra.console.smithi002:power off output: Chassis Power Control: Down/Off 2023-09-15T12:02:23.057 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-15T12:02:23.069 DEBUG:teuthology.orchestra.console.smithi017:power off output: Chassis Power Control: Down/Off 2023-09-15T12:02:23.070 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-15T12:02:23.079 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off 2023-09-15T12:02:23.091 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2023-09-15T12:02:23.180 INFO:teuthology.orchestra.console.smithi002:Power off completed 2023-09-15T12:02:23.193 INFO:teuthology.orchestra.console.smithi017:Power off completed 2023-09-15T12:02:23.338 INFO:teuthology.lock.ops:unlocked: smithi002.front.sepia.ceph.com 2023-09-15T12:02:23.345 INFO:teuthology.lock.ops:unlocked: smithi017.front.sepia.ceph.com