2023-09-26T19:57:44.753 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-26T19:57:44.753 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T19:57:44.897 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7eff10c7ad30>, signals=[15]) 2023-09-26T19:57:44.898 INFO:teuthology.lock.ops:Start node 'smithi099.front.sepia.ceph.com' reimaging 2023-09-26T19:57:44.898 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: reset os type and version on server 2023-09-26T19:57:44.899 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2023-09-26T19:57:44.922 INFO:teuthology.lock.ops:Start node 'smithi148.front.sepia.ceph.com' reimaging 2023-09-26T19:57:44.923 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: reset os type and version on server 2023-09-26T19:57:44.923 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2023-09-26T19:57:44.924 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /host {"name": "smithi099"} 2023-09-26T19:57:44.948 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /host {"name": "smithi148"} 2023-09-26T19:57:45.003 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-09-26T19:57:45.026 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-09-26T19:57:45.051 DEBUG:teuthology.provision.fog.smithi099:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-09-26T19:57:45.051 DEBUG:teuthology.provision.fog.smithi099:FOG request: PUT /host/204 {"imageID": 6} 2023-09-26T19:57:45.079 DEBUG:teuthology.provision.fog.smithi148:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-09-26T19:57:45.079 DEBUG:teuthology.provision.fog.smithi148:FOG request: PUT /host/253 {"imageID": 6} 2023-09-26T19:57:45.096 INFO:teuthology.provision.fog.smithi099:Scheduling deploy of ubuntu 22.04 2023-09-26T19:57:45.096 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-09-26T19:57:45.128 INFO:teuthology.provision.fog.smithi148:Scheduling deploy of ubuntu 22.04 2023-09-26T19:57:45.129 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-09-26T19:57:45.142 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /tasktype {"name": "deploy"} 2023-09-26T19:57:45.179 DEBUG:teuthology.provision.fog.smithi099:FOG request: POST /host/204/task {"taskTypeID": 1} 2023-09-26T19:57:45.183 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /tasktype {"name": "deploy"} 2023-09-26T19:57:45.218 DEBUG:teuthology.provision.fog.smithi148:FOG request: POST /host/253/task {"taskTypeID": 1} 2023-09-26T19:57:45.329 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-09-26T19:57:45.358 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-09-26T19:57:45.420 INFO:teuthology.orchestra.console.smithi099:Power off 2023-09-26T19:57:45.420 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-26T19:57:45.436 INFO:teuthology.orchestra.console.smithi148:Power off 2023-09-26T19:57:45.436 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-26T19:57:45.444 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off 2023-09-26T19:57:45.444 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-26T19:57:45.457 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off 2023-09-26T19:57:45.457 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-26T19:57:45.474 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2023-09-26T19:57:45.477 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2023-09-26T19:57:49.479 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-26T19:57:49.486 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-26T19:57:49.588 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2023-09-26T19:57:49.594 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2023-09-26T19:57:53.590 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-26T19:57:53.596 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-26T19:57:53.698 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2023-09-26T19:57:53.703 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2023-09-26T19:57:53.800 INFO:teuthology.orchestra.console.smithi099:Power off completed 2023-09-26T19:57:53.901 INFO:teuthology.orchestra.console.smithi099:Power on 2023-09-26T19:57:53.901 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-26T19:57:53.921 DEBUG:teuthology.orchestra.console.smithi099:power on output: Chassis Power Control: Up/On 2023-09-26T19:57:53.921 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-26T19:57:53.940 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2023-09-26T19:57:57.706 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-26T19:57:57.815 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2023-09-26T19:57:57.916 INFO:teuthology.orchestra.console.smithi148:Power off completed 2023-09-26T19:57:57.941 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-26T19:57:58.017 INFO:teuthology.orchestra.console.smithi148:Power on 2023-09-26T19:57:58.017 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-26T19:57:58.037 DEBUG:teuthology.orchestra.console.smithi148:power on output: Chassis Power Control: Up/On 2023-09-26T19:57:58.037 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-26T19:57:58.051 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2023-09-26T19:57:58.057 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2023-09-26T19:58:02.056 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-26T19:58:02.063 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-26T19:58:02.167 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2023-09-26T19:58:02.171 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2023-09-26T19:58:02.268 INFO:teuthology.orchestra.console.smithi099:Power on completed 2023-09-26T19:58:02.368 INFO:teuthology.provision.fog.smithi099:Waiting for deploy to finish 2023-09-26T19:58:02.369 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-09-26T19:58:06.174 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-26T19:58:06.282 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2023-09-26T19:58:06.383 INFO:teuthology.orchestra.console.smithi148:Power on completed 2023-09-26T19:58:06.483 INFO:teuthology.provision.fog.smithi148:Waiting for deploy to finish 2023-09-26T19:58:06.483 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-09-26T19:58:17.434 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-09-26T19:58:21.546 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-09-26T19:58:32.498 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-09-26T19:58:36.606 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-09-26T19:58:47.562 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-09-26T19:58:51.662 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-09-26T19:59:02.634 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-09-26T19:59:06.722 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-09-26T19:59:17.702 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-09-26T19:59:21.792 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-09-26T19:59:32.774 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-09-26T19:59:36.862 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-09-26T19:59:47.850 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-09-26T19:59:51.926 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-09-26T20:00:02.920 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-09-26T20:00:06.989 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-09-26T20:00:17.998 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-09-26T20:00:22.094 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-09-26T20:00:33.068 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-09-26T20:00:37.150 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-09-26T20:00:48.142 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-09-26T20:00:52.231 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-09-26T20:01:03.214 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-09-26T20:01:07.300 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-09-26T20:01:18.291 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-09-26T20:01:18.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-26T20:01:22.370 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-09-26T20:01:22.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-26T20:01:36.890 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-09-26T20:01:40.986 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-09-26T20:01:42.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-26T20:01:45.946 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-09-26T20:01:46.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-26T20:01:50.042 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-09-26T20:01:51.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-26T20:01:55.002 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-09-26T20:01:56.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-26T20:01:59.098 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-09-26T20:02:01.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-26T20:02:04.058 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-09-26T20:02:05.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-26T20:02:08.154 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-09-26T20:02:10.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-26T20:02:13.114 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-09-26T20:02:14.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-26T20:02:17.211 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-09-26T20:02:19.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-26T20:02:23.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-26T20:02:50.619 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-09-26T20:02:56.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-26T20:02:56.628 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-09-26T20:03:02.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-26T20:03:02.635 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-09-26T20:03:08.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-26T20:03:08.644 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-09-26T20:03:14.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-26T20:03:14.897 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-26T20:03:14.898 DEBUG:teuthology.orchestra.run.smithi099:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-26T20:03:15.332 INFO:teuthology.provision.fog.smithi099:Node is ready 2023-09-26T20:03:15.332 DEBUG:teuthology.orchestra.run.smithi099:> hostname 2023-09-26T20:03:15.376 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099.front.sepia.ceph.com 2023-09-26T20:03:15.377 DEBUG:teuthology.orchestra.run.smithi099:> grep smithi099.front.sepia.ceph.com /etc/hosts 2023-09-26T20:03:15.427 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99 smithi099.front.sepia.ceph.com smithi099 2023-09-26T20:03:15.427 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2023-09-26T20:03:15.562 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hosts 2023-09-26T20:03:15.582 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/172.21.15.99/172.21.15.99/g' /etc/hosts 2023-09-26T20:03:15.638 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hostname 2023-09-26T20:03:15.693 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2023-09-26T20:03:15.748 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2023-09-26T20:03:15.797 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-26T20:03:15.797 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="Ubuntu" 2023-09-26T20:03:15.797 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="22.04" 2023-09-26T20:03:15.797 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-26T20:03:15.797 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_CODENAME=jammy 2023-09-26T20:03:15.797 INFO:teuthology.orchestra.run.smithi099.stdout:ID=ubuntu 2023-09-26T20:03:15.797 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE=debian 2023-09-26T20:03:15.798 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-26T20:03:15.798 INFO:teuthology.orchestra.run.smithi099.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-26T20:03:15.798 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-26T20:03:15.798 INFO:teuthology.orchestra.run.smithi099.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-26T20:03:15.798 INFO:teuthology.orchestra.run.smithi099.stdout:UBUNTU_CODENAME=jammy 2023-09-26T20:03:15.799 INFO:teuthology.provision.fog.smithi099:Deploy complete! 2023-09-26T20:03:15.800 DEBUG:teuthology.parallel:result is None 2023-09-26T20:03:23.490 WARNING:teuthology.provision.fog.smithi148:timed out 2023-09-26T20:03:30.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-26T20:03:30.836 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-26T20:03:30.836 DEBUG:teuthology.orchestra.run.smithi148:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-26T20:03:31.322 INFO:teuthology.provision.fog.smithi148:Node is ready 2023-09-26T20:03:31.322 DEBUG:teuthology.orchestra.run.smithi148:> hostname 2023-09-26T20:03:31.371 INFO:teuthology.orchestra.run.smithi148.stdout:smithi148.front.sepia.ceph.com 2023-09-26T20:03:31.371 DEBUG:teuthology.orchestra.run.smithi148:> grep smithi148.front.sepia.ceph.com /etc/hosts 2023-09-26T20:03:31.418 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148 smithi148.front.sepia.ceph.com smithi148 2023-09-26T20:03:31.418 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148 2023-09-26T20:03:31.550 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148.front.sepia.ceph.com/smithi148/g' /etc/hosts 2023-09-26T20:03:31.564 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/172.21.15.148/172.21.15.148/g' /etc/hosts 2023-09-26T20:03:31.617 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148.front.sepia.ceph.com/smithi148/g' /etc/hostname 2023-09-26T20:03:31.675 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148 2023-09-26T20:03:31.733 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2023-09-26T20:03:31.778 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-26T20:03:31.778 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="Ubuntu" 2023-09-26T20:03:31.779 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="22.04" 2023-09-26T20:03:31.779 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-26T20:03:31.779 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_CODENAME=jammy 2023-09-26T20:03:31.779 INFO:teuthology.orchestra.run.smithi148.stdout:ID=ubuntu 2023-09-26T20:03:31.779 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE=debian 2023-09-26T20:03:31.779 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-26T20:03:31.779 INFO:teuthology.orchestra.run.smithi148.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-26T20:03:31.779 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-26T20:03:31.779 INFO:teuthology.orchestra.run.smithi148.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-26T20:03:31.779 INFO:teuthology.orchestra.run.smithi148.stdout:UBUNTU_CODENAME=jammy 2023-09-26T20:03:31.779 INFO:teuthology.provision.fog.smithi148:Deploy complete! 2023-09-26T20:03:31.780 DEBUG:teuthology.parallel:result is None 2023-09-26T20:03:31.955 INFO:teuthology.lock.ops:Checking smithi099.front.sepia.ceph.com 2023-09-26T20:03:31.955 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-26T20:03:31.975 INFO:teuthology.lock.ops:Checking smithi148.front.sepia.ceph.com 2023-09-26T20:03:31.976 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-26T20:03:31.993 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: set os type and version on server 2023-09-26T20:03:31.993 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2023-09-26T20:03:31.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-26T20:03:32.069 DEBUG:teuthology.orchestra.run.smithi099:> true 2023-09-26T20:03:32.290 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2023-09-26T20:03:32.290 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2023-09-26T20:03:32.336 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2023-09-26T20:03:32.337 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2023-09-26T20:03:32.385 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-26T20:03:32.385 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="Ubuntu" 2023-09-26T20:03:32.385 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="22.04" 2023-09-26T20:03:32.385 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-26T20:03:32.385 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_CODENAME=jammy 2023-09-26T20:03:32.385 INFO:teuthology.orchestra.run.smithi099.stdout:ID=ubuntu 2023-09-26T20:03:32.386 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE=debian 2023-09-26T20:03:32.386 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-26T20:03:32.386 INFO:teuthology.orchestra.run.smithi099.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-26T20:03:32.386 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-26T20:03:32.386 INFO:teuthology.orchestra.run.smithi099.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-26T20:03:32.386 INFO:teuthology.orchestra.run.smithi099.stdout:UBUNTU_CODENAME=jammy 2023-09-26T20:03:32.386 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2023-09-26T20:03:32.409 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: set os type and version on server 2023-09-26T20:03:32.409 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-09-26T20:03:32.409 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-26T20:03:32.482 DEBUG:teuthology.orchestra.run.smithi148:> true 2023-09-26T20:03:32.598 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-09-26T20:03:32.598 DEBUG:teuthology.orchestra.run.smithi148:> uname -m 2023-09-26T20:03:32.645 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64 2023-09-26T20:03:32.645 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2023-09-26T20:03:32.693 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-26T20:03:32.693 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="Ubuntu" 2023-09-26T20:03:32.693 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="22.04" 2023-09-26T20:03:32.693 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-26T20:03:32.693 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_CODENAME=jammy 2023-09-26T20:03:32.693 INFO:teuthology.orchestra.run.smithi148.stdout:ID=ubuntu 2023-09-26T20:03:32.694 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE=debian 2023-09-26T20:03:32.694 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-26T20:03:32.694 INFO:teuthology.orchestra.run.smithi148.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-26T20:03:32.694 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-26T20:03:32.694 INFO:teuthology.orchestra.run.smithi148.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-26T20:03:32.694 INFO:teuthology.orchestra.run.smithi148.stdout:UBUNTU_CODENAME=jammy 2023-09-26T20:03:32.694 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2023-09-26T20:03:32.717 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:03:32.796 INFO:teuthology.dispatcher.supervisor:Running job 7402561 2023-09-26T20:03:32.796 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_ksirivad@teuthology --archive /home/teuthworker/archive/ksirivad-2023-09-26_19:22:00-rados:thrash-erasure-code-main-distro-default-smithi/7402561 --name ksirivad-2023-09-26_19:22:00-rados:thrash-erasure-code-main-distro-default-smithi --description rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} -- /home/teuthworker/archive/ksirivad-2023-09-26_19:22:00-rados:thrash-erasure-code-main-distro-default-smithi/7402561/orig.config.yaml 2023-09-26T20:03:32.799 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/ksirivad-2023-09-26_19:22:00-rados:thrash-erasure-code-main-distro-default-smithi/7402561 2023-09-26T20:03:32.799 INFO:teuthology.dispatcher.supervisor:Job PID: 1527854 2023-09-26T20:03:32.799 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-26T20:05:32.882 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:07:33.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:09:33.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:11:33.380 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:13:33.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:15:33.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:17:33.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:19:33.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:21:34.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:23:34.323 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:25:34.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:27:34.653 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:29:34.786 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:31:34.945 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:33:35.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:35:35.317 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:37:35.433 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:39:35.560 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:41:35.738 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:43:35.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:45:36.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:47:36.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:49:36.404 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:51:36.569 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:53:36.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:53:36.820 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-09-26T20:53:36.989 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-26T20:53:36.989 INFO:teuthology.nuke:Checking targets against current locks 2023-09-26T20:53:37.038 DEBUG:teuthology.nuke:shortname: smithi099 2023-09-26T20:53:37.038 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-26T20:53:37.059 DEBUG:teuthology.nuke:shortname: smithi148 2023-09-26T20:53:37.059 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-26T20:53:37.062 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/ksirivad-2023-09-26_19:22:00-rados:thrash-erasure-code-main-distro-default-smithi/7402561', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-26 19:57:43.933570', 'locked_by': 'scheduled_ksirivad@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGSyBzIDN2+YW1nG2KJHTryLXYezYaIB5rqfIW1RVq3UPWFkQcF8gYMgeDLrdxdXbN5PPf0TpnIRDbKUy04HTUc='} 2023-09-26T20:53:37.085 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/ksirivad-2023-09-26_19:22:00-rados:thrash-erasure-code-main-distro-default-smithi/7402561', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-26 19:57:43.935661', 'locked_by': 'scheduled_ksirivad@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIUE+uiXEbLFaRex0ORH0HCa5YZnh8ktdLwkg7dKp/nq8lokA4+C/zS8uf/2Px3U+bTaAsTQH54FzcJ0raFIM70='} 2023-09-26T20:53:37.111 INFO:teuthology.orchestra.console.smithi099:Power off 2023-09-26T20:53:37.111 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-26T20:53:37.132 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off 2023-09-26T20:53:37.132 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-26T20:53:37.148 INFO:teuthology.orchestra.console.smithi148:Power off 2023-09-26T20:53:37.149 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-26T20:53:37.156 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2023-09-26T20:53:37.170 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off 2023-09-26T20:53:37.171 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-26T20:53:37.190 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2023-09-26T20:53:37.257 INFO:teuthology.orchestra.console.smithi099:Power off completed 2023-09-26T20:53:37.291 INFO:teuthology.orchestra.console.smithi148:Power off completed 2023-09-26T20:53:37.412 INFO:teuthology.lock.ops:unlocked: smithi099.front.sepia.ceph.com 2023-09-26T20:53:37.437 INFO:teuthology.lock.ops:unlocked: smithi148.front.sepia.ceph.com