2023-09-26T19:45:51.494 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-26T19:45:51.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T19:45:51.626 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fbeba3f2d30>, signals=[15]) 2023-09-26T19:45:51.626 INFO:teuthology.lock.ops:Start node 'smithi069.front.sepia.ceph.com' reimaging 2023-09-26T19:45:51.627 INFO:teuthology.lock.ops:Updating [smithi069.front.sepia.ceph.com]: reset os type and version on server 2023-09-26T19:45:51.627 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server 2023-09-26T19:45:51.651 INFO:teuthology.lock.ops:Start node 'smithi174.front.sepia.ceph.com' reimaging 2023-09-26T19:45:51.651 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: reset os type and version on server 2023-09-26T19:45:51.651 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2023-09-26T19:45:51.653 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /host {"name": "smithi069"} 2023-09-26T19:45:51.676 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /host {"name": "smithi174"} 2023-09-26T19:45:51.731 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-09-26T19:45:51.743 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-09-26T19:45:51.774 DEBUG:teuthology.provision.fog.smithi069:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-09-26T19:45:51.774 DEBUG:teuthology.provision.fog.smithi069:FOG request: PUT /host/174 {"imageID": 6} 2023-09-26T19:45:51.785 DEBUG:teuthology.provision.fog.smithi174:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-09-26T19:45:51.785 DEBUG:teuthology.provision.fog.smithi174:FOG request: PUT /host/279 {"imageID": 6} 2023-09-26T19:45:51.817 INFO:teuthology.provision.fog.smithi069:Scheduling deploy of ubuntu 22.04 2023-09-26T19:45:51.817 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-09-26T19:45:51.828 INFO:teuthology.provision.fog.smithi174:Scheduling deploy of ubuntu 22.04 2023-09-26T19:45:51.828 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-09-26T19:45:51.859 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /tasktype {"name": "deploy"} 2023-09-26T19:45:51.867 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /tasktype {"name": "deploy"} 2023-09-26T19:45:51.894 DEBUG:teuthology.provision.fog.smithi069:FOG request: POST /host/174/task {"taskTypeID": 1} 2023-09-26T19:45:51.897 DEBUG:teuthology.provision.fog.smithi174:FOG request: POST /host/279/task {"taskTypeID": 1} 2023-09-26T19:45:51.987 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-09-26T19:45:52.003 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-09-26T19:45:52.074 INFO:teuthology.orchestra.console.smithi069:Power off 2023-09-26T19:45:52.074 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-26T19:45:52.086 INFO:teuthology.orchestra.console.smithi174:Power off 2023-09-26T19:45:52.087 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-26T19:45:52.095 DEBUG:teuthology.orchestra.console.smithi069:power off output: Chassis Power Control: Down/Off 2023-09-26T19:45:52.096 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-26T19:45:52.106 DEBUG:teuthology.orchestra.console.smithi174:power off output: Chassis Power Control: Down/Off 2023-09-26T19:45:52.106 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-26T19:45:52.117 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2023-09-26T19:45:52.125 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2023-09-26T19:45:56.121 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-26T19:45:56.127 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-26T19:45:56.230 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2023-09-26T19:45:56.236 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2023-09-26T19:46:00.231 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-26T19:46:00.238 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-26T19:46:00.341 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2023-09-26T19:46:00.347 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2023-09-26T19:46:00.442 INFO:teuthology.orchestra.console.smithi069:Power off completed 2023-09-26T19:46:00.542 INFO:teuthology.orchestra.console.smithi069:Power on 2023-09-26T19:46:00.542 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-26T19:46:00.563 DEBUG:teuthology.orchestra.console.smithi069:power on output: Chassis Power Control: Up/On 2023-09-26T19:46:00.563 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-26T19:46:00.583 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2023-09-26T19:46:04.352 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-26T19:46:04.461 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-09-26T19:46:04.562 INFO:teuthology.orchestra.console.smithi174:Power off completed 2023-09-26T19:46:04.583 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-26T19:46:04.663 INFO:teuthology.orchestra.console.smithi174:Power on 2023-09-26T19:46:04.663 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-26T19:46:04.682 DEBUG:teuthology.orchestra.console.smithi174:power on output: Chassis Power Control: Up/On 2023-09-26T19:46:04.682 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-26T19:46:04.691 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2023-09-26T19:46:04.701 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-09-26T19:46:08.696 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-26T19:46:08.704 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-26T19:46:08.806 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2023-09-26T19:46:08.814 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2023-09-26T19:46:08.907 INFO:teuthology.orchestra.console.smithi069:Power on completed 2023-09-26T19:46:08.915 INFO:teuthology.orchestra.console.smithi174:Power on completed 2023-09-26T19:46:09.009 INFO:teuthology.provision.fog.smithi069:Waiting for deploy to finish 2023-09-26T19:46:09.009 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-09-26T19:46:09.016 INFO:teuthology.provision.fog.smithi174:Waiting for deploy to finish 2023-09-26T19:46:09.016 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-09-26T19:46:24.074 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-09-26T19:46:24.077 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-09-26T19:46:39.143 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-09-26T19:46:39.145 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-09-26T19:46:54.215 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-09-26T19:46:54.218 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-09-26T19:47:09.270 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-09-26T19:47:09.274 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-09-26T19:47:24.338 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-09-26T19:47:24.340 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-09-26T19:47:39.415 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-09-26T19:47:39.417 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-09-26T19:47:54.493 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-09-26T19:47:54.494 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-09-26T19:48:09.573 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-09-26T19:48:09.575 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-09-26T19:48:24.646 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-09-26T19:48:24.648 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-09-26T19:48:39.719 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-09-26T19:48:39.721 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-09-26T19:48:54.796 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-09-26T19:48:54.800 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-09-26T19:49:09.874 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-09-26T19:49:09.876 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-09-26T19:49:24.950 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-09-26T19:49:24.952 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-09-26T19:49:25.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-26T19:49:25.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-26T19:49:43.421 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-09-26T19:49:43.422 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-09-26T19:49:49.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-26T19:49:49.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-26T19:49:52.506 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-09-26T19:49:52.507 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-09-26T19:49:58.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-26T19:49:58.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-26T19:50:01.595 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-09-26T19:50:01.596 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-09-26T19:50:07.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-26T19:50:07.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-26T19:50:10.650 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-09-26T19:50:10.682 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-09-26T19:50:16.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-26T19:50:16.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-26T19:51:16.708 WARNING:teuthology.provision.fog.smithi069:timed out 2023-09-26T19:51:16.709 WARNING:teuthology.provision.fog.smithi174:timed out 2023-09-26T19:51:22.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-26T19:51:22.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-26T19:51:22.943 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-26T19:51:22.943 DEBUG:teuthology.orchestra.run.smithi174:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-26T19:51:23.053 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-26T19:51:23.053 DEBUG:teuthology.orchestra.run.smithi069:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-26T19:51:23.389 INFO:teuthology.provision.fog.smithi174:Node is ready 2023-09-26T19:51:23.389 DEBUG:teuthology.orchestra.run.smithi174:> hostname 2023-09-26T19:51:23.434 INFO:teuthology.orchestra.run.smithi174.stdout:smithi174.front.sepia.ceph.com 2023-09-26T19:51:23.435 DEBUG:teuthology.orchestra.run.smithi174:> grep smithi174.front.sepia.ceph.com /etc/hosts 2023-09-26T19:51:23.483 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.15.174 smithi174.front.sepia.ceph.com smithi174 2023-09-26T19:51:23.484 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname smithi174 2023-09-26T19:51:23.540 INFO:teuthology.provision.fog.smithi069:Node is ready 2023-09-26T19:51:23.540 DEBUG:teuthology.orchestra.run.smithi069:> hostname 2023-09-26T19:51:23.585 INFO:teuthology.orchestra.run.smithi069.stdout:smithi069.front.sepia.ceph.com 2023-09-26T19:51:23.586 DEBUG:teuthology.orchestra.run.smithi069:> grep smithi069.front.sepia.ceph.com /etc/hosts 2023-09-26T19:51:23.616 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi174.front.sepia.ceph.com/smithi174/g' /etc/hosts 2023-09-26T19:51:23.630 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/172.21.15.174/172.21.15.174/g' /etc/hosts 2023-09-26T19:51:23.634 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69 smithi069.front.sepia.ceph.com smithi069 2023-09-26T19:51:23.634 DEBUG:teuthology.orchestra.run.smithi069:> sudo hostname smithi069 2023-09-26T19:51:23.687 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi174.front.sepia.ceph.com/smithi174/g' /etc/hostname 2023-09-26T19:51:23.742 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname smithi174 2023-09-26T19:51:23.752 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/smithi069.front.sepia.ceph.com/smithi069/g' /etc/hosts 2023-09-26T19:51:23.766 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/172.21.15.69/172.21.15.69/g' /etc/hosts 2023-09-26T19:51:23.796 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2023-09-26T19:51:23.821 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/smithi069.front.sepia.ceph.com/smithi069/g' /etc/hostname 2023-09-26T19:51:23.846 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-26T19:51:23.847 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="Ubuntu" 2023-09-26T19:51:23.847 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="22.04" 2023-09-26T19:51:23.847 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-26T19:51:23.847 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_CODENAME=jammy 2023-09-26T19:51:23.847 INFO:teuthology.orchestra.run.smithi174.stdout:ID=ubuntu 2023-09-26T19:51:23.847 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE=debian 2023-09-26T19:51:23.847 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-26T19:51:23.847 INFO:teuthology.orchestra.run.smithi174.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-26T19:51:23.847 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-26T19:51:23.847 INFO:teuthology.orchestra.run.smithi174.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-26T19:51:23.847 INFO:teuthology.orchestra.run.smithi174.stdout:UBUNTU_CODENAME=jammy 2023-09-26T19:51:23.848 INFO:teuthology.provision.fog.smithi174:Deploy complete! 2023-09-26T19:51:23.849 DEBUG:teuthology.parallel:result is None 2023-09-26T19:51:23.878 DEBUG:teuthology.orchestra.run.smithi069:> sudo hostname smithi069 2023-09-26T19:51:23.932 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release 2023-09-26T19:51:23.981 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-26T19:51:23.981 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="Ubuntu" 2023-09-26T19:51:23.981 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="22.04" 2023-09-26T19:51:23.982 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-26T19:51:23.982 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_CODENAME=jammy 2023-09-26T19:51:23.982 INFO:teuthology.orchestra.run.smithi069.stdout:ID=ubuntu 2023-09-26T19:51:23.982 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE=debian 2023-09-26T19:51:23.982 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-26T19:51:23.982 INFO:teuthology.orchestra.run.smithi069.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-26T19:51:23.982 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-26T19:51:23.982 INFO:teuthology.orchestra.run.smithi069.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-26T19:51:23.982 INFO:teuthology.orchestra.run.smithi069.stdout:UBUNTU_CODENAME=jammy 2023-09-26T19:51:23.983 INFO:teuthology.provision.fog.smithi069:Deploy complete! 2023-09-26T19:51:23.983 DEBUG:teuthology.parallel:result is None 2023-09-26T19:51:24.184 INFO:teuthology.lock.ops:Checking smithi069.front.sepia.ceph.com 2023-09-26T19:51:24.185 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-26T19:51:24.209 INFO:teuthology.lock.ops:Checking smithi174.front.sepia.ceph.com 2023-09-26T19:51:24.209 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-26T19:51:24.235 INFO:teuthology.lock.ops:Updating [smithi069.front.sepia.ceph.com]: set os type and version on server 2023-09-26T19:51:24.236 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-09-26T19:51:24.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-26T19:51:24.311 DEBUG:teuthology.orchestra.run.smithi069:> true 2023-09-26T19:51:24.417 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-09-26T19:51:24.418 DEBUG:teuthology.orchestra.run.smithi069:> uname -m 2023-09-26T19:51:24.465 INFO:teuthology.orchestra.run.smithi069.stdout:x86_64 2023-09-26T19:51:24.466 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release 2023-09-26T19:51:24.514 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-26T19:51:24.514 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="Ubuntu" 2023-09-26T19:51:24.514 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="22.04" 2023-09-26T19:51:24.514 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-26T19:51:24.514 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_CODENAME=jammy 2023-09-26T19:51:24.514 INFO:teuthology.orchestra.run.smithi069.stdout:ID=ubuntu 2023-09-26T19:51:24.514 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE=debian 2023-09-26T19:51:24.514 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-26T19:51:24.514 INFO:teuthology.orchestra.run.smithi069.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-26T19:51:24.515 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-26T19:51:24.515 INFO:teuthology.orchestra.run.smithi069.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-26T19:51:24.515 INFO:teuthology.orchestra.run.smithi069.stdout:UBUNTU_CODENAME=jammy 2023-09-26T19:51:24.515 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server 2023-09-26T19:51:24.533 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: set os type and version on server 2023-09-26T19:51:24.533 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-09-26T19:51:24.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-26T19:51:24.610 DEBUG:teuthology.orchestra.run.smithi174:> true 2023-09-26T19:51:24.718 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-09-26T19:51:24.718 DEBUG:teuthology.orchestra.run.smithi174:> uname -m 2023-09-26T19:51:24.766 INFO:teuthology.orchestra.run.smithi174.stdout:x86_64 2023-09-26T19:51:24.767 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2023-09-26T19:51:24.814 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-26T19:51:24.814 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="Ubuntu" 2023-09-26T19:51:24.814 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="22.04" 2023-09-26T19:51:24.814 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-26T19:51:24.814 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_CODENAME=jammy 2023-09-26T19:51:24.815 INFO:teuthology.orchestra.run.smithi174.stdout:ID=ubuntu 2023-09-26T19:51:24.815 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE=debian 2023-09-26T19:51:24.815 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-26T19:51:24.815 INFO:teuthology.orchestra.run.smithi174.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-26T19:51:24.815 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-26T19:51:24.815 INFO:teuthology.orchestra.run.smithi174.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-26T19:51:24.815 INFO:teuthology.orchestra.run.smithi174.stdout:UBUNTU_CODENAME=jammy 2023-09-26T19:51:24.815 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2023-09-26T19:51:24.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T19:51:24.915 INFO:teuthology.dispatcher.supervisor:Running job 7402557 2023-09-26T19:51:24.915 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_ksirivad@teuthology --archive /home/teuthworker/archive/ksirivad-2023-09-26_19:22:00-rados:thrash-erasure-code-main-distro-default-smithi/7402557 --name ksirivad-2023-09-26_19:22:00-rados:thrash-erasure-code-main-distro-default-smithi --description rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} -- /home/teuthworker/archive/ksirivad-2023-09-26_19:22:00-rados:thrash-erasure-code-main-distro-default-smithi/7402557/orig.config.yaml 2023-09-26T19:51:24.918 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/ksirivad-2023-09-26_19:22:00-rados:thrash-erasure-code-main-distro-default-smithi/7402557 2023-09-26T19:51:24.918 INFO:teuthology.dispatcher.supervisor:Job PID: 1478202 2023-09-26T19:51:24.918 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-26T19:53:25.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T19:55:25.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T19:57:25.349 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T19:59:25.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:01:25.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:03:25.822 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:05:25.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:07:26.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:09:27.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:11:27.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:13:27.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:15:27.645 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:17:27.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:19:27.956 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:21:28.042 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:23:28.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:25:28.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:27:28.532 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:29:28.690 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:31:28.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:33:29.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:35:29.118 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:37:29.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:39:29.408 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:41:29.524 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-26T20:41:29.582 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-09-26T20:41:29.749 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-26T20:41:29.749 INFO:teuthology.nuke:Checking targets against current locks 2023-09-26T20:41:29.797 DEBUG:teuthology.nuke:shortname: smithi069 2023-09-26T20:41:29.797 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-26T20:41:29.815 DEBUG:teuthology.nuke:shortname: smithi174 2023-09-26T20:41:29.815 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-26T20:41:29.835 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi174.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/ksirivad-2023-09-26_19:22:00-rados:thrash-erasure-code-main-distro-default-smithi/7402557', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-26 19:45:50.731519', 'locked_by': 'scheduled_ksirivad@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHpYM0Ba3ZEe+xBYIRSiIdbIeQ4zS+OvesK5nR1KuOcm83USbbEvDuuPMGKgzgJfgNKCW3onfxahNrhjakQDEXY='} 2023-09-26T20:41:29.851 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi069.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/ksirivad-2023-09-26_19:22:00-rados:thrash-erasure-code-main-distro-default-smithi/7402557', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-26 19:45:50.729730', 'locked_by': 'scheduled_ksirivad@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIDDsSC2j0lqnmfle7ISaP2MA6scR/WU5nyDLNtsJsTUmeHYG6ldWfRXRKACExn60/QITWpBG2kVO6c6DdNggog='} 2023-09-26T20:41:29.878 INFO:teuthology.orchestra.console.smithi174:Power off 2023-09-26T20:41:29.879 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-26T20:41:29.890 INFO:teuthology.orchestra.console.smithi069:Power off 2023-09-26T20:41:29.890 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-26T20:41:29.901 DEBUG:teuthology.orchestra.console.smithi174:power off output: Chassis Power Control: Down/Off 2023-09-26T20:41:29.901 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-26T20:41:29.911 DEBUG:teuthology.orchestra.console.smithi069:power off output: Chassis Power Control: Down/Off 2023-09-26T20:41:29.911 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-26T20:41:29.921 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-09-26T20:41:29.930 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2023-09-26T20:41:30.021 INFO:teuthology.orchestra.console.smithi174:Power off completed 2023-09-26T20:41:30.031 INFO:teuthology.orchestra.console.smithi069:Power off completed 2023-09-26T20:41:30.163 INFO:teuthology.lock.ops:unlocked: smithi174.front.sepia.ceph.com 2023-09-26T20:41:30.171 INFO:teuthology.lock.ops:unlocked: smithi069.front.sepia.ceph.com