2023-10-15T11:52:20.365 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-15T11:52:20.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-15T11:52:20.511 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8fd19e1670>, signals=[15]) 2023-10-15T11:52:20.513 INFO:teuthology.lock.ops:Start node 'smithi098.front.sepia.ceph.com' reimaging 2023-10-15T11:52:20.513 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: reset os type and version on server 2023-10-15T11:52:20.513 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2023-10-15T11:52:20.533 INFO:teuthology.lock.ops:Start node 'smithi135.front.sepia.ceph.com' reimaging 2023-10-15T11:52:20.534 INFO:teuthology.lock.ops:Updating [smithi135.front.sepia.ceph.com]: reset os type and version on server 2023-10-15T11:52:20.534 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2023-10-15T11:52:20.535 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /host {"name": "smithi098"} 2023-10-15T11:52:20.556 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /host {"name": "smithi135"} 2023-10-15T11:52:20.622 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-10-15T11:52:20.627 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-10-15T11:52:20.668 DEBUG:teuthology.provision.fog.smithi135:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-10-15T11:52:20.668 DEBUG:teuthology.provision.fog.smithi135:FOG request: PUT /host/240 {"imageID": 6} 2023-10-15T11:52:20.672 DEBUG:teuthology.provision.fog.smithi098:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-10-15T11:52:20.673 DEBUG:teuthology.provision.fog.smithi098:FOG request: PUT /host/203 {"imageID": 6} 2023-10-15T11:52:20.708 INFO:teuthology.provision.fog.smithi135:Scheduling deploy of ubuntu 22.04 2023-10-15T11:52:20.708 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-10-15T11:52:20.715 INFO:teuthology.provision.fog.smithi098:Scheduling deploy of ubuntu 22.04 2023-10-15T11:52:20.716 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-15T11:52:20.767 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /tasktype {"name": "deploy"} 2023-10-15T11:52:20.771 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /tasktype {"name": "deploy"} 2023-10-15T11:52:20.807 DEBUG:teuthology.provision.fog.smithi098:FOG request: POST /host/203/task {"taskTypeID": 1} 2023-10-15T11:52:20.810 DEBUG:teuthology.provision.fog.smithi135:FOG request: POST /host/240/task {"taskTypeID": 1} 2023-10-15T11:52:20.864 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-15T11:52:20.867 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-10-15T11:52:20.957 INFO:teuthology.orchestra.console.smithi098:Power off 2023-10-15T11:52:20.958 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-15T11:52:20.968 INFO:teuthology.orchestra.console.smithi135:Power off 2023-10-15T11:52:20.969 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-15T11:52:20.980 DEBUG:teuthology.orchestra.console.smithi098:power off output: Chassis Power Control: Down/Off 2023-10-15T11:52:20.980 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-15T11:52:20.989 DEBUG:teuthology.orchestra.console.smithi135:power off output: Chassis Power Control: Down/Off 2023-10-15T11:52:20.989 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-15T11:52:21.004 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2023-10-15T11:52:21.012 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2023-10-15T11:52:25.008 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-15T11:52:25.014 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-15T11:52:25.116 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2023-10-15T11:52:25.122 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2023-10-15T11:52:29.121 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-15T11:52:29.130 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-15T11:52:29.232 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2023-10-15T11:52:29.238 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2023-10-15T11:52:29.339 INFO:teuthology.orchestra.console.smithi135:Power off completed 2023-10-15T11:52:29.439 INFO:teuthology.orchestra.console.smithi135:Power on 2023-10-15T11:52:29.440 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-15T11:52:29.460 DEBUG:teuthology.orchestra.console.smithi135:power on output: Chassis Power Control: Up/On 2023-10-15T11:52:29.461 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-15T11:52:29.480 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2023-10-15T11:52:33.234 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-15T11:52:33.342 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2023-10-15T11:52:33.443 INFO:teuthology.orchestra.console.smithi098:Power off completed 2023-10-15T11:52:33.481 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-15T11:52:33.544 INFO:teuthology.orchestra.console.smithi098:Power on 2023-10-15T11:52:33.545 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-15T11:52:33.564 DEBUG:teuthology.orchestra.console.smithi098:power on output: Chassis Power Control: Up/On 2023-10-15T11:52:33.564 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-15T11:52:33.584 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2023-10-15T11:52:33.589 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2023-10-15T11:52:37.586 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-15T11:52:37.593 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-15T11:52:37.695 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2023-10-15T11:52:37.719 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2023-10-15T11:52:37.820 INFO:teuthology.orchestra.console.smithi135:Power on completed 2023-10-15T11:52:37.921 INFO:teuthology.provision.fog.smithi135:Waiting for deploy to finish 2023-10-15T11:52:37.921 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-10-15T11:52:41.697 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-15T11:52:41.806 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2023-10-15T11:52:41.907 INFO:teuthology.orchestra.console.smithi098:Power on completed 2023-10-15T11:52:42.008 INFO:teuthology.provision.fog.smithi098:Waiting for deploy to finish 2023-10-15T11:52:42.008 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-15T11:52:52.990 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-10-15T11:52:57.078 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-15T11:53:08.059 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-10-15T11:53:12.154 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-15T11:53:23.130 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-10-15T11:53:27.230 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-15T11:53:38.214 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-10-15T11:53:42.306 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-15T11:53:53.290 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-10-15T11:53:57.386 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-15T11:54:08.374 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-10-15T11:54:12.458 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-15T11:54:23.458 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-10-15T11:54:27.522 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-15T11:54:38.538 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-10-15T11:54:42.602 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-15T11:54:53.634 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-10-15T11:54:57.674 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-15T11:55:08.714 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-10-15T11:55:12.738 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-15T11:55:23.786 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-10-15T11:55:27.796 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-15T11:55:38.918 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-10-15T11:55:42.874 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-15T11:55:53.994 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-10-15T11:55:54.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-15T11:55:57.940 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-15T11:55:57.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-15T11:56:12.542 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-10-15T11:56:16.378 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-10-15T11:56:18.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-15T11:56:21.630 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-10-15T11:56:22.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-15T11:56:25.434 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-10-15T11:56:27.634 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-15T11:56:30.718 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-10-15T11:56:31.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-15T11:56:34.526 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-10-15T11:56:36.722 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-15T11:56:39.806 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-10-15T11:56:40.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-15T11:56:43.582 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-10-15T11:56:45.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-15T11:56:49.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-15T11:57:21.151 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-10-15T11:57:27.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-15T11:57:27.159 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-10-15T11:57:33.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-15T11:57:33.167 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-10-15T11:57:39.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-15T11:57:39.172 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-10-15T11:57:45.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-15T11:57:45.180 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-10-15T11:57:45.813 WARNING:teuthology.provision.fog.smithi135:timed out 2023-10-15T11:57:51.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-15T11:57:51.493 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-15T11:57:51.497 DEBUG:teuthology.orchestra.run.smithi098:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-15T11:57:51.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-15T11:57:51.972 INFO:teuthology.provision.fog.smithi098:Node is ready 2023-10-15T11:57:51.972 DEBUG:teuthology.orchestra.run.smithi098:> hostname 2023-10-15T11:57:52.014 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-15T11:57:52.014 DEBUG:teuthology.orchestra.run.smithi135:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-15T11:57:52.017 INFO:teuthology.orchestra.run.smithi098.stdout:smithi098.front.sepia.ceph.com 2023-10-15T11:57:52.018 DEBUG:teuthology.orchestra.run.smithi098:> grep smithi098.front.sepia.ceph.com /etc/hosts 2023-10-15T11:57:52.066 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98 smithi098.front.sepia.ceph.com smithi098 2023-10-15T11:57:52.066 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098 2023-10-15T11:57:52.179 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hosts 2023-10-15T11:57:52.194 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/172.21.15.98/172.21.15.98/g' /etc/hosts 2023-10-15T11:57:52.253 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hostname 2023-10-15T11:57:52.310 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098 2023-10-15T11:57:52.368 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2023-10-15T11:57:52.417 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-15T11:57:52.418 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="Ubuntu" 2023-10-15T11:57:52.418 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="22.04" 2023-10-15T11:57:52.418 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-15T11:57:52.418 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_CODENAME=jammy 2023-10-15T11:57:52.419 INFO:teuthology.orchestra.run.smithi098.stdout:ID=ubuntu 2023-10-15T11:57:52.419 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE=debian 2023-10-15T11:57:52.419 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-15T11:57:52.419 INFO:teuthology.orchestra.run.smithi098.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-15T11:57:52.420 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-15T11:57:52.420 INFO:teuthology.orchestra.run.smithi098.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-15T11:57:52.420 INFO:teuthology.orchestra.run.smithi098.stdout:UBUNTU_CODENAME=jammy 2023-10-15T11:57:52.421 INFO:teuthology.provision.fog.smithi098:Deploy complete! 2023-10-15T11:57:52.422 DEBUG:teuthology.parallel:result is None 2023-10-15T11:57:52.485 INFO:teuthology.provision.fog.smithi135:Node is ready 2023-10-15T11:57:52.485 DEBUG:teuthology.orchestra.run.smithi135:> hostname 2023-10-15T11:57:52.533 INFO:teuthology.orchestra.run.smithi135.stdout:smithi135.front.sepia.ceph.com 2023-10-15T11:57:52.533 DEBUG:teuthology.orchestra.run.smithi135:> grep smithi135.front.sepia.ceph.com /etc/hosts 2023-10-15T11:57:52.581 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135 smithi135.front.sepia.ceph.com smithi135 2023-10-15T11:57:52.582 DEBUG:teuthology.orchestra.run.smithi135:> sudo hostname smithi135 2023-10-15T11:57:52.741 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/smithi135.front.sepia.ceph.com/smithi135/g' /etc/hosts 2023-10-15T11:57:52.756 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/172.21.15.135/172.21.15.135/g' /etc/hosts 2023-10-15T11:57:52.810 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/smithi135.front.sepia.ceph.com/smithi135/g' /etc/hostname 2023-10-15T11:57:52.864 DEBUG:teuthology.orchestra.run.smithi135:> sudo hostname smithi135 2023-10-15T11:57:52.921 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2023-10-15T11:57:52.969 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-15T11:57:52.969 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="Ubuntu" 2023-10-15T11:57:52.970 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="22.04" 2023-10-15T11:57:52.970 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-15T11:57:52.970 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_CODENAME=jammy 2023-10-15T11:57:52.970 INFO:teuthology.orchestra.run.smithi135.stdout:ID=ubuntu 2023-10-15T11:57:52.970 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE=debian 2023-10-15T11:57:52.971 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-15T11:57:52.971 INFO:teuthology.orchestra.run.smithi135.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-15T11:57:52.971 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-15T11:57:52.971 INFO:teuthology.orchestra.run.smithi135.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-15T11:57:52.971 INFO:teuthology.orchestra.run.smithi135.stdout:UBUNTU_CODENAME=jammy 2023-10-15T11:57:52.972 INFO:teuthology.provision.fog.smithi135:Deploy complete! 2023-10-15T11:57:52.972 DEBUG:teuthology.parallel:result is None 2023-10-15T11:57:53.151 INFO:teuthology.lock.ops:Checking smithi098.front.sepia.ceph.com 2023-10-15T11:57:53.152 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-15T11:57:53.175 INFO:teuthology.lock.ops:Checking smithi135.front.sepia.ceph.com 2023-10-15T11:57:53.175 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-15T11:57:53.192 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: set os type and version on server 2023-10-15T11:57:53.193 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-10-15T11:57:53.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-15T11:57:53.262 DEBUG:teuthology.orchestra.run.smithi098:> true 2023-10-15T11:57:53.370 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-10-15T11:57:53.371 DEBUG:teuthology.orchestra.run.smithi098:> uname -m 2023-10-15T11:57:53.417 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2023-10-15T11:57:53.418 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2023-10-15T11:57:53.466 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-15T11:57:53.466 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="Ubuntu" 2023-10-15T11:57:53.466 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="22.04" 2023-10-15T11:57:53.466 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-15T11:57:53.467 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_CODENAME=jammy 2023-10-15T11:57:53.467 INFO:teuthology.orchestra.run.smithi098.stdout:ID=ubuntu 2023-10-15T11:57:53.467 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE=debian 2023-10-15T11:57:53.467 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-15T11:57:53.467 INFO:teuthology.orchestra.run.smithi098.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-15T11:57:53.468 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-15T11:57:53.468 INFO:teuthology.orchestra.run.smithi098.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-15T11:57:53.468 INFO:teuthology.orchestra.run.smithi098.stdout:UBUNTU_CODENAME=jammy 2023-10-15T11:57:53.468 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2023-10-15T11:57:53.491 INFO:teuthology.lock.ops:Updating [smithi135.front.sepia.ceph.com]: set os type and version on server 2023-10-15T11:57:53.492 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-10-15T11:57:53.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-15T11:57:53.566 DEBUG:teuthology.orchestra.run.smithi135:> true 2023-10-15T11:57:53.673 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-10-15T11:57:53.674 DEBUG:teuthology.orchestra.run.smithi135:> uname -m 2023-10-15T11:57:53.721 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64 2023-10-15T11:57:53.721 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2023-10-15T11:57:53.769 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-15T11:57:53.769 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="Ubuntu" 2023-10-15T11:57:53.769 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="22.04" 2023-10-15T11:57:53.770 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-15T11:57:53.770 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_CODENAME=jammy 2023-10-15T11:57:53.770 INFO:teuthology.orchestra.run.smithi135.stdout:ID=ubuntu 2023-10-15T11:57:53.770 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE=debian 2023-10-15T11:57:53.770 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-15T11:57:53.771 INFO:teuthology.orchestra.run.smithi135.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-15T11:57:53.771 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-15T11:57:53.771 INFO:teuthology.orchestra.run.smithi135.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-15T11:57:53.771 INFO:teuthology.orchestra.run.smithi135.stdout:UBUNTU_CODENAME=jammy 2023-10-15T11:57:53.772 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2023-10-15T11:57:53.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-15T11:57:53.879 INFO:teuthology.dispatcher.supervisor:Running job 7426725 2023-10-15T11:57:53.879 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/bin/teuthology -v --owner scheduled_lflores@teuthology --archive /home/teuthworker/archive/lflores-2023-10-13_22:31:48-fs-main-distro-default-smithi/7426725 --name lflores-2023-10-13_22:31:48-fs-main-distro-default-smithi --description fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} kclient-overrides/{distro/testing/k-testing ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_untarbuild_blogbench} -- /home/teuthworker/archive/lflores-2023-10-13_22:31:48-fs-main-distro-default-smithi/7426725/orig.config.yaml 2023-10-15T11:57:53.882 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/lflores-2023-10-13_22:31:48-fs-main-distro-default-smithi/7426725 2023-10-15T11:57:53.885 INFO:teuthology.dispatcher.supervisor:Job PID: 3128471 2023-10-15T11:57:53.885 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-15T11:59:53.982 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-15T12:01:54.144 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-15T12:03:54.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-15T12:05:54.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-15T12:07:54.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-15T12:09:54.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-15T12:11:55.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-15T12:13:55.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-15T12:15:55.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-15T12:17:55.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-15T12:19:55.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-15T12:21:55.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-15T12:23:56.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-15T12:25:56.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-15T12:27:56.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-15T12:29:56.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-15T12:31:56.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-15T12:31:56.760 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-15T12:31:56.990 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-15T12:31:56.991 INFO:teuthology.nuke:Checking targets against current locks 2023-10-15T12:31:57.039 DEBUG:teuthology.nuke:shortname: smithi098 2023-10-15T12:31:57.039 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-15T12:31:57.058 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2023-10-13_22:31:48-fs-main-distro-default-smithi/7426725', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-15 11:52:19.558179', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEWLqd1uTw/LZqBjWvlgTN/3whilt/qMIsSACF35po+H8PK30AFyfbA//pyKTT/TBE2yqI2vHGuEzUafCKcddOM='} 2023-10-15T12:31:57.062 DEBUG:teuthology.nuke:shortname: smithi135 2023-10-15T12:31:57.062 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-15T12:31:57.087 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi135.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2023-10-13_22:31:48-fs-main-distro-default-smithi/7426725', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-15 11:52:19.560544', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJnUCkNZdHlZu9uVkyTGR6QDkP6RA1PM2/pp2oy/WQV9moFw++wuT4+9fEAwvVu6rt6JaqyRTy58RfSNiMvtK2I='} 2023-10-15T12:31:57.116 INFO:teuthology.orchestra.console.smithi098:Power off 2023-10-15T12:31:57.117 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-15T12:31:57.138 DEBUG:teuthology.orchestra.console.smithi098:power off output: Chassis Power Control: Down/Off 2023-10-15T12:31:57.139 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-15T12:31:57.154 INFO:teuthology.orchestra.console.smithi135:Power off 2023-10-15T12:31:57.154 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-15T12:31:57.164 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2023-10-15T12:31:57.177 DEBUG:teuthology.orchestra.console.smithi135:power off output: Chassis Power Control: Down/Off 2023-10-15T12:31:57.177 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-15T12:31:57.199 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2023-10-15T12:31:57.266 INFO:teuthology.orchestra.console.smithi098:Power off completed 2023-10-15T12:31:57.300 INFO:teuthology.orchestra.console.smithi135:Power off completed 2023-10-15T12:31:57.449 INFO:teuthology.lock.ops:unlocked: smithi135.front.sepia.ceph.com 2023-10-15T12:31:57.450 INFO:teuthology.lock.ops:unlocked: smithi098.front.sepia.ceph.com