2023-11-08T19:06:54.585 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-08T19:06:54.586 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T19:06:54.731 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fcd20c4bca0>, signals=[15]) 2023-11-08T19:06:54.733 INFO:teuthology.lock.ops:Start node 'smithi121.front.sepia.ceph.com' reimaging 2023-11-08T19:06:54.733 INFO:teuthology.lock.ops:Updating [smithi121.front.sepia.ceph.com]: reset os type and version on server 2023-11-08T19:06:54.733 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2023-11-08T19:06:54.760 INFO:teuthology.lock.ops:Start node 'smithi133.front.sepia.ceph.com' reimaging 2023-11-08T19:06:54.760 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: reset os type and version on server 2023-11-08T19:06:54.761 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2023-11-08T19:06:54.762 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /host {"name": "smithi121"} 2023-11-08T19:06:54.785 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /host {"name": "smithi133"} 2023-11-08T19:06:54.839 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-11-08T19:06:54.856 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-11-08T19:06:54.880 DEBUG:teuthology.provision.fog.smithi121:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-11-08T19:06:54.880 DEBUG:teuthology.provision.fog.smithi121:FOG request: PUT /host/226 {"imageID": 6} 2023-11-08T19:06:54.900 DEBUG:teuthology.provision.fog.smithi133:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-11-08T19:06:54.901 DEBUG:teuthology.provision.fog.smithi133:FOG request: PUT /host/238 {"imageID": 6} 2023-11-08T19:06:54.926 INFO:teuthology.provision.fog.smithi121:Scheduling deploy of ubuntu 22.04 2023-11-08T19:06:54.926 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-11-08T19:06:54.952 INFO:teuthology.provision.fog.smithi133:Scheduling deploy of ubuntu 22.04 2023-11-08T19:06:54.952 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-08T19:06:54.984 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /tasktype {"name": "deploy"} 2023-11-08T19:06:55.011 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /tasktype {"name": "deploy"} 2023-11-08T19:06:55.019 DEBUG:teuthology.provision.fog.smithi121:FOG request: POST /host/226/task {"taskTypeID": 1} 2023-11-08T19:06:55.049 DEBUG:teuthology.provision.fog.smithi133:FOG request: POST /host/238/task {"taskTypeID": 1} 2023-11-08T19:06:55.074 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-11-08T19:06:55.121 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-08T19:06:55.183 INFO:teuthology.orchestra.console.smithi121:Power off 2023-11-08T19:06:55.184 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-08T19:06:55.206 DEBUG:teuthology.orchestra.console.smithi121:power off output: Chassis Power Control: Down/Off 2023-11-08T19:06:55.207 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T19:06:55.222 INFO:teuthology.orchestra.console.smithi133:Power off 2023-11-08T19:06:55.223 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-08T19:06:55.231 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is off 2023-11-08T19:06:55.244 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2023-11-08T19:06:55.244 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T19:06:55.264 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2023-11-08T19:06:55.332 INFO:teuthology.orchestra.console.smithi121:Power off completed 2023-11-08T19:06:55.366 INFO:teuthology.orchestra.console.smithi133:Power off completed 2023-11-08T19:06:55.434 INFO:teuthology.orchestra.console.smithi121:Power on 2023-11-08T19:06:55.434 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-08T19:06:55.459 DEBUG:teuthology.orchestra.console.smithi121:power on output: Chassis Power Control: Up/On 2023-11-08T19:06:55.460 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T19:06:55.467 INFO:teuthology.orchestra.console.smithi133:Power on 2023-11-08T19:06:55.467 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-08T19:06:55.482 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is off 2023-11-08T19:06:55.493 DEBUG:teuthology.orchestra.console.smithi133:power on output: Chassis Power Control: Up/On 2023-11-08T19:06:55.493 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T19:06:55.518 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2023-11-08T19:06:59.486 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T19:06:59.519 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T19:06:59.595 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is on 2023-11-08T19:06:59.629 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2023-11-08T19:06:59.697 INFO:teuthology.orchestra.console.smithi121:Power on completed 2023-11-08T19:06:59.730 INFO:teuthology.orchestra.console.smithi133:Power on completed 2023-11-08T19:06:59.798 INFO:teuthology.provision.fog.smithi121:Waiting for deploy to finish 2023-11-08T19:06:59.799 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-11-08T19:06:59.831 INFO:teuthology.provision.fog.smithi133:Waiting for deploy to finish 2023-11-08T19:06:59.832 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-08T19:07:14.893 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-11-08T19:07:14.896 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-08T19:07:29.986 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-08T19:07:29.988 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-11-08T19:07:45.094 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-11-08T19:07:45.096 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-08T19:08:00.182 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-11-08T19:08:00.185 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-08T19:08:15.270 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-11-08T19:08:15.272 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-08T19:08:30.346 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-11-08T19:08:30.348 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-08T19:08:45.426 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-08T19:08:45.428 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-11-08T19:09:00.502 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-11-08T19:09:00.504 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-08T19:09:15.590 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-08T19:09:15.592 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-11-08T19:09:30.675 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-08T19:09:30.677 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-11-08T19:09:45.750 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-11-08T19:09:45.752 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-08T19:10:00.830 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-08T19:10:00.832 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-11-08T19:10:15.910 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-11-08T19:10:15.912 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-11-08T19:10:15.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T19:10:15.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T19:10:19.034 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2023-11-08T19:10:19.035 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-11-08T19:10:25.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T19:10:25.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T19:10:28.122 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2023-11-08T19:10:28.123 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-11-08T19:10:34.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T19:10:34.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T19:10:37.178 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2023-11-08T19:10:37.210 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-11-08T19:10:43.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T19:10:43.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T19:10:46.266 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2023-11-08T19:10:46.267 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-11-08T19:10:52.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T19:10:52.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T19:10:55.322 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2023-11-08T19:10:55.326 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-11-08T19:11:01.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T19:11:01.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T19:11:04.378 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2023-11-08T19:11:04.413 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-11-08T19:11:10.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T19:11:10.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T19:11:13.442 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2023-11-08T19:11:19.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T19:11:50.907 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2023-11-08T19:11:56.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T19:11:56.914 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2023-11-08T19:12:02.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T19:12:02.923 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2023-11-08T19:12:08.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T19:12:08.933 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2023-11-08T19:12:10.418 WARNING:teuthology.provision.fog.smithi133:timed out 2023-11-08T19:12:14.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T19:12:14.944 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2023-11-08T19:12:16.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T19:12:16.646 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-08T19:12:16.647 DEBUG:teuthology.orchestra.run.smithi133:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-08T19:12:17.063 INFO:teuthology.provision.fog.smithi133:Node is ready 2023-11-08T19:12:17.063 DEBUG:teuthology.orchestra.run.smithi133:> hostname 2023-11-08T19:12:17.109 INFO:teuthology.orchestra.run.smithi133.stdout:smithi133.front.sepia.ceph.com 2023-11-08T19:12:17.110 DEBUG:teuthology.orchestra.run.smithi133:> grep smithi133.front.sepia.ceph.com /etc/hosts 2023-11-08T19:12:17.157 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.15.133 smithi133.front.sepia.ceph.com smithi133 2023-11-08T19:12:17.158 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133 2023-11-08T19:12:17.297 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hosts 2023-11-08T19:12:17.311 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/172.21.15.133/172.21.15.133/g' /etc/hosts 2023-11-08T19:12:17.369 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hostname 2023-11-08T19:12:17.426 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133 2023-11-08T19:12:17.481 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2023-11-08T19:12:17.529 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-08T19:12:17.529 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="Ubuntu" 2023-11-08T19:12:17.530 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="22.04" 2023-11-08T19:12:17.530 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-08T19:12:17.530 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_CODENAME=jammy 2023-11-08T19:12:17.530 INFO:teuthology.orchestra.run.smithi133.stdout:ID=ubuntu 2023-11-08T19:12:17.530 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE=debian 2023-11-08T19:12:17.531 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-08T19:12:17.531 INFO:teuthology.orchestra.run.smithi133.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-08T19:12:17.531 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-08T19:12:17.531 INFO:teuthology.orchestra.run.smithi133.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-08T19:12:17.531 INFO:teuthology.orchestra.run.smithi133.stdout:UBUNTU_CODENAME=jammy 2023-11-08T19:12:17.532 INFO:teuthology.provision.fog.smithi133:Deploy complete! 2023-11-08T19:12:17.534 DEBUG:teuthology.parallel:result is None 2023-11-08T19:12:20.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T19:12:21.136 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-08T19:12:21.136 DEBUG:teuthology.orchestra.run.smithi121:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-08T19:12:21.622 INFO:teuthology.provision.fog.smithi121:Node is ready 2023-11-08T19:12:21.622 DEBUG:teuthology.orchestra.run.smithi121:> hostname 2023-11-08T19:12:21.667 INFO:teuthology.orchestra.run.smithi121.stdout:smithi121.front.sepia.ceph.com 2023-11-08T19:12:21.668 DEBUG:teuthology.orchestra.run.smithi121:> grep smithi121.front.sepia.ceph.com /etc/hosts 2023-11-08T19:12:21.716 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121 smithi121.front.sepia.ceph.com smithi121 2023-11-08T19:12:21.716 DEBUG:teuthology.orchestra.run.smithi121:> sudo hostname smithi121 2023-11-08T19:12:21.855 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/smithi121.front.sepia.ceph.com/smithi121/g' /etc/hosts 2023-11-08T19:12:21.870 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/172.21.15.121/172.21.15.121/g' /etc/hosts 2023-11-08T19:12:21.928 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/smithi121.front.sepia.ceph.com/smithi121/g' /etc/hostname 2023-11-08T19:12:21.988 DEBUG:teuthology.orchestra.run.smithi121:> sudo hostname smithi121 2023-11-08T19:12:22.044 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release 2023-11-08T19:12:22.092 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-08T19:12:22.092 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="Ubuntu" 2023-11-08T19:12:22.093 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="22.04" 2023-11-08T19:12:22.093 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-08T19:12:22.093 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_CODENAME=jammy 2023-11-08T19:12:22.093 INFO:teuthology.orchestra.run.smithi121.stdout:ID=ubuntu 2023-11-08T19:12:22.093 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE=debian 2023-11-08T19:12:22.094 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-08T19:12:22.094 INFO:teuthology.orchestra.run.smithi121.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-08T19:12:22.094 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-08T19:12:22.094 INFO:teuthology.orchestra.run.smithi121.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-08T19:12:22.095 INFO:teuthology.orchestra.run.smithi121.stdout:UBUNTU_CODENAME=jammy 2023-11-08T19:12:22.095 INFO:teuthology.provision.fog.smithi121:Deploy complete! 2023-11-08T19:12:22.096 DEBUG:teuthology.parallel:result is None 2023-11-08T19:12:22.270 INFO:teuthology.lock.ops:Checking smithi121.front.sepia.ceph.com 2023-11-08T19:12:22.271 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-08T19:12:22.296 INFO:teuthology.lock.ops:Checking smithi133.front.sepia.ceph.com 2023-11-08T19:12:22.296 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-08T19:12:22.316 INFO:teuthology.lock.ops:Updating [smithi121.front.sepia.ceph.com]: set os type and version on server 2023-11-08T19:12:22.316 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2023-11-08T19:12:22.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T19:12:22.397 DEBUG:teuthology.orchestra.run.smithi121:> true 2023-11-08T19:12:22.498 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi121.front.sepia.ceph.com' 2023-11-08T19:12:22.498 DEBUG:teuthology.orchestra.run.smithi121:> uname -m 2023-11-08T19:12:22.543 INFO:teuthology.orchestra.run.smithi121.stdout:x86_64 2023-11-08T19:12:22.543 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release 2023-11-08T19:12:22.596 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-08T19:12:22.596 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="Ubuntu" 2023-11-08T19:12:22.596 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="22.04" 2023-11-08T19:12:22.597 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-08T19:12:22.597 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_CODENAME=jammy 2023-11-08T19:12:22.597 INFO:teuthology.orchestra.run.smithi121.stdout:ID=ubuntu 2023-11-08T19:12:22.597 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE=debian 2023-11-08T19:12:22.597 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-08T19:12:22.598 INFO:teuthology.orchestra.run.smithi121.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-08T19:12:22.598 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-08T19:12:22.598 INFO:teuthology.orchestra.run.smithi121.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-08T19:12:22.598 INFO:teuthology.orchestra.run.smithi121.stdout:UBUNTU_CODENAME=jammy 2023-11-08T19:12:22.599 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2023-11-08T19:12:22.621 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: set os type and version on server 2023-11-08T19:12:22.621 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-11-08T19:12:22.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T19:12:22.700 DEBUG:teuthology.orchestra.run.smithi133:> true 2023-11-08T19:12:22.814 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-11-08T19:12:22.814 DEBUG:teuthology.orchestra.run.smithi133:> uname -m 2023-11-08T19:12:22.860 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2023-11-08T19:12:22.861 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2023-11-08T19:12:22.909 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-08T19:12:22.910 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="Ubuntu" 2023-11-08T19:12:22.910 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="22.04" 2023-11-08T19:12:22.910 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-08T19:12:22.911 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_CODENAME=jammy 2023-11-08T19:12:22.911 INFO:teuthology.orchestra.run.smithi133.stdout:ID=ubuntu 2023-11-08T19:12:22.912 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE=debian 2023-11-08T19:12:22.912 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-08T19:12:22.912 INFO:teuthology.orchestra.run.smithi133.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-08T19:12:22.913 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-08T19:12:22.913 INFO:teuthology.orchestra.run.smithi133.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-08T19:12:22.913 INFO:teuthology.orchestra.run.smithi133.stdout:UBUNTU_CODENAME=jammy 2023-11-08T19:12:22.914 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2023-11-08T19:12:22.938 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T19:12:23.030 INFO:teuthology.dispatcher.supervisor:Running job 7452106 2023-11-08T19:12:23.030 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-11-08_19:01:12-fs:functional-main-distro-default-smithi/7452106 --name pdonnell-2023-11-08_19:01:12-fs:functional-main-distro-default-smithi --description fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots} -- /home/teuthworker/archive/pdonnell-2023-11-08_19:01:12-fs:functional-main-distro-default-smithi/7452106/orig.config.yaml 2023-11-08T19:12:23.034 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-11-08_19:01:12-fs:functional-main-distro-default-smithi/7452106 2023-11-08T19:12:23.034 INFO:teuthology.dispatcher.supervisor:Job PID: 3795813 2023-11-08T19:12:23.035 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-08T19:14:23.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T19:16:23.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T19:18:23.474 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T19:20:23.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T19:22:23.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T19:24:23.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T19:26:24.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T19:28:24.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T19:30:24.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T19:32:24.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T19:34:24.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T19:36:25.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T19:36:25.086 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-11-08T19:36:25.226 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-08T19:36:25.227 INFO:teuthology.nuke:Checking targets against current locks 2023-11-08T19:36:25.276 DEBUG:teuthology.nuke:shortname: smithi121 2023-11-08T19:36:25.277 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-08T19:36:25.299 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi121.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-11-08_19:01:12-fs:functional-main-distro-default-smithi/7452106', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-08 19:06:53.761008', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAWo6exuEIhbaMC7zSzcy7O3CiES9M1OS7TCQAKM1jkMMCNs0te2gmUcbGv1y9Qe7CReVOjUWr94wKJjKhe/4M0='} 2023-11-08T19:36:25.303 DEBUG:teuthology.nuke:shortname: smithi133 2023-11-08T19:36:25.303 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-08T19:36:25.324 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-11-08_19:01:12-fs:functional-main-distro-default-smithi/7452106', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-08 19:06:53.762795', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIfK9MBfKoruOHAPI/N6k8NRBJ88wf/9hIvt/lGs/mDuX+wCwTOab32cBLdSME2m05nmgp/2vLLjHrtnPOw27eI='} 2023-11-08T19:36:25.353 INFO:teuthology.orchestra.console.smithi121:Power off 2023-11-08T19:36:25.353 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-08T19:36:25.375 DEBUG:teuthology.orchestra.console.smithi121:power off output: Chassis Power Control: Down/Off 2023-11-08T19:36:25.376 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T19:36:25.392 INFO:teuthology.orchestra.console.smithi133:Power off 2023-11-08T19:36:25.392 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-08T19:36:25.401 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is off 2023-11-08T19:36:25.415 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2023-11-08T19:36:25.416 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T19:36:25.438 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2023-11-08T19:36:25.502 INFO:teuthology.orchestra.console.smithi121:Power off completed 2023-11-08T19:36:25.540 INFO:teuthology.orchestra.console.smithi133:Power off completed 2023-11-08T19:36:25.652 INFO:teuthology.lock.ops:unlocked: smithi121.front.sepia.ceph.com 2023-11-08T19:36:25.676 INFO:teuthology.lock.ops:unlocked: smithi133.front.sepia.ceph.com