2023-08-21T10:31:47.819 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-21T10:31:47.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T10:31:47.939 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7effd0f77f70>, signals=[15]) 2023-08-21T10:31:47.940 INFO:teuthology.lock.ops:Start node 'smithi037.front.sepia.ceph.com' reimaging 2023-08-21T10:31:47.940 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: reset os type and version on server 2023-08-21T10:31:47.941 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2023-08-21T10:31:47.962 INFO:teuthology.lock.ops:Start node 'smithi104.front.sepia.ceph.com' reimaging 2023-08-21T10:31:47.962 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: reset os type and version on server 2023-08-21T10:31:47.962 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2023-08-21T10:31:47.963 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /host {"name": "smithi037"} 2023-08-21T10:31:47.978 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /host {"name": "smithi104"} 2023-08-21T10:31:48.035 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-08-21T10:31:48.040 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-08-21T10:31:48.077 DEBUG:teuthology.provision.fog.smithi037:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-08-21T10:31:48.078 DEBUG:teuthology.provision.fog.smithi037:FOG request: PUT /host/142 {"imageID": 6} 2023-08-21T10:31:48.080 DEBUG:teuthology.provision.fog.smithi104:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-08-21T10:31:48.080 DEBUG:teuthology.provision.fog.smithi104:FOG request: PUT /host/209 {"imageID": 6} 2023-08-21T10:31:48.118 INFO:teuthology.provision.fog.smithi104:Scheduling deploy of ubuntu 22.04 2023-08-21T10:31:48.118 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-21T10:31:48.120 INFO:teuthology.provision.fog.smithi037:Scheduling deploy of ubuntu 22.04 2023-08-21T10:31:48.121 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-08-21T10:31:48.163 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /tasktype {"name": "deploy"} 2023-08-21T10:31:48.166 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /tasktype {"name": "deploy"} 2023-08-21T10:31:48.198 DEBUG:teuthology.provision.fog.smithi104:FOG request: POST /host/209/task {"taskTypeID": 1} 2023-08-21T10:31:48.201 DEBUG:teuthology.provision.fog.smithi037:FOG request: POST /host/142/task {"taskTypeID": 1} 2023-08-21T10:31:48.242 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-21T10:31:48.249 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-08-21T10:31:48.342 INFO:teuthology.orchestra.console.smithi104:Power off 2023-08-21T10:31:48.343 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-21T10:31:48.357 INFO:teuthology.orchestra.console.smithi037:Power off 2023-08-21T10:31:48.358 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-21T10:31:48.367 DEBUG:teuthology.orchestra.console.smithi104:power off output: Chassis Power Control: Down/Off 2023-08-21T10:31:48.368 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T10:31:48.379 DEBUG:teuthology.orchestra.console.smithi037:power off output: Chassis Power Control: Down/Off 2023-08-21T10:31:48.380 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T10:31:48.389 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off 2023-08-21T10:31:48.399 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2023-08-21T10:31:48.491 INFO:teuthology.orchestra.console.smithi104:Power off completed 2023-08-21T10:31:48.592 INFO:teuthology.orchestra.console.smithi104:Power on 2023-08-21T10:31:48.592 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-21T10:31:48.612 DEBUG:teuthology.orchestra.console.smithi104:power on output: Chassis Power Control: Up/On 2023-08-21T10:31:48.613 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T10:31:48.634 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off 2023-08-21T10:31:52.404 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T10:31:52.513 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2023-08-21T10:31:52.635 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T10:31:52.743 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on 2023-08-21T10:31:52.844 INFO:teuthology.orchestra.console.smithi104:Power on completed 2023-08-21T10:31:52.945 INFO:teuthology.provision.fog.smithi104:Waiting for deploy to finish 2023-08-21T10:31:52.945 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-21T10:31:56.518 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T10:31:56.627 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off 2023-08-21T10:31:56.727 INFO:teuthology.orchestra.console.smithi037:Power off completed 2023-08-21T10:31:56.828 INFO:teuthology.orchestra.console.smithi037:Power on 2023-08-21T10:31:56.828 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-21T10:31:56.848 DEBUG:teuthology.orchestra.console.smithi037:power on output: Chassis Power Control: Up/On 2023-08-21T10:31:56.848 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T10:31:56.869 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off 2023-08-21T10:32:00.873 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T10:32:00.982 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off 2023-08-21T10:32:04.987 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T10:32:05.096 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2023-08-21T10:32:05.197 INFO:teuthology.orchestra.console.smithi037:Power on completed 2023-08-21T10:32:05.298 INFO:teuthology.provision.fog.smithi037:Waiting for deploy to finish 2023-08-21T10:32:05.299 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-08-21T10:32:08.020 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-21T10:32:20.391 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-08-21T10:32:23.090 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-21T10:32:35.466 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-08-21T10:32:38.154 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-21T10:32:50.535 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-08-21T10:32:53.226 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-21T10:33:05.615 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-08-21T10:33:08.292 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-21T10:33:20.694 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-08-21T10:33:23.362 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-21T10:33:35.764 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-08-21T10:33:38.424 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-21T10:33:50.844 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-08-21T10:33:53.496 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-21T10:34:05.941 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-08-21T10:34:08.585 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-21T10:34:21.020 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-08-21T10:34:23.652 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-21T10:34:36.104 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-08-21T10:34:38.724 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-21T10:34:51.171 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-08-21T10:34:51.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T10:34:51.323 ERROR:teuthology.orchestra.connection:Error authenticating with smithi037.front.sepia.ceph.com: Authentication failed. 2023-08-21T10:34:51.325 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-21T10:34:51.325 DEBUG:teuthology.orchestra.run.smithi037:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-21T10:34:51.326 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-21T10:34:52.330 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-21T10:34:53.333 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-21T10:34:53.789 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-21T10:34:54.336 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-21T10:35:08.840 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-21T10:35:08.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T10:35:27.216 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-08-21T10:35:33.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T10:35:36.272 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-08-21T10:35:42.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T10:35:45.328 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-08-21T10:35:51.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T10:35:54.384 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-08-21T10:36:00.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T10:36:43.504 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-08-21T10:36:43.505 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi037 2023-08-21T10:36:52.515 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-08-21T10:36:52.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T10:36:52.517 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-08-21T10:37:00.389 WARNING:teuthology.provision.fog.smithi104:timed out 2023-08-21T10:37:01.519 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-08-21T10:37:01.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T10:37:06.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T10:37:06.594 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-21T10:37:06.595 DEBUG:teuthology.orchestra.run.smithi104:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-21T10:37:07.044 INFO:teuthology.provision.fog.smithi104:Node is ready 2023-08-21T10:37:07.045 DEBUG:teuthology.orchestra.run.smithi104:> hostname 2023-08-21T10:37:07.092 INFO:teuthology.orchestra.run.smithi104.stdout:smithi104.front.sepia.ceph.com 2023-08-21T10:37:07.092 DEBUG:teuthology.orchestra.run.smithi104:> grep smithi104.front.sepia.ceph.com /etc/hosts 2023-08-21T10:37:07.140 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.15.104 smithi104.front.sepia.ceph.com smithi104 2023-08-21T10:37:07.140 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104 2023-08-21T10:37:07.290 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104.front.sepia.ceph.com/smithi104/g' /etc/hosts 2023-08-21T10:37:07.304 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/172.21.15.104/172.21.15.104/g' /etc/hosts 2023-08-21T10:37:07.360 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104.front.sepia.ceph.com/smithi104/g' /etc/hostname 2023-08-21T10:37:07.416 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104 2023-08-21T10:37:07.475 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release 2023-08-21T10:37:07.524 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-21T10:37:07.524 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="Ubuntu" 2023-08-21T10:37:07.524 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="22.04" 2023-08-21T10:37:07.524 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-21T10:37:07.524 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_CODENAME=jammy 2023-08-21T10:37:07.525 INFO:teuthology.orchestra.run.smithi104.stdout:ID=ubuntu 2023-08-21T10:37:07.525 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE=debian 2023-08-21T10:37:07.525 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-21T10:37:07.525 INFO:teuthology.orchestra.run.smithi104.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-21T10:37:07.525 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-21T10:37:07.525 INFO:teuthology.orchestra.run.smithi104.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-21T10:37:07.525 INFO:teuthology.orchestra.run.smithi104.stdout:UBUNTU_CODENAME=jammy 2023-08-21T10:37:07.526 INFO:teuthology.provision.fog.smithi104:Deploy complete! 2023-08-21T10:37:07.527 DEBUG:teuthology.parallel:result is None 2023-08-21T10:37:16.972 DEBUG:teuthology.orchestra.run.smithi037:> true 2023-08-21T10:37:17.450 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-08-21T10:37:17.451 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-21T10:37:17.451 DEBUG:teuthology.orchestra.run.smithi037:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-21T10:37:17.495 INFO:teuthology.provision.fog.smithi037:Node is ready 2023-08-21T10:37:17.496 DEBUG:teuthology.orchestra.run.smithi037:> hostname 2023-08-21T10:37:17.544 INFO:teuthology.orchestra.run.smithi037.stdout:smithi037.front.sepia.ceph.com 2023-08-21T10:37:17.545 DEBUG:teuthology.orchestra.run.smithi037:> grep smithi037.front.sepia.ceph.com /etc/hosts 2023-08-21T10:37:17.592 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37 smithi037.front.sepia.ceph.com smithi037 2023-08-21T10:37:17.593 DEBUG:teuthology.orchestra.run.smithi037:> sudo hostname smithi037 2023-08-21T10:37:17.733 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/smithi037.front.sepia.ceph.com/smithi037/g' /etc/hosts 2023-08-21T10:37:17.748 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/172.21.15.37/172.21.15.37/g' /etc/hosts 2023-08-21T10:37:17.807 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/smithi037.front.sepia.ceph.com/smithi037/g' /etc/hostname 2023-08-21T10:37:17.863 DEBUG:teuthology.orchestra.run.smithi037:> sudo hostname smithi037 2023-08-21T10:37:17.919 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2023-08-21T10:37:17.967 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-21T10:37:17.968 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="Ubuntu" 2023-08-21T10:37:17.968 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="22.04" 2023-08-21T10:37:17.968 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-21T10:37:17.968 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_CODENAME=jammy 2023-08-21T10:37:17.968 INFO:teuthology.orchestra.run.smithi037.stdout:ID=ubuntu 2023-08-21T10:37:17.968 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE=debian 2023-08-21T10:37:17.969 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-21T10:37:17.969 INFO:teuthology.orchestra.run.smithi037.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-21T10:37:17.969 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-21T10:37:17.969 INFO:teuthology.orchestra.run.smithi037.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-21T10:37:17.969 INFO:teuthology.orchestra.run.smithi037.stdout:UBUNTU_CODENAME=jammy 2023-08-21T10:37:17.969 INFO:teuthology.provision.fog.smithi037:Deploy complete! 2023-08-21T10:37:17.970 DEBUG:teuthology.parallel:result is None 2023-08-21T10:37:18.115 INFO:teuthology.lock.ops:Checking smithi037.front.sepia.ceph.com 2023-08-21T10:37:18.116 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-21T10:37:18.141 INFO:teuthology.lock.ops:Checking smithi104.front.sepia.ceph.com 2023-08-21T10:37:18.141 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-21T10:37:18.158 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: set os type and version on server 2023-08-21T10:37:18.159 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-08-21T10:37:18.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T10:37:18.237 DEBUG:teuthology.orchestra.run.smithi037:> true 2023-08-21T10:37:18.336 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-08-21T10:37:18.336 DEBUG:teuthology.orchestra.run.smithi037:> uname -m 2023-08-21T10:37:18.383 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2023-08-21T10:37:18.384 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2023-08-21T10:37:18.430 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-21T10:37:18.431 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="Ubuntu" 2023-08-21T10:37:18.431 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="22.04" 2023-08-21T10:37:18.432 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-21T10:37:18.432 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_CODENAME=jammy 2023-08-21T10:37:18.432 INFO:teuthology.orchestra.run.smithi037.stdout:ID=ubuntu 2023-08-21T10:37:18.432 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE=debian 2023-08-21T10:37:18.433 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-21T10:37:18.433 INFO:teuthology.orchestra.run.smithi037.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-21T10:37:18.433 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-21T10:37:18.433 INFO:teuthology.orchestra.run.smithi037.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-21T10:37:18.434 INFO:teuthology.orchestra.run.smithi037.stdout:UBUNTU_CODENAME=jammy 2023-08-21T10:37:18.434 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2023-08-21T10:37:18.474 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: set os type and version on server 2023-08-21T10:37:18.475 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2023-08-21T10:37:18.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T10:37:18.550 DEBUG:teuthology.orchestra.run.smithi104:> true 2023-08-21T10:37:18.659 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com' 2023-08-21T10:37:18.660 DEBUG:teuthology.orchestra.run.smithi104:> uname -m 2023-08-21T10:37:18.708 INFO:teuthology.orchestra.run.smithi104.stdout:x86_64 2023-08-21T10:37:18.708 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release 2023-08-21T10:37:18.756 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-21T10:37:18.756 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="Ubuntu" 2023-08-21T10:37:18.756 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="22.04" 2023-08-21T10:37:18.756 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-21T10:37:18.756 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_CODENAME=jammy 2023-08-21T10:37:18.757 INFO:teuthology.orchestra.run.smithi104.stdout:ID=ubuntu 2023-08-21T10:37:18.757 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE=debian 2023-08-21T10:37:18.757 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-21T10:37:18.757 INFO:teuthology.orchestra.run.smithi104.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-21T10:37:18.757 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-21T10:37:18.757 INFO:teuthology.orchestra.run.smithi104.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-21T10:37:18.757 INFO:teuthology.orchestra.run.smithi104.stdout:UBUNTU_CODENAME=jammy 2023-08-21T10:37:18.758 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2023-08-21T10:37:18.774 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T10:37:18.865 INFO:teuthology.dispatcher.supervisor:Running job 7373996 2023-08-21T10:37:18.865 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner mchangir --archive /home/teuthworker/archive/mchangir-2023-08-21_10:31:14-fs-wip-mchangir-mgr-snap_schedule-make-fs-argument-mandatory-distro-default-smithi/7373996 --name mchangir-2023-08-21_10:31:14-fs-wip-mchangir-mgr-snap_schedule-make-fs-argument-mandatory-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} -- /home/teuthworker/archive/mchangir-2023-08-21_10:31:14-fs-wip-mchangir-mgr-snap_schedule-make-fs-argument-mandatory-distro-default-smithi/7373996/orig.config.yaml 2023-08-21T10:37:18.868 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mchangir-2023-08-21_10:31:14-fs-wip-mchangir-mgr-snap_schedule-make-fs-argument-mandatory-distro-default-smithi/7373996 2023-08-21T10:37:18.869 INFO:teuthology.dispatcher.supervisor:Job PID: 20491 2023-08-21T10:37:18.869 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-21T10:39:18.929 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T10:41:19.080 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T10:43:19.244 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T10:45:19.401 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T10:47:19.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T10:49:19.612 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T10:51:19.758 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T10:53:19.862 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T10:55:19.976 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T10:57:20.120 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T10:59:20.189 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T11:01:20.281 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T11:03:20.342 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T11:05:20.505 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T11:07:20.678 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T11:09:20.848 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T11:11:21.096 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T11:13:21.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T11:15:21.246 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T11:17:21.314 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T11:19:21.448 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T11:21:21.600 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T11:23:21.677 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T11:25:21.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T11:27:22.013 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T11:29:22.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T11:31:22.245 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T11:33:22.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T11:35:22.650 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T11:37:22.793 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T11:39:22.941 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T11:41:23.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T11:43:23.209 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T11:45:23.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T11:47:23.398 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T11:49:23.605 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T11:51:23.745 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T11:53:23.913 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T11:55:24.080 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T11:57:24.243 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T11:59:24.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T12:01:24.429 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T12:03:24.590 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T12:05:24.754 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T12:07:24.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T12:09:24.960 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T12:11:25.126 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T12:13:25.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T12:15:25.341 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T12:17:25.577 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T12:19:25.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T12:21:26.061 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T12:23:26.188 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T12:25:26.349 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T12:27:26.513 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T12:29:26.677 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T12:31:26.841 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T12:31:26.906 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-21T12:31:27.052 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-21T12:31:27.052 INFO:teuthology.nuke:Checking targets against current locks 2023-08-21T12:31:27.097 DEBUG:teuthology.nuke:shortname: smithi037 2023-08-21T12:31:27.098 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-21T12:31:27.124 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-08-21_10:31:14-fs-wip-mchangir-mgr-snap_schedule-make-fs-argument-mandatory-distro-default-smithi/7373996', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-21 10:31:47.035930', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIK2zD5O/tCsBUVf4lb9Gb1EEFsm2xjHV9ofC+Gb7wD3u'} 2023-08-21T12:31:27.125 DEBUG:teuthology.nuke:shortname: smithi104 2023-08-21T12:31:27.126 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-21T12:31:27.148 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi104.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-08-21_10:31:14-fs-wip-mchangir-mgr-snap_schedule-make-fs-argument-mandatory-distro-default-smithi/7373996', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-21 10:31:47.034230', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBACoil1ZqZ+T7OSIBwHN0DHLAwneSAEN/thGmHehxcNHCEL+AGbantdRbItfJxCeWglUBWROoJ64I8Yph6KBSKY='} 2023-08-21T12:31:27.173 INFO:teuthology.orchestra.console.smithi037:Power off 2023-08-21T12:31:27.173 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-21T12:31:27.194 DEBUG:teuthology.orchestra.console.smithi037:power off output: Chassis Power Control: Down/Off 2023-08-21T12:31:27.194 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T12:31:27.206 INFO:teuthology.orchestra.console.smithi104:Power off 2023-08-21T12:31:27.207 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-21T12:31:27.226 DEBUG:teuthology.orchestra.console.smithi104:power off output: Chassis Power Control: Down/Off 2023-08-21T12:31:27.226 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T12:31:27.234 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off 2023-08-21T12:31:27.244 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off 2023-08-21T12:31:27.336 INFO:teuthology.orchestra.console.smithi037:Power off completed 2023-08-21T12:31:27.346 INFO:teuthology.orchestra.console.smithi104:Power off completed 2023-08-21T12:31:27.490 INFO:teuthology.lock.ops:unlocked: smithi037.front.sepia.ceph.com 2023-08-21T12:31:27.499 INFO:teuthology.lock.ops:unlocked: smithi104.front.sepia.ceph.com