2023-09-03T10:08:10.410 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556
2023-09-03T10:08:10.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-03T10:08:10.531 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7ff8b3572d00>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7ff8b4067670>, signals=[15])
2023-09-03T10:08:10.532 INFO:teuthology.lock.ops:Start node 'smithi044.front.sepia.ceph.com' reimaging
2023-09-03T10:08:10.533 INFO:teuthology.lock.ops:Updating [smithi044.front.sepia.ceph.com]: reset os type and version on server
2023-09-03T10:08:10.533 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server
2023-09-03T10:08:10.555 INFO:teuthology.lock.ops:Start node 'smithi158.front.sepia.ceph.com' reimaging
2023-09-03T10:08:10.556 INFO:teuthology.lock.ops:Updating [smithi158.front.sepia.ceph.com]: reset os type and version on server
2023-09-03T10:08:10.556 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server
2023-09-03T10:08:10.558 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /host {"name": "smithi044"}
2023-09-03T10:08:10.580 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /host {"name": "smithi158"}
2023-09-03T10:08:10.634 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /image {"name": "smithi_ubuntu_22.04"}
2023-09-03T10:08:10.642 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /image {"name": "smithi_ubuntu_22.04"}
2023-09-03T10:08:10.668 DEBUG:teuthology.provision.fog.smithi044:Requesting image smithi_ubuntu_22.04 (ID 6)
2023-09-03T10:08:10.669 DEBUG:teuthology.provision.fog.smithi044:FOG request: PUT /host/149 {"imageID": 6}
2023-09-03T10:08:10.682 DEBUG:teuthology.provision.fog.smithi158:Requesting image smithi_ubuntu_22.04 (ID 6)
2023-09-03T10:08:10.682 DEBUG:teuthology.provision.fog.smithi158:FOG request: PUT /host/263 {"imageID": 6}
2023-09-03T10:08:10.721 INFO:teuthology.provision.fog.smithi044:Scheduling deploy of ubuntu 22.04
2023-09-03T10:08:10.721 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None
2023-09-03T10:08:10.722 INFO:teuthology.provision.fog.smithi158:Scheduling deploy of ubuntu 22.04
2023-09-03T10:08:10.723 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-09-03T10:08:10.818 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /tasktype {"name": "deploy"}
2023-09-03T10:08:10.823 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /tasktype {"name": "deploy"}
2023-09-03T10:08:10.852 DEBUG:teuthology.provision.fog.smithi044:FOG request: POST /host/149/task {"taskTypeID": 1}
2023-09-03T10:08:10.858 DEBUG:teuthology.provision.fog.smithi158:FOG request: POST /host/263/task {"taskTypeID": 1}
2023-09-03T10:08:10.905 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None
2023-09-03T10:08:10.908 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-09-03T10:08:11.044 INFO:teuthology.orchestra.console.smithi158:Power off
2023-09-03T10:08:11.045 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-03T10:08:11.057 INFO:teuthology.orchestra.console.smithi044:Power off
2023-09-03T10:08:11.057 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-03T10:08:11.066 DEBUG:teuthology.orchestra.console.smithi158:power off output: Chassis Power Control: Down/Off
2023-09-03T10:08:11.066 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-03T10:08:11.079 DEBUG:teuthology.orchestra.console.smithi044:power off output: Chassis Power Control: Down/Off
2023-09-03T10:08:11.080 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-03T10:08:11.086 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is on
2023-09-03T10:08:11.100 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on
2023-09-03T10:08:15.091 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-03T10:08:15.101 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-03T10:08:15.200 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is on
2023-09-03T10:08:15.209 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on
2023-09-03T10:08:19.205 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-03T10:08:19.211 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-03T10:08:19.313 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is off
2023-09-03T10:08:19.318 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on
2023-09-03T10:08:19.414 INFO:teuthology.orchestra.console.smithi158:Power off completed
2023-09-03T10:08:19.515 INFO:teuthology.orchestra.console.smithi158:Power on
2023-09-03T10:08:19.515 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-03T10:08:19.535 DEBUG:teuthology.orchestra.console.smithi158:power on output: Chassis Power Control: Up/On
2023-09-03T10:08:19.535 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-03T10:08:19.554 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is off
2023-09-03T10:08:23.323 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-03T10:08:23.431 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off
2023-09-03T10:08:23.532 INFO:teuthology.orchestra.console.smithi044:Power off completed
2023-09-03T10:08:23.555 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-03T10:08:23.634 INFO:teuthology.orchestra.console.smithi044:Power on
2023-09-03T10:08:23.634 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-03T10:08:23.654 DEBUG:teuthology.orchestra.console.smithi044:power on output: Chassis Power Control: Up/On
2023-09-03T10:08:23.654 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-03T10:08:23.662 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is off
2023-09-03T10:08:23.673 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off
2023-09-03T10:08:27.667 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-03T10:08:27.674 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-03T10:08:27.782 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off
2023-09-03T10:08:27.888 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is on
2023-09-03T10:08:27.988 INFO:teuthology.orchestra.console.smithi158:Power on completed
2023-09-03T10:08:28.089 INFO:teuthology.provision.fog.smithi158:Waiting for deploy to finish
2023-09-03T10:08:28.089 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-09-03T10:08:31.787 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-03T10:08:31.895 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on
2023-09-03T10:08:31.996 INFO:teuthology.orchestra.console.smithi044:Power on completed
2023-09-03T10:08:32.096 INFO:teuthology.provision.fog.smithi044:Waiting for deploy to finish
2023-09-03T10:08:32.096 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None
2023-09-03T10:08:43.234 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-09-03T10:08:47.233 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None
2023-09-03T10:08:58.386 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-09-03T10:09:02.379 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None
2023-09-03T10:09:13.515 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-09-03T10:09:17.508 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None
2023-09-03T10:09:28.662 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-09-03T10:09:32.655 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None
2023-09-03T10:09:43.804 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-09-03T10:09:47.792 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None
2023-09-03T10:09:58.957 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-09-03T10:10:02.937 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None
2023-09-03T10:10:14.100 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-09-03T10:10:18.069 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None
2023-09-03T10:10:29.266 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-09-03T10:10:33.211 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None
2023-09-03T10:10:44.449 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-09-03T10:10:48.343 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None
2023-09-03T10:10:59.605 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-09-03T10:11:03.507 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None
2023-09-03T10:11:14.754 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-09-03T10:11:18.646 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None
2023-09-03T10:11:29.908 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-09-03T10:11:33.780 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None
2023-09-03T10:11:33.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-03T10:11:34.289 ERROR:teuthology.orchestra.connection:Error authenticating with smithi044.front.sepia.ceph.com: Authentication failed.
2023-09-03T10:11:34.291 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-03T10:11:34.292 DEBUG:teuthology.orchestra.run.smithi044:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-03T10:11:34.292 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-09-03T10:11:35.299 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-09-03T10:11:45.040 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-09-03T10:12:00.149 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-09-03T10:12:15.257 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-09-03T10:12:30.356 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-09-03T10:12:45.452 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-09-03T10:12:45.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-03T10:13:04.026 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158
2023-09-03T10:13:10.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-03T10:13:13.082 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158
2023-09-03T10:13:19.083 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-03T10:13:22.138 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158
2023-09-03T10:13:28.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-03T10:13:31.194 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158
2023-09-03T10:13:36.282 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2023-09-03T10:13:36.284 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi044
2023-09-03T10:13:37.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-03T10:13:40.250 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158
2023-09-03T10:13:45.290 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com'
2023-09-03T10:13:45.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-03T10:13:46.253 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-03T10:13:48.346 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.44
2023-09-03T10:13:49.306 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158
2023-09-03T10:13:55.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-03T10:13:57.350 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com'
2023-09-03T10:13:57.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-03T10:13:57.579 DEBUG:teuthology.orchestra.run.smithi044:> true
2023-09-03T10:13:58.022 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com'
2023-09-03T10:13:58.023 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-03T10:13:58.023 DEBUG:teuthology.orchestra.run.smithi044:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-03T10:13:58.069 INFO:teuthology.provision.fog.smithi044:Node is ready
2023-09-03T10:13:58.070 DEBUG:teuthology.orchestra.run.smithi044:> hostname
2023-09-03T10:13:58.117 INFO:teuthology.orchestra.run.smithi044.stdout:smithi044.front.sepia.ceph.com
2023-09-03T10:13:58.117 DEBUG:teuthology.orchestra.run.smithi044:> grep smithi044.front.sepia.ceph.com /etc/hosts
2023-09-03T10:13:58.166 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44 smithi044.front.sepia.ceph.com smithi044
2023-09-03T10:13:58.166 DEBUG:teuthology.orchestra.run.smithi044:> sudo hostname smithi044
2023-09-03T10:13:58.294 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i -e 's/smithi044.front.sepia.ceph.com/smithi044/g' /etc/hosts
2023-09-03T10:13:58.308 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i -e 's/172.21.15.44/172.21.15.44/g' /etc/hosts
2023-09-03T10:13:58.362 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i -e 's/smithi044.front.sepia.ceph.com/smithi044/g' /etc/hostname
2023-09-03T10:13:58.394 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158
2023-09-03T10:13:58.417 DEBUG:teuthology.orchestra.run.smithi044:> sudo hostname smithi044
2023-09-03T10:13:58.472 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release
2023-09-03T10:13:58.517 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-09-03T10:13:58.517 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="Ubuntu"
2023-09-03T10:13:58.517 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="22.04"
2023-09-03T10:13:58.518 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-09-03T10:13:58.518 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_CODENAME=jammy
2023-09-03T10:13:58.518 INFO:teuthology.orchestra.run.smithi044.stdout:ID=ubuntu
2023-09-03T10:13:58.518 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE=debian
2023-09-03T10:13:58.518 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://www.ubuntu.com/"
2023-09-03T10:13:58.519 INFO:teuthology.orchestra.run.smithi044.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-09-03T10:13:58.519 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-09-03T10:13:58.519 INFO:teuthology.orchestra.run.smithi044.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-09-03T10:13:58.519 INFO:teuthology.orchestra.run.smithi044.stdout:UBUNTU_CODENAME=jammy
2023-09-03T10:13:58.520 INFO:teuthology.provision.fog.smithi044:Deploy complete!
2023-09-03T10:13:58.521 DEBUG:teuthology.parallel:result is None
2023-09-03T10:14:04.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-03T10:14:14.682 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158
2023-09-03T10:14:20.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-03T10:14:23.770 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158
2023-09-03T10:14:29.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-03T10:14:32.826 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158
2023-09-03T10:14:38.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-03T10:14:38.836 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158
2023-09-03T10:14:44.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-03T10:14:44.840 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158
2023-09-03T10:14:50.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-03T10:14:50.848 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158
2023-09-03T10:14:56.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-03T10:14:56.857 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158
2023-09-03T10:15:02.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-03T10:15:03.040 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-03T10:15:03.040 DEBUG:teuthology.orchestra.run.smithi158:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-03T10:15:03.405 INFO:teuthology.provision.fog.smithi158:Node is ready
2023-09-03T10:15:03.406 DEBUG:teuthology.orchestra.run.smithi158:> hostname
2023-09-03T10:15:03.453 INFO:teuthology.orchestra.run.smithi158.stdout:smithi158.front.sepia.ceph.com
2023-09-03T10:15:03.454 DEBUG:teuthology.orchestra.run.smithi158:> grep smithi158.front.sepia.ceph.com /etc/hosts
2023-09-03T10:15:03.501 INFO:teuthology.orchestra.run.smithi158.stdout:172.21.15.158 smithi158.front.sepia.ceph.com smithi158
2023-09-03T10:15:03.502 DEBUG:teuthology.orchestra.run.smithi158:> sudo hostname smithi158
2023-09-03T10:15:03.656 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/smithi158.front.sepia.ceph.com/smithi158/g' /etc/hosts
2023-09-03T10:15:03.670 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/172.21.15.158/172.21.15.158/g' /etc/hosts
2023-09-03T10:15:03.725 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/smithi158.front.sepia.ceph.com/smithi158/g' /etc/hostname
2023-09-03T10:15:03.782 DEBUG:teuthology.orchestra.run.smithi158:> sudo hostname smithi158
2023-09-03T10:15:03.842 DEBUG:teuthology.orchestra.run.smithi158:> cat /etc/os-release
2023-09-03T10:15:03.890 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-09-03T10:15:03.890 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="Ubuntu"
2023-09-03T10:15:03.890 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="22.04"
2023-09-03T10:15:03.890 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-09-03T10:15:03.891 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_CODENAME=jammy
2023-09-03T10:15:03.891 INFO:teuthology.orchestra.run.smithi158.stdout:ID=ubuntu
2023-09-03T10:15:03.891 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE=debian
2023-09-03T10:15:03.891 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://www.ubuntu.com/"
2023-09-03T10:15:03.891 INFO:teuthology.orchestra.run.smithi158.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-09-03T10:15:03.892 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-09-03T10:15:03.892 INFO:teuthology.orchestra.run.smithi158.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-09-03T10:15:03.892 INFO:teuthology.orchestra.run.smithi158.stdout:UBUNTU_CODENAME=jammy
2023-09-03T10:15:03.893 INFO:teuthology.provision.fog.smithi158:Deploy complete!
2023-09-03T10:15:03.893 DEBUG:teuthology.parallel:result is None
2023-09-03T10:15:04.113 INFO:teuthology.lock.ops:Checking smithi044.front.sepia.ceph.com
2023-09-03T10:15:04.114 INFO:teuthology.lock.ops:New key found. Updating...
2023-09-03T10:15:04.134 INFO:teuthology.lock.ops:Checking smithi158.front.sepia.ceph.com
2023-09-03T10:15:04.134 INFO:teuthology.lock.ops:New key found. Updating...
2023-09-03T10:15:04.160 INFO:teuthology.lock.ops:Updating [smithi044.front.sepia.ceph.com]: set os type and version on server
2023-09-03T10:15:04.161 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com'
2023-09-03T10:15:04.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-03T10:15:04.240 DEBUG:teuthology.orchestra.run.smithi044:> true
2023-09-03T10:15:04.486 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com'
2023-09-03T10:15:04.486 DEBUG:teuthology.orchestra.run.smithi044:> uname -m
2023-09-03T10:15:04.532 INFO:teuthology.orchestra.run.smithi044.stdout:x86_64
2023-09-03T10:15:04.533 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release
2023-09-03T10:15:04.580 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-09-03T10:15:04.581 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="Ubuntu"
2023-09-03T10:15:04.581 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="22.04"
2023-09-03T10:15:04.581 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-09-03T10:15:04.581 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_CODENAME=jammy
2023-09-03T10:15:04.582 INFO:teuthology.orchestra.run.smithi044.stdout:ID=ubuntu
2023-09-03T10:15:04.582 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE=debian
2023-09-03T10:15:04.582 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://www.ubuntu.com/"
2023-09-03T10:15:04.582 INFO:teuthology.orchestra.run.smithi044.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-09-03T10:15:04.582 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-09-03T10:15:04.583 INFO:teuthology.orchestra.run.smithi044.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-09-03T10:15:04.583 INFO:teuthology.orchestra.run.smithi044.stdout:UBUNTU_CODENAME=jammy
2023-09-03T10:15:04.583 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server
2023-09-03T10:15:04.601 INFO:teuthology.lock.ops:Updating [smithi158.front.sepia.ceph.com]: set os type and version on server
2023-09-03T10:15:04.601 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com'
2023-09-03T10:15:04.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-03T10:15:04.719 DEBUG:teuthology.orchestra.run.smithi158:> true
2023-09-03T10:15:04.826 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi158.front.sepia.ceph.com'
2023-09-03T10:15:04.826 DEBUG:teuthology.orchestra.run.smithi158:> uname -m
2023-09-03T10:15:04.872 INFO:teuthology.orchestra.run.smithi158.stdout:x86_64
2023-09-03T10:15:04.873 DEBUG:teuthology.orchestra.run.smithi158:> cat /etc/os-release
2023-09-03T10:15:04.921 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-09-03T10:15:04.922 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="Ubuntu"
2023-09-03T10:15:04.922 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="22.04"
2023-09-03T10:15:04.922 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-09-03T10:15:04.922 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_CODENAME=jammy
2023-09-03T10:15:04.923 INFO:teuthology.orchestra.run.smithi158.stdout:ID=ubuntu
2023-09-03T10:15:04.923 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE=debian
2023-09-03T10:15:04.923 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://www.ubuntu.com/"
2023-09-03T10:15:04.923 INFO:teuthology.orchestra.run.smithi158.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-09-03T10:15:04.923 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-09-03T10:15:04.923 INFO:teuthology.orchestra.run.smithi158.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-09-03T10:15:04.924 INFO:teuthology.orchestra.run.smithi158.stdout:UBUNTU_CODENAME=jammy
2023-09-03T10:15:04.924 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server
2023-09-03T10:15:04.942 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-03T10:15:05.024 INFO:teuthology.dispatcher.supervisor:Running job 7387512
2023-09-03T10:15:05.024 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/virtualenv/bin/teuthology -v --owner scheduled_matan@teuthology --archive /home/teuthworker/archive/matan-2023-09-03_10:07:17-rados:thrash-wip-matanb-reremove-snap-only-distro-default-smithi/7387512 --name matan-2023-09-03_10:07:17-rados:thrash-wip-matanb-reremove-snap-only-distro-default-smithi --description rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-localized} -- /home/teuthworker/archive/matan-2023-09-03_10:07:17-rados:thrash-wip-matanb-reremove-snap-only-distro-default-smithi/7387512/orig.config.yaml
2023-09-03T10:15:05.032 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/matan-2023-09-03_10:07:17-rados:thrash-wip-matanb-reremove-snap-only-distro-default-smithi/7387512
2023-09-03T10:15:05.033 INFO:teuthology.dispatcher.supervisor:Job PID: 2820877
2023-09-03T10:15:05.033 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-09-03T10:17:05.134 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-03T10:17:05.208 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-09-03T10:17:05.314 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-09-03T10:17:05.315 INFO:teuthology.nuke:Checking targets against current locks
2023-09-03T10:17:05.362 DEBUG:teuthology.nuke:shortname: smithi044
2023-09-03T10:17:05.363 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-03T10:17:05.386 DEBUG:teuthology.nuke:shortname: smithi158
2023-09-03T10:17:05.386 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-03T10:17:05.389 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi044.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-09-03_10:07:17-rados:thrash-wip-matanb-reremove-snap-only-distro-default-smithi/7387512', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-03 10:08:09.607514', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIH9beunrafO0Ysgmze3G2zFg1TBLL5apzXfqBxDzjjEe'}
2023-09-03T10:17:05.414 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi158.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-09-03_10:07:17-rados:thrash-wip-matanb-reremove-snap-only-distro-default-smithi/7387512', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-03 10:08:09.608597', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOISsLUkGEWLsqWUyBjZW+LBwpiCmE0DyXFcrZCzDgYZ'}
2023-09-03T10:17:05.438 INFO:teuthology.orchestra.console.smithi044:Power off
2023-09-03T10:17:05.439 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-03T10:17:05.476 INFO:teuthology.orchestra.console.smithi158:Power off
2023-09-03T10:17:05.477 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-03T10:17:05.485 DEBUG:teuthology.orchestra.console.smithi044:power off output: Chassis Power Control: Down/Off
2023-09-03T10:17:05.486 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-03T10:17:05.497 DEBUG:teuthology.orchestra.console.smithi158:power off output: Chassis Power Control: Down/Off
2023-09-03T10:17:05.498 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-03T10:17:05.506 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off
2023-09-03T10:17:05.518 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is off
2023-09-03T10:17:05.608 INFO:teuthology.orchestra.console.smithi044:Power off completed
2023-09-03T10:17:05.619 INFO:teuthology.orchestra.console.smithi158:Power off completed
2023-09-03T10:17:05.763 INFO:teuthology.lock.ops:unlocked: smithi044.front.sepia.ceph.com
2023-09-03T10:17:05.771 INFO:teuthology.lock.ops:unlocked: smithi158.front.sepia.ceph.com