2023-07-29T21:22:21.570 INFO:root:teuthology version: 0.0.1.dev165+g3117e89
2023-07-29T21:22:21.572 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-29T21:22:21.573 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-29T21:22:46.022 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fc544495880>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fc543b7f310>, signals=[15])
2023-07-29T21:22:46.024 INFO:teuthology.lock.ops:Start node 'smithi104.front.sepia.ceph.com' reimaging
2023-07-29T21:22:46.024 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: reset os type and version on server
2023-07-29T21:22:46.024 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server
2023-07-29T21:22:51.054 INFO:teuthology.lock.ops:Start node 'smithi184.front.sepia.ceph.com' reimaging
2023-07-29T21:22:51.054 INFO:teuthology.lock.ops:Updating [smithi184.front.sepia.ceph.com]: reset os type and version on server
2023-07-29T21:22:51.055 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server
2023-07-29T21:22:51.056 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /host {"name": "smithi104"}
2023-07-29T21:23:01.085 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /host {"name": "smithi184"}
2023-07-29T21:23:06.125 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /image {"name": "smithi_ubuntu_22.04"}
2023-07-29T21:23:07.031 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /image {"name": "smithi_ubuntu_22.04"}
2023-07-29T21:23:07.061 DEBUG:teuthology.provision.fog.smithi104:Requesting image smithi_ubuntu_22.04 (ID 6)
2023-07-29T21:23:07.061 DEBUG:teuthology.provision.fog.smithi104:FOG request: PUT /host/209 {"imageID": 6}
2023-07-29T21:23:07.091 DEBUG:teuthology.provision.fog.smithi184:Requesting image smithi_ubuntu_22.04 (ID 6)
2023-07-29T21:23:07.092 DEBUG:teuthology.provision.fog.smithi184:FOG request: PUT /host/289 {"imageID": 6}
2023-07-29T21:23:07.118 INFO:teuthology.provision.fog.smithi104:Scheduling deploy of ubuntu 22.04
2023-07-29T21:23:07.118 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-07-29T21:23:07.133 INFO:teuthology.provision.fog.smithi184:Scheduling deploy of ubuntu 22.04
2023-07-29T21:23:07.134 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None
2023-07-29T21:23:07.209 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /tasktype {"name": "deploy"}
2023-07-29T21:23:07.214 DEBUG:teuthology.provision.fog.smithi184:Canceling deploy task with ID 420846
2023-07-29T21:23:07.214 DEBUG:teuthology.provision.fog.smithi184:FOG request: DELETE /task/cancel {"id": 420846}
2023-07-29T21:23:07.259 DEBUG:teuthology.provision.fog.smithi104:FOG request: POST /host/209/task {"taskTypeID": 1}
2023-07-29T21:23:07.285 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /tasktype {"name": "deploy"}
2023-07-29T21:23:07.319 DEBUG:teuthology.provision.fog.smithi184:FOG request: POST /host/289/task {"taskTypeID": 1}
2023-07-29T21:23:07.325 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-07-29T21:23:07.371 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None
2023-07-29T21:23:07.434 INFO:teuthology.orchestra.console.smithi104:Power off
2023-07-29T21:23:07.435 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-29T21:23:07.461 DEBUG:teuthology.orchestra.console.smithi104:power off output: Chassis Power Control: Down/Off
2023-07-29T21:23:07.461 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-29T21:23:07.484 INFO:teuthology.orchestra.console.smithi184:Power off
2023-07-29T21:23:07.485 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-29T21:23:07.499 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on
2023-07-29T21:23:11.504 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-29T21:23:12.616 DEBUG:teuthology.orchestra.console.smithi104:check power output: 
2023-07-29T21:23:16.620 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-29T21:23:17.731 DEBUG:teuthology.orchestra.console.smithi104:check power output: 
2023-07-29T21:23:20.904 DEBUG:teuthology.orchestra.console.smithi184:power off output: Chassis Power Control: Down/Off
2023-07-29T21:23:20.904 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-29T21:23:21.734 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-29T21:23:21.914 DEBUG:teuthology.orchestra.console.smithi184:check power output: 
2023-07-29T21:23:22.845 DEBUG:teuthology.orchestra.console.smithi104:check power output: 
2023-07-29T21:23:25.916 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-29T21:23:26.026 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off
2023-07-29T21:23:26.128 INFO:teuthology.orchestra.console.smithi184:Power off completed
2023-07-29T21:23:26.228 INFO:teuthology.orchestra.console.smithi184:Power on
2023-07-29T21:23:26.229 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-29T21:23:26.846 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-29T21:23:27.957 DEBUG:teuthology.orchestra.console.smithi104:check power output: 
2023-07-29T21:23:31.261 DEBUG:teuthology.orchestra.console.smithi184:power on output: Chassis Power Control: Up/On
2023-07-29T21:23:31.262 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-29T21:23:31.293 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off
2023-07-29T21:23:31.959 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-29T21:23:33.070 DEBUG:teuthology.orchestra.console.smithi104:check power output: 
2023-07-29T21:23:35.297 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-29T21:23:35.411 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on
2023-07-29T21:23:35.512 INFO:teuthology.orchestra.console.smithi184:Power on completed
2023-07-29T21:23:35.614 INFO:teuthology.provision.fog.smithi184:Waiting for deploy to finish
2023-07-29T21:23:35.615 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None
2023-07-29T21:23:40.620 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-29T21:23:41.730 DEBUG:teuthology.orchestra.console.smithi104:check power output: 
2023-07-29T21:23:45.732 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-29T21:23:46.843 DEBUG:teuthology.orchestra.console.smithi104:check power output: 
2023-07-29T21:23:50.845 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-29T21:23:51.955 DEBUG:teuthology.orchestra.console.smithi104:check power output: 
2023-07-29T21:23:55.704 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None
2023-07-29T21:23:55.957 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-29T21:23:57.068 DEBUG:teuthology.orchestra.console.smithi104:check power output: 
2023-07-29T21:24:01.072 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-29T21:24:02.183 DEBUG:teuthology.orchestra.console.smithi104:check power output: 
2023-07-29T21:24:06.184 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-29T21:24:07.296 DEBUG:teuthology.orchestra.console.smithi104:check power output: 
2023-07-29T21:24:10.912 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None
2023-07-29T21:24:15.921 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-29T21:24:17.033 DEBUG:teuthology.orchestra.console.smithi104:check power output: 
2023-07-29T21:24:21.037 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-29T21:24:22.148 DEBUG:teuthology.orchestra.console.smithi104:check power output: 
2023-07-29T21:24:26.153 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-29T21:24:27.263 DEBUG:teuthology.orchestra.console.smithi104:check power output: 
2023-07-29T21:24:27.264 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds
2023-07-29T21:24:27.264 ERROR:teuthology.orchestra.console.smithi104:Failed to power off
2023-07-29T21:24:27.264 INFO:teuthology.orchestra.console.smithi104:Power on
2023-07-29T21:24:27.265 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-29T21:24:31.008 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None
2023-07-29T21:24:37.295 DEBUG:teuthology.orchestra.console.smithi104:power on output: Chassis Power Control: Up/On
2023-07-29T21:24:37.295 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-29T21:24:38.306 DEBUG:teuthology.orchestra.console.smithi104:check power output: 
2023-07-29T21:24:42.309 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-29T21:24:43.420 DEBUG:teuthology.orchestra.console.smithi104:check power output: 
2023-07-29T21:24:47.424 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-29T21:24:48.536 DEBUG:teuthology.orchestra.console.smithi104:check power output: 
2023-07-29T21:24:51.076 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None
2023-07-29T21:24:52.538 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-29T21:24:52.651 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on
2023-07-29T21:24:52.753 INFO:teuthology.orchestra.console.smithi104:Power on completed
2023-07-29T21:24:52.854 INFO:teuthology.provision.fog.smithi104:Waiting for deploy to finish
2023-07-29T21:24:52.855 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-07-29T21:25:06.156 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None
2023-07-29T21:25:07.934 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-07-29T21:25:21.240 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None
2023-07-29T21:25:23.012 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-07-29T21:25:37.464 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None
2023-07-29T21:25:38.562 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-07-29T21:25:53.648 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-07-29T21:25:53.650 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None
2023-07-29T21:26:13.747 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None
2023-07-29T21:26:13.749 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-07-29T21:26:28.836 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-07-29T21:26:28.837 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None
2023-07-29T21:26:48.912 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None
2023-07-29T21:26:48.913 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-07-29T21:26:50.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-29T21:27:05.268 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-07-29T21:27:25.349 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-07-29T21:27:45.428 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-07-29T21:27:50.437 WARNING:teuthology.provision.fog.smithi184:timed out
2023-07-29T21:27:50.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-29T21:27:56.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-29T21:28:01.445 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2023-07-29T21:28:04.496 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184
2023-07-29T21:28:07.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-29T21:28:12.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-29T21:28:17.456 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2023-07-29T21:28:20.532 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184
2023-07-29T21:28:23.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-29T21:28:27.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-29T21:28:27.593 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184
2023-07-29T21:28:30.640 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2023-07-29T21:28:33.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-29T21:28:38.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-29T21:28:43.604 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184
2023-07-29T21:28:46.672 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2023-07-29T21:28:49.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-29T21:28:54.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-29T21:28:54.870 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-29T21:28:54.871 DEBUG:teuthology.orchestra.run.smithi184:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-29T21:28:55.306 INFO:teuthology.provision.fog.smithi184:Node is ready
2023-07-29T21:28:55.306 DEBUG:teuthology.orchestra.run.smithi184:> hostname
2023-07-29T21:28:55.311 INFO:teuthology.orchestra.run.smithi184.stdout:smithi184.front.sepia.ceph.com
2023-07-29T21:28:55.311 DEBUG:teuthology.orchestra.run.smithi184:> grep smithi184.front.sepia.ceph.com /etc/hosts
2023-07-29T21:28:55.358 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.15.184 smithi184.front.sepia.ceph.com smithi184
2023-07-29T21:28:55.358 DEBUG:teuthology.orchestra.run.smithi184:> sudo hostname smithi184
2023-07-29T21:28:55.479 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/smithi184.front.sepia.ceph.com/smithi184/g' /etc/hosts
2023-07-29T21:28:55.493 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/172.21.15.184/172.21.15.184/g' /etc/hosts
2023-07-29T21:28:55.551 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/smithi184.front.sepia.ceph.com/smithi184/g' /etc/hostname
2023-07-29T21:28:55.607 DEBUG:teuthology.orchestra.run.smithi184:> sudo hostname smithi184
2023-07-29T21:28:55.661 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release
2023-07-29T21:28:55.705 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-07-29T21:28:55.706 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="Ubuntu"
2023-07-29T21:28:55.706 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="22.04"
2023-07-29T21:28:55.706 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-07-29T21:28:55.706 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_CODENAME=jammy
2023-07-29T21:28:55.706 INFO:teuthology.orchestra.run.smithi184.stdout:ID=ubuntu
2023-07-29T21:28:55.706 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE=debian
2023-07-29T21:28:55.706 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://www.ubuntu.com/"
2023-07-29T21:28:55.707 INFO:teuthology.orchestra.run.smithi184.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-07-29T21:28:55.707 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-07-29T21:28:55.707 INFO:teuthology.orchestra.run.smithi184.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-07-29T21:28:55.707 INFO:teuthology.orchestra.run.smithi184.stdout:UBUNTU_CODENAME=jammy
2023-07-29T21:28:55.708 INFO:teuthology.provision.fog.smithi184:Deploy complete!
2023-07-29T21:28:55.709 DEBUG:teuthology.parallel:result is None
2023-07-29T21:29:26.132 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2023-07-29T21:29:32.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-29T21:29:37.141 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2023-07-29T21:29:43.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-29T21:29:48.320 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-29T21:29:48.321 DEBUG:teuthology.orchestra.run.smithi104:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-29T21:29:49.029 INFO:teuthology.provision.fog.smithi104:Node is ready
2023-07-29T21:29:49.029 DEBUG:teuthology.orchestra.run.smithi104:> hostname
2023-07-29T21:29:49.076 INFO:teuthology.orchestra.run.smithi104.stdout:smithi104.front.sepia.ceph.com
2023-07-29T21:29:49.079 DEBUG:teuthology.orchestra.run.smithi104:> grep smithi104.front.sepia.ceph.com /etc/hosts
2023-07-29T21:29:49.124 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.15.104 smithi104.front.sepia.ceph.com smithi104
2023-07-29T21:29:49.124 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104
2023-07-29T21:29:49.284 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104.front.sepia.ceph.com/smithi104/g' /etc/hosts
2023-07-29T21:29:49.298 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/172.21.15.104/172.21.15.104/g' /etc/hosts
2023-07-29T21:29:49.353 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104.front.sepia.ceph.com/smithi104/g' /etc/hostname
2023-07-29T21:29:49.411 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104
2023-07-29T21:29:49.466 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release
2023-07-29T21:29:49.512 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-07-29T21:29:49.512 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="Ubuntu"
2023-07-29T21:29:49.513 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="22.04"
2023-07-29T21:29:49.513 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-07-29T21:29:49.513 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_CODENAME=jammy
2023-07-29T21:29:49.513 INFO:teuthology.orchestra.run.smithi104.stdout:ID=ubuntu
2023-07-29T21:29:49.513 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE=debian
2023-07-29T21:29:49.513 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://www.ubuntu.com/"
2023-07-29T21:29:49.513 INFO:teuthology.orchestra.run.smithi104.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-07-29T21:29:49.514 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-07-29T21:29:49.514 INFO:teuthology.orchestra.run.smithi104.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-07-29T21:29:49.514 INFO:teuthology.orchestra.run.smithi104.stdout:UBUNTU_CODENAME=jammy
2023-07-29T21:29:49.514 INFO:teuthology.provision.fog.smithi104:Deploy complete!
2023-07-29T21:29:49.515 DEBUG:teuthology.parallel:result is None
2023-07-29T21:30:23.683 ERROR:teuthology.misc:write (smithi184.front.sepia.ceph.com): No route to host
2023-07-29T21:30:23.684 ERROR:teuthology.misc:write (smithi184.front.sepia.ceph.com): No route to host
2023-07-29T21:30:52.710 ERROR:teuthology.misc:write (smithi184.front.sepia.ceph.com): No route to host
2023-07-29T21:30:52.711 ERROR:teuthology.misc:write (smithi184.front.sepia.ceph.com): No route to host
2023-07-29T21:31:57.798 ERROR:teuthology.misc:write (smithi184.front.sepia.ceph.com): No route to host
2023-07-29T21:31:57.799 ERROR:teuthology.misc:write (smithi184.front.sepia.ceph.com): No route to host
2023-07-29T21:32:57.914 INFO:teuthology.lock.ops:Checking smithi104.front.sepia.ceph.com
2023-07-29T21:32:57.915 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-29T21:33:00.694 INFO:teuthology.lock.ops:Checking smithi184.front.sepia.ceph.com
2023-07-29T21:33:00.694 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-29T21:33:05.727 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: set os type and version on server
2023-07-29T21:33:05.728 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com'
2023-07-29T21:33:05.729 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-29T21:33:10.809 DEBUG:teuthology.orchestra.run.smithi104:> true
2023-07-29T21:33:11.060 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com'
2023-07-29T21:33:11.060 DEBUG:teuthology.orchestra.run.smithi104:> uname -m
2023-07-29T21:33:11.109 INFO:teuthology.orchestra.run.smithi104.stdout:x86_64
2023-07-29T21:33:11.109 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release
2023-07-29T21:33:11.155 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-07-29T21:33:11.155 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="Ubuntu"
2023-07-29T21:33:11.156 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="22.04"
2023-07-29T21:33:11.156 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-07-29T21:33:11.156 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_CODENAME=jammy
2023-07-29T21:33:11.156 INFO:teuthology.orchestra.run.smithi104.stdout:ID=ubuntu
2023-07-29T21:33:11.156 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE=debian
2023-07-29T21:33:11.156 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://www.ubuntu.com/"
2023-07-29T21:33:11.156 INFO:teuthology.orchestra.run.smithi104.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-07-29T21:33:11.157 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-07-29T21:33:11.157 INFO:teuthology.orchestra.run.smithi104.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-07-29T21:33:11.157 INFO:teuthology.orchestra.run.smithi104.stdout:UBUNTU_CODENAME=jammy
2023-07-29T21:33:11.157 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server
2023-07-29T21:33:16.183 INFO:teuthology.lock.ops:Updating [smithi184.front.sepia.ceph.com]: set os type and version on server
2023-07-29T21:33:16.183 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com'
2023-07-29T21:33:16.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-29T21:33:16.258 ERROR:teuthology.orchestra.connection:Error authenticating with smithi184.front.sepia.ceph.com: Authentication failed.
2023-07-29T21:33:16.260 DEBUG:teuthology.orchestra.run.smithi184:> true
2023-07-29T21:33:16.261 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-29T22:33:25.349 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com'
2023-07-29T22:33:25.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-29T22:33:25.451 DEBUG:teuthology.orchestra.run.smithi184:> true
2023-07-29T22:33:25.583 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com'
2023-07-29T22:33:25.584 DEBUG:teuthology.orchestra.run.smithi184:> uname -m
2023-07-29T22:33:25.644 INFO:teuthology.orchestra.run.smithi184.stdout:x86_64
2023-07-29T22:33:25.644 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release
2023-07-29T22:33:25.703 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="CentOS Stream"
2023-07-29T22:33:25.704 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="8"
2023-07-29T22:33:25.704 INFO:teuthology.orchestra.run.smithi184.stdout:ID="centos"
2023-07-29T22:33:25.704 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE="rhel fedora"
2023-07-29T22:33:25.704 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="8"
2023-07-29T22:33:25.705 INFO:teuthology.orchestra.run.smithi184.stdout:PLATFORM_ID="platform:el8"
2023-07-29T22:33:25.705 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-29T22:33:25.705 INFO:teuthology.orchestra.run.smithi184.stdout:ANSI_COLOR="0;31"
2023-07-29T22:33:25.705 INFO:teuthology.orchestra.run.smithi184.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-29T22:33:25.705 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://centos.org/"
2023-07-29T22:33:25.705 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-29T22:33:25.705 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-29T22:33:25.706 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-29T22:33:25.706 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server
2023-07-29T22:33:30.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-29T22:33:30.743 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-29T22:33:35.846 INFO:teuthology.dispatcher.supervisor:Running job 7355786
2023-07-29T22:33:35.847 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-28_14:34:09-rgw-wip-yuri7-testing-2023-07-27-1336-quincy-distro-default-smithi/7355786 --name yuriw-2023-07-28_14:34:09-rgw-wip-yuri7-testing-2023-07-27-1336-quincy-distro-default-smithi --description rgw/hadoop-s3a/{clusters/fixed-2 hadoop/v32 overrides s3a-hadoop} -- /home/teuthworker/archive/yuriw-2023-07-28_14:34:09-rgw-wip-yuri7-testing-2023-07-27-1336-quincy-distro-default-smithi/7355786/orig.config.yaml
2023-07-29T22:33:35.852 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-07-28_14:34:09-rgw-wip-yuri7-testing-2023-07-27-1336-quincy-distro-default-smithi/7355786
2023-07-29T22:33:35.853 INFO:teuthology.dispatcher.supervisor:Job PID: 2140
2023-07-29T22:33:35.853 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-07-29T22:35:35.856 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-29T22:35:35.857 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-29T22:35:40.931 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-07-29T22:35:51.029 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi184 but it was locked by another job: /home/teuthworker/archive/teuthology-2023-07-29_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7356945
2023-07-29T22:35:51.029 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-07-29T22:35:51.029 INFO:teuthology.nuke:Checking targets against current locks
2023-07-29T22:36:03.028 DEBUG:teuthology.nuke:shortname: smithi104
2023-07-29T22:36:03.029 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-29T22:36:03.032 INFO:teuthology.nuke:Not nuking smithi184.front.sepia.ceph.com because description doesn't match: yuriw-2023-07-28_14:34:09-rgw-wip-yuri7-testing-2023-07-27-1336-quincy-distro-default-smithi != /home/teuthworker/archive/teuthology-2023-07-29_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7356945
2023-07-29T22:36:03.052 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi104.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-28_14:34:09-rgw-wip-yuri7-testing-2023-07-27-1336-quincy-distro-default-smithi/7355786', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-29 21:22:20.796683', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBEhHrKVzbKVP+cWnC7kEGz6/P7MHF03xDa2/y3M9ip3'}
2023-07-29T22:36:08.118 INFO:teuthology.orchestra.console.smithi104:Power off
2023-07-29T22:36:08.119 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-29T22:36:08.139 DEBUG:teuthology.orchestra.console.smithi104:power off output: Chassis Power Control: Down/Off
2023-07-29T22:36:08.140 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-29T22:36:08.161 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off
2023-07-29T22:36:08.262 INFO:teuthology.orchestra.console.smithi104:Power off completed
2023-07-29T22:36:08.417 INFO:teuthology.lock.ops:unlocked: smithi104.front.sepia.ceph.com
2023-07-29T22:36:08.418 ERROR:teuthology.nuke:Could not nuke the following targets:
targets:
  smithi184.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD0SDuUPlJ/l9L7LrgL2CIHvLlO2s7JISOjtQHSf1/2FpUQ3Ox5KV9P31BX96KAIP2YQGqgYd52Bo2wN6Klcw73NZ4CyBHe3dOsN2fl6YTsXna6gz6ADhCSSBZvC9FLCQR3Ma6V6vY2IX8GuVX5BAB0w74ZvegkYBbY9RM49fKBJ2n5bNafoCk3c47R+Tsx1jh1CXgtsajW/jE/DeJ0c/sBrur75BhsnXi/cSxczQWHRdANPF2v04BKTNcZGtEJeNmrTBNkwjcJZF6RZ8cN+Jxppyz5hyQ3uvegfL3hXH3gDt1kDSFUaisL88ZF3L8NcjKHCoLtsyQo15LtQigBZtxRugtxo2aQZadp03PfRjzYMz4GOFd0WfPvtu3U5HRRLmeZDYuUglzEVciOMbkK7bYqKjYA02ZJ7GCFad59cAE6T0NjbjqjOH+pIG13JVNEaKXTxI50myg35k7gF0zSlOX5HIWSrww/ndXVJUP86dm+aoMHN/B1hO16pYhkNPCE7bM=