2023-09-30T18:32:04.777 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc
2023-09-30T18:32:04.778 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-30T18:32:04.914 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f510706fbe0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f5107b75670>, signals=[15])
2023-09-30T18:32:04.914 INFO:teuthology.lock.ops:Start node 'smithi029.front.sepia.ceph.com' reimaging
2023-09-30T18:32:04.914 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: reset os type and version on server
2023-09-30T18:32:04.915 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server
2023-09-30T18:32:04.933 INFO:teuthology.lock.ops:Start node 'smithi087.front.sepia.ceph.com' reimaging
2023-09-30T18:32:04.934 INFO:teuthology.lock.ops:Updating [smithi087.front.sepia.ceph.com]: reset os type and version on server
2023-09-30T18:32:04.934 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server
2023-09-30T18:32:04.935 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /host {"name": "smithi029"}
2023-09-30T18:32:04.958 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /host {"name": "smithi087"}
2023-09-30T18:32:05.010 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /image {"name": "smithi_ubuntu_22.04"}
2023-09-30T18:32:05.036 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /image {"name": "smithi_ubuntu_22.04"}
2023-09-30T18:32:05.049 DEBUG:teuthology.provision.fog.smithi029:Requesting image smithi_ubuntu_22.04 (ID 6)
2023-09-30T18:32:05.049 DEBUG:teuthology.provision.fog.smithi029:FOG request: PUT /host/134 {"imageID": 6}
2023-09-30T18:32:05.079 DEBUG:teuthology.provision.fog.smithi087:Requesting image smithi_ubuntu_22.04 (ID 6)
2023-09-30T18:32:05.079 DEBUG:teuthology.provision.fog.smithi087:FOG request: PUT /host/192 {"imageID": 6}
2023-09-30T18:32:05.089 INFO:teuthology.provision.fog.smithi029:Scheduling deploy of ubuntu 22.04
2023-09-30T18:32:05.089 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-09-30T18:32:05.134 INFO:teuthology.provision.fog.smithi087:Scheduling deploy of ubuntu 22.04
2023-09-30T18:32:05.134 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None
2023-09-30T18:32:05.170 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /tasktype {"name": "deploy"}
2023-09-30T18:32:05.206 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /tasktype {"name": "deploy"}
2023-09-30T18:32:05.209 DEBUG:teuthology.provision.fog.smithi029:FOG request: POST /host/134/task {"taskTypeID": 1}
2023-09-30T18:32:05.250 DEBUG:teuthology.provision.fog.smithi087:FOG request: POST /host/192/task {"taskTypeID": 1}
2023-09-30T18:32:05.273 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-09-30T18:32:05.312 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None
2023-09-30T18:32:05.362 INFO:teuthology.orchestra.console.smithi029:Power off
2023-09-30T18:32:05.363 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-30T18:32:05.386 DEBUG:teuthology.orchestra.console.smithi029:power off output: Chassis Power Control: Down/Off
2023-09-30T18:32:05.386 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-30T18:32:05.419 INFO:teuthology.orchestra.console.smithi087:Power off
2023-09-30T18:32:05.419 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-30T18:32:05.427 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on
2023-09-30T18:32:05.439 DEBUG:teuthology.orchestra.console.smithi087:power off output: Chassis Power Control: Down/Off
2023-09-30T18:32:05.440 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-30T18:32:05.460 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is on
2023-09-30T18:32:09.430 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-30T18:32:09.461 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-30T18:32:09.539 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on
2023-09-30T18:32:09.570 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is on
2023-09-30T18:32:13.545 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-30T18:32:13.571 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-30T18:32:13.654 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off
2023-09-30T18:32:13.679 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is on
2023-09-30T18:32:13.755 INFO:teuthology.orchestra.console.smithi029:Power off completed
2023-09-30T18:32:13.855 INFO:teuthology.orchestra.console.smithi029:Power on
2023-09-30T18:32:13.856 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-30T18:32:13.876 DEBUG:teuthology.orchestra.console.smithi029:power on output: Chassis Power Control: Up/On
2023-09-30T18:32:13.876 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-30T18:32:13.896 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off
2023-09-30T18:32:17.682 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-30T18:32:17.790 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is off
2023-09-30T18:32:17.891 INFO:teuthology.orchestra.console.smithi087:Power off completed
2023-09-30T18:32:17.897 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-30T18:32:17.992 INFO:teuthology.orchestra.console.smithi087:Power on
2023-09-30T18:32:17.992 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-30T18:32:18.005 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off
2023-09-30T18:32:18.013 DEBUG:teuthology.orchestra.console.smithi087:power on output: Chassis Power Control: Up/On
2023-09-30T18:32:18.013 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-30T18:32:18.038 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is off
2023-09-30T18:32:22.010 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-30T18:32:22.039 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-30T18:32:22.119 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on
2023-09-30T18:32:22.149 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is off
2023-09-30T18:32:22.220 INFO:teuthology.orchestra.console.smithi029:Power on completed
2023-09-30T18:32:22.321 INFO:teuthology.provision.fog.smithi029:Waiting for deploy to finish
2023-09-30T18:32:22.321 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-09-30T18:32:26.153 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-30T18:32:26.262 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is on
2023-09-30T18:32:26.363 INFO:teuthology.orchestra.console.smithi087:Power on completed
2023-09-30T18:32:26.463 INFO:teuthology.provision.fog.smithi087:Waiting for deploy to finish
2023-09-30T18:32:26.464 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None
2023-09-30T18:32:37.422 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-09-30T18:32:41.534 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None
2023-09-30T18:32:52.506 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-09-30T18:32:56.626 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None
2023-09-30T18:33:07.590 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-09-30T18:33:11.706 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None
2023-09-30T18:33:22.678 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-09-30T18:33:26.782 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None
2023-09-30T18:33:37.760 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-09-30T18:33:41.856 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None
2023-09-30T18:33:52.848 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-09-30T18:33:56.930 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None
2023-09-30T18:34:07.930 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-09-30T18:34:11.994 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None
2023-09-30T18:34:23.002 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-09-30T18:34:27.063 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None
2023-09-30T18:34:38.074 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-09-30T18:34:42.126 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None
2023-09-30T18:34:53.150 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-09-30T18:34:57.194 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None
2023-09-30T18:35:08.212 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-09-30T18:35:12.270 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None
2023-09-30T18:35:23.278 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-09-30T18:35:27.338 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None
2023-09-30T18:35:38.344 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-09-30T18:35:42.406 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None
2023-09-30T18:35:42.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-30T18:35:45.530 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87
2023-09-30T18:35:51.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-30T18:35:53.398 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-09-30T18:35:54.590 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87
2023-09-30T18:36:00.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-30T18:36:03.674 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87
2023-09-30T18:36:08.455 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-09-30T18:36:09.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-30T18:36:12.730 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87
2023-09-30T18:36:18.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-30T18:36:21.786 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87
2023-09-30T18:36:23.506 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-09-30T18:36:27.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-30T18:36:30.846 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87
2023-09-30T18:36:36.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-30T18:36:38.570 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-09-30T18:36:38.634 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-30T18:36:38.725 ERROR:teuthology.orchestra.connection:Error authenticating with smithi029.front.sepia.ceph.com: Authentication failed.
2023-09-30T18:36:38.725 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-30T18:36:38.726 DEBUG:teuthology.orchestra.run.smithi029:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-30T18:36:38.726 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-09-30T18:37:08.347 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87
2023-09-30T18:37:14.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-30T18:37:14.350 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87
2023-09-30T18:37:20.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-30T18:37:20.352 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87
2023-09-30T18:37:26.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-30T18:37:26.356 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87
2023-09-30T18:37:32.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-30T18:37:32.359 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87
2023-09-30T18:37:38.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-30T18:37:38.674 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-30T18:37:38.674 DEBUG:teuthology.orchestra.run.smithi087:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-30T18:37:39.116 INFO:teuthology.provision.fog.smithi087:Node is ready
2023-09-30T18:37:39.117 DEBUG:teuthology.orchestra.run.smithi087:> hostname
2023-09-30T18:37:39.165 INFO:teuthology.orchestra.run.smithi087.stdout:smithi087.front.sepia.ceph.com
2023-09-30T18:37:39.165 DEBUG:teuthology.orchestra.run.smithi087:> grep smithi087.front.sepia.ceph.com /etc/hosts
2023-09-30T18:37:39.213 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87 smithi087.front.sepia.ceph.com smithi087
2023-09-30T18:37:39.214 DEBUG:teuthology.orchestra.run.smithi087:> sudo hostname smithi087
2023-09-30T18:37:39.389 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i -e 's/smithi087.front.sepia.ceph.com/smithi087/g' /etc/hosts
2023-09-30T18:37:39.403 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i -e 's/172.21.15.87/172.21.15.87/g' /etc/hosts
2023-09-30T18:37:39.461 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i -e 's/smithi087.front.sepia.ceph.com/smithi087/g' /etc/hostname
2023-09-30T18:37:39.518 DEBUG:teuthology.orchestra.run.smithi087:> sudo hostname smithi087
2023-09-30T18:37:39.571 DEBUG:teuthology.orchestra.run.smithi087:> cat /etc/os-release
2023-09-30T18:37:39.620 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-09-30T18:37:39.621 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="Ubuntu"
2023-09-30T18:37:39.621 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="22.04"
2023-09-30T18:37:39.621 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-09-30T18:37:39.621 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_CODENAME=jammy
2023-09-30T18:37:39.621 INFO:teuthology.orchestra.run.smithi087.stdout:ID=ubuntu
2023-09-30T18:37:39.621 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE=debian
2023-09-30T18:37:39.621 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://www.ubuntu.com/"
2023-09-30T18:37:39.621 INFO:teuthology.orchestra.run.smithi087.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-09-30T18:37:39.621 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-09-30T18:37:39.621 INFO:teuthology.orchestra.run.smithi087.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-09-30T18:37:39.622 INFO:teuthology.orchestra.run.smithi087.stdout:UBUNTU_CODENAME=jammy
2023-09-30T18:37:39.622 INFO:teuthology.provision.fog.smithi087:Deploy complete!
2023-09-30T18:37:39.623 DEBUG:teuthology.parallel:result is None
2023-09-30T18:38:31.038 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2023-09-30T18:38:31.039 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi029
2023-09-30T18:38:40.046 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com'
2023-09-30T18:38:40.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-30T18:38:47.163 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.29
2023-09-30T18:38:56.170 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com'
2023-09-30T18:38:56.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-30T18:38:56.529 DEBUG:teuthology.orchestra.run.smithi029:> true
2023-09-30T18:38:57.106 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com'
2023-09-30T18:38:57.106 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-30T18:38:57.106 DEBUG:teuthology.orchestra.run.smithi029:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-30T18:38:57.151 INFO:teuthology.provision.fog.smithi029:Node is ready
2023-09-30T18:38:57.151 DEBUG:teuthology.orchestra.run.smithi029:> hostname
2023-09-30T18:38:57.203 INFO:teuthology.orchestra.run.smithi029.stdout:smithi029.front.sepia.ceph.com
2023-09-30T18:38:57.203 DEBUG:teuthology.orchestra.run.smithi029:> grep smithi029.front.sepia.ceph.com /etc/hosts
2023-09-30T18:38:57.251 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29 smithi029.front.sepia.ceph.com smithi029
2023-09-30T18:38:57.252 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname smithi029
2023-09-30T18:38:57.497 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/smithi029.front.sepia.ceph.com/smithi029/g' /etc/hosts
2023-09-30T18:38:57.512 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/172.21.15.29/172.21.15.29/g' /etc/hosts
2023-09-30T18:38:57.572 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/smithi029.front.sepia.ceph.com/smithi029/g' /etc/hostname
2023-09-30T18:38:57.632 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname smithi029
2023-09-30T18:38:57.687 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release
2023-09-30T18:38:57.735 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-09-30T18:38:57.736 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="Ubuntu"
2023-09-30T18:38:57.736 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="22.04"
2023-09-30T18:38:57.736 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-09-30T18:38:57.736 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_CODENAME=jammy
2023-09-30T18:38:57.736 INFO:teuthology.orchestra.run.smithi029.stdout:ID=ubuntu
2023-09-30T18:38:57.736 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE=debian
2023-09-30T18:38:57.736 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://www.ubuntu.com/"
2023-09-30T18:38:57.736 INFO:teuthology.orchestra.run.smithi029.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-09-30T18:38:57.736 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-09-30T18:38:57.736 INFO:teuthology.orchestra.run.smithi029.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-09-30T18:38:57.736 INFO:teuthology.orchestra.run.smithi029.stdout:UBUNTU_CODENAME=jammy
2023-09-30T18:38:57.737 INFO:teuthology.provision.fog.smithi029:Deploy complete!
2023-09-30T18:38:57.737 DEBUG:teuthology.parallel:result is None
2023-09-30T18:38:57.918 INFO:teuthology.lock.ops:Checking smithi029.front.sepia.ceph.com
2023-09-30T18:38:57.918 INFO:teuthology.lock.ops:New key found. Updating...
2023-09-30T18:38:57.947 INFO:teuthology.lock.ops:Checking smithi087.front.sepia.ceph.com
2023-09-30T18:38:57.948 INFO:teuthology.lock.ops:New key found. Updating...
2023-09-30T18:38:57.965 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: set os type and version on server
2023-09-30T18:38:57.966 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com'
2023-09-30T18:38:57.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-30T18:38:58.045 DEBUG:teuthology.orchestra.run.smithi029:> true
2023-09-30T18:38:58.142 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com'
2023-09-30T18:38:58.143 DEBUG:teuthology.orchestra.run.smithi029:> uname -m
2023-09-30T18:38:58.191 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64
2023-09-30T18:38:58.191 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release
2023-09-30T18:38:58.239 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-09-30T18:38:58.239 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="Ubuntu"
2023-09-30T18:38:58.239 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="22.04"
2023-09-30T18:38:58.239 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-09-30T18:38:58.239 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_CODENAME=jammy
2023-09-30T18:38:58.239 INFO:teuthology.orchestra.run.smithi029.stdout:ID=ubuntu
2023-09-30T18:38:58.240 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE=debian
2023-09-30T18:38:58.240 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://www.ubuntu.com/"
2023-09-30T18:38:58.240 INFO:teuthology.orchestra.run.smithi029.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-09-30T18:38:58.240 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-09-30T18:38:58.240 INFO:teuthology.orchestra.run.smithi029.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-09-30T18:38:58.240 INFO:teuthology.orchestra.run.smithi029.stdout:UBUNTU_CODENAME=jammy
2023-09-30T18:38:58.240 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server
2023-09-30T18:38:58.282 INFO:teuthology.lock.ops:Updating [smithi087.front.sepia.ceph.com]: set os type and version on server
2023-09-30T18:38:58.282 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com'
2023-09-30T18:38:58.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-30T18:38:58.359 DEBUG:teuthology.orchestra.run.smithi087:> true
2023-09-30T18:38:58.575 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com'
2023-09-30T18:38:58.575 DEBUG:teuthology.orchestra.run.smithi087:> uname -m
2023-09-30T18:38:58.619 INFO:teuthology.orchestra.run.smithi087.stdout:x86_64
2023-09-30T18:38:58.620 DEBUG:teuthology.orchestra.run.smithi087:> cat /etc/os-release
2023-09-30T18:38:58.671 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-09-30T18:38:58.672 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="Ubuntu"
2023-09-30T18:38:58.672 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="22.04"
2023-09-30T18:38:58.672 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-09-30T18:38:58.672 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_CODENAME=jammy
2023-09-30T18:38:58.672 INFO:teuthology.orchestra.run.smithi087.stdout:ID=ubuntu
2023-09-30T18:38:58.672 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE=debian
2023-09-30T18:38:58.672 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://www.ubuntu.com/"
2023-09-30T18:38:58.672 INFO:teuthology.orchestra.run.smithi087.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-09-30T18:38:58.672 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-09-30T18:38:58.672 INFO:teuthology.orchestra.run.smithi087.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-09-30T18:38:58.672 INFO:teuthology.orchestra.run.smithi087.stdout:UBUNTU_CODENAME=jammy
2023-09-30T18:38:58.673 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server
2023-09-30T18:38:58.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-30T18:38:58.787 INFO:teuthology.dispatcher.supervisor:Running job 7405665
2023-09-30T18:38:58.787 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_kkeithle@teuthology --archive /home/teuthworker/archive/kkeithle-2023-09-28_16:35:37-rgw:verify-wip-kkeithley-zipper-ary-distro-default-smithi/7405665 --name kkeithle-2023-09-28_16:35:37-rgw:verify-wip-kkeithley-zipper-ary-distro-default-smithi --description rgw:verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} -- /home/teuthworker/archive/kkeithle-2023-09-28_16:35:37-rgw:verify-wip-kkeithley-zipper-ary-distro-default-smithi/7405665/orig.config.yaml
2023-09-30T18:38:58.790 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/kkeithle-2023-09-28_16:35:37-rgw:verify-wip-kkeithley-zipper-ary-distro-default-smithi/7405665
2023-09-30T18:38:58.791 INFO:teuthology.dispatcher.supervisor:Job PID: 2788653
2023-09-30T18:38:58.791 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-09-30T18:40:58.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-30T18:42:58.994 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-30T18:44:59.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-30T18:46:59.330 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-30T18:48:59.493 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-30T18:50:59.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-30T18:52:59.806 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-30T18:54:59.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-30T18:57:00.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-30T18:59:00.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-30T19:01:00.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-30T19:03:00.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-30T19:05:00.812 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-30T19:07:00.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-30T19:09:01.137 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-30T19:09:01.203 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-09-30T19:09:01.313 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-09-30T19:09:01.314 INFO:teuthology.nuke:Checking targets against current locks
2023-09-30T19:09:01.362 DEBUG:teuthology.nuke:shortname: smithi029
2023-09-30T19:09:01.362 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-30T19:09:01.381 DEBUG:teuthology.nuke:shortname: smithi087
2023-09-30T19:09:01.381 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-30T19:09:01.385 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi029.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/kkeithle-2023-09-28_16:35:37-rgw:verify-wip-kkeithley-zipper-ary-distro-default-smithi/7405665', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-30 18:32:03.994082', 'locked_by': 'scheduled_kkeithle@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFVh1EtK3d7vV9mqROIUkQxG/c9wr+TqgWITaXOnOgGJHAvnsEbvakRWvrgW4E6g3eJCRMy3a/rVgU77rp0et1k='}
2023-09-30T19:09:01.409 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi087.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/kkeithle-2023-09-28_16:35:37-rgw:verify-wip-kkeithley-zipper-ary-distro-default-smithi/7405665', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-30 18:32:03.996419', 'locked_by': 'scheduled_kkeithle@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBvSBJK0wVWsOMolL1NyAzCKb7HXDpFxYZ0CXvv7Z+zZVNr7tkt5C0W7wq2Uc8K6OKVNBwhhvWxmSHuJTA2bkBA='}
2023-09-30T19:09:01.436 INFO:teuthology.orchestra.console.smithi029:Power off
2023-09-30T19:09:01.437 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-30T19:09:01.458 DEBUG:teuthology.orchestra.console.smithi029:power off output: Chassis Power Control: Down/Off
2023-09-30T19:09:01.458 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-30T19:09:01.472 INFO:teuthology.orchestra.console.smithi087:Power off
2023-09-30T19:09:01.472 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-30T19:09:01.481 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off
2023-09-30T19:09:01.493 DEBUG:teuthology.orchestra.console.smithi087:power off output: Chassis Power Control: Down/Off
2023-09-30T19:09:01.493 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-30T19:09:01.515 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is off
2023-09-30T19:09:01.582 INFO:teuthology.orchestra.console.smithi029:Power off completed
2023-09-30T19:09:01.617 INFO:teuthology.orchestra.console.smithi087:Power off completed
2023-09-30T19:09:01.743 INFO:teuthology.lock.ops:unlocked: smithi029.front.sepia.ceph.com
2023-09-30T19:09:01.768 INFO:teuthology.lock.ops:unlocked: smithi087.front.sepia.ceph.com