2023-07-27T01:49:16.196 INFO:root:teuthology version: 0.0.1.dev160+g407880c
2023-07-27T01:49:16.197 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-27T01:49:16.198 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-27T01:49:31.228 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f0356cd9d60>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f0356d693a0>, signals=[15])
2023-07-27T01:49:31.229 INFO:teuthology.lock.ops:Start node 'smithi096.front.sepia.ceph.com' reimaging
2023-07-27T01:49:31.230 INFO:teuthology.lock.ops:Updating [smithi096.front.sepia.ceph.com]: reset os type and version on server
2023-07-27T01:49:31.230 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server
2023-07-27T01:49:31.258 INFO:teuthology.lock.ops:Start node 'smithi117.front.sepia.ceph.com' reimaging
2023-07-27T01:49:31.259 INFO:teuthology.lock.ops:Updating [smithi117.front.sepia.ceph.com]: reset os type and version on server
2023-07-27T01:49:31.259 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server
2023-07-27T01:49:31.262 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /host {"name": "smithi096"}
2023-07-27T01:49:31.289 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /host {"name": "smithi117"}
2023-07-27T01:49:31.336 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /image {"name": "smithi_ubuntu_20.04"}
2023-07-27T01:49:31.368 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /image {"name": "smithi_ubuntu_20.04"}
2023-07-27T01:49:31.372 DEBUG:teuthology.provision.fog.smithi096:Requesting image smithi_ubuntu_20.04 (ID 2)
2023-07-27T01:49:31.372 DEBUG:teuthology.provision.fog.smithi096:FOG request: PUT /host/201 {"imageID": 2}
2023-07-27T01:49:31.410 INFO:teuthology.provision.fog.smithi096:Scheduling deploy of ubuntu 20.04
2023-07-27T01:49:31.410 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None
2023-07-27T01:49:31.414 DEBUG:teuthology.provision.fog.smithi117:Requesting image smithi_ubuntu_20.04 (ID 2)
2023-07-27T01:49:31.414 DEBUG:teuthology.provision.fog.smithi117:FOG request: PUT /host/222 {"imageID": 2}
2023-07-27T01:49:31.456 INFO:teuthology.provision.fog.smithi117:Scheduling deploy of ubuntu 20.04
2023-07-27T01:49:31.457 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None
2023-07-27T01:49:31.467 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /tasktype {"name": "deploy"}
2023-07-27T01:49:31.503 DEBUG:teuthology.provision.fog.smithi096:FOG request: POST /host/201/task {"taskTypeID": 1}
2023-07-27T01:49:31.506 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /tasktype {"name": "deploy"}
2023-07-27T01:49:31.544 DEBUG:teuthology.provision.fog.smithi117:FOG request: POST /host/222/task {"taskTypeID": 1}
2023-07-27T01:49:31.547 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None
2023-07-27T01:49:31.594 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None
2023-07-27T01:49:31.634 INFO:teuthology.orchestra.console:Power off smithi096
2023-07-27T01:49:31.635 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-27T01:49:31.656 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off
2023-07-27T01:49:31.657 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-27T01:49:31.679 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-27T01:49:31.690 INFO:teuthology.orchestra.console:Power off smithi117
2023-07-27T01:49:31.690 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-27T01:49:31.717 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off
2023-07-27T01:49:31.718 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-27T01:49:31.746 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-27T01:49:35.684 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-27T01:49:35.748 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-27T01:49:36.795 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-27T01:49:36.859 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-27T01:49:40.797 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-27T01:49:40.861 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-27T01:49:41.908 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-27T01:49:41.970 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-27T01:49:45.910 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-27T01:49:45.972 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-27T01:49:46.022 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-27T01:49:46.124 INFO:teuthology.orchestra.console:Power off for smithi096 completed
2023-07-27T01:49:46.225 INFO:teuthology.orchestra.console:Power on smithi096
2023-07-27T01:49:46.225 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-27T01:49:46.247 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On
2023-07-27T01:49:46.248 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-27T01:49:46.272 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-27T01:49:47.082 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-27T01:49:50.276 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-27T01:49:51.083 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-27T01:49:51.387 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-27T01:49:52.194 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-27T01:49:55.389 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-27T01:49:56.197 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-27T01:49:56.308 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-27T01:49:56.409 INFO:teuthology.orchestra.console:Power off for smithi117 completed
2023-07-27T01:49:56.497 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-27T01:49:56.510 INFO:teuthology.orchestra.console:Power on smithi117
2023-07-27T01:49:56.511 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-27T01:50:00.500 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-27T01:50:01.538 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On
2023-07-27T01:50:01.539 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-27T01:50:01.610 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-27T01:50:02.549 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-27T01:50:05.615 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-27T01:50:06.551 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-27T01:50:06.725 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-27T01:50:07.660 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-27T01:50:10.728 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-27T01:50:11.661 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-27T01:50:11.838 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-27T01:50:12.772 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-27T01:50:15.840 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-27T01:50:16.774 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-27T01:50:16.883 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-27T01:50:16.949 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-27T01:50:16.986 INFO:teuthology.orchestra.console:Power on for smithi117 completed
2023-07-27T01:50:17.086 INFO:teuthology.provision.fog.smithi117:Waiting for deploy to finish
2023-07-27T01:50:17.087 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None
2023-07-27T01:50:22.093 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-27T01:50:23.203 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-27T01:50:27.206 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-27T01:50:28.315 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-27T01:50:32.317 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-27T01:50:33.428 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-27T01:50:37.160 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None
2023-07-27T01:50:42.169 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-27T01:50:42.279 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-27T01:50:42.380 INFO:teuthology.orchestra.console:Power on for smithi096 completed
2023-07-27T01:50:42.480 INFO:teuthology.provision.fog.smithi096:Waiting for deploy to finish
2023-07-27T01:50:42.481 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None
2023-07-27T01:50:57.252 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None
2023-07-27T01:51:02.560 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None
2023-07-27T01:51:12.328 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None
2023-07-27T01:51:22.636 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None
2023-07-27T01:51:27.643 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None
2023-07-27T01:51:47.724 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None
2023-07-27T01:51:47.726 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None
2023-07-27T01:52:06.933 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None
2023-07-27T01:52:11.937 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None
2023-07-27T01:52:32.025 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None
2023-07-27T01:52:37.033 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None
2023-07-27T01:52:52.630 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None
2023-07-27T01:52:52.632 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None
2023-07-27T01:53:07.716 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None
2023-07-27T01:53:07.718 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None
2023-07-27T01:53:25.092 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None
2023-07-27T01:53:25.093 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None
2023-07-27T01:53:30.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-27T01:53:33.140 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96
2023-07-27T01:53:39.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-27T01:53:45.062 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None
2023-07-27T01:53:55.030 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96
2023-07-27T01:53:55.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-27T01:53:58.128 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117
2023-07-27T01:54:01.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-27T01:54:06.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-27T01:54:11.042 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96
2023-07-27T01:54:14.100 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117
2023-07-27T01:54:17.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-27T01:54:22.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-27T01:54:27.054 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96
2023-07-27T01:54:30.128 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117
2023-07-27T01:54:33.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-27T01:54:36.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-27T01:54:40.304 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117
2023-07-27T01:54:46.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-27T01:54:51.376 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96
2023-07-27T01:54:57.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-27T01:55:00.436 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96
2023-07-27T01:55:06.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-27T01:55:06.813 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-27T01:55:06.837 DEBUG:teuthology.orchestra.run.smithi096:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-27T01:55:22.872 INFO:teuthology.provision.fog.smithi096:Node is ready
2023-07-27T01:55:22.873 DEBUG:teuthology.orchestra.run.smithi096:> hostname
2023-07-27T01:55:22.921 INFO:teuthology.orchestra.run.smithi096.stdout:smithi129
2023-07-27T01:55:22.921 DEBUG:teuthology.orchestra.run.smithi096:> grep smithi129 /etc/hosts
2023-07-27T01:55:22.928 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.129 smithi129 smithi129
2023-07-27T01:55:22.929 DEBUG:teuthology.orchestra.run.smithi096:> sudo hostname smithi096
2023-07-27T01:55:23.029 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i -e 's/smithi129/smithi096/g' /etc/hosts
2023-07-27T01:55:23.048 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i -e 's/172.21.15.129/172.21.15.96/g' /etc/hosts
2023-07-27T01:55:23.064 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i -e 's/smithi129/smithi096/g' /etc/hostname
2023-07-27T01:55:23.078 DEBUG:teuthology.orchestra.run.smithi096:> sudo hostname smithi096
2023-07-27T01:55:23.087 DEBUG:teuthology.orchestra.run.smithi096:> cat /etc/os-release
2023-07-27T01:55:23.093 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="Ubuntu"
2023-07-27T01:55:23.093 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2023-07-27T01:55:23.093 INFO:teuthology.orchestra.run.smithi096.stdout:ID=ubuntu
2023-07-27T01:55:23.094 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE=debian
2023-07-27T01:55:23.094 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2023-07-27T01:55:23.094 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="20.04"
2023-07-27T01:55:23.094 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://www.ubuntu.com/"
2023-07-27T01:55:23.094 INFO:teuthology.orchestra.run.smithi096.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-07-27T01:55:23.094 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-07-27T01:55:23.094 INFO:teuthology.orchestra.run.smithi096.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-07-27T01:55:23.095 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_CODENAME=focal
2023-07-27T01:55:23.095 INFO:teuthology.orchestra.run.smithi096.stdout:UBUNTU_CODENAME=focal
2023-07-27T01:55:23.095 INFO:teuthology.provision.fog.smithi096:Deploy complete!
2023-07-27T01:55:23.097 DEBUG:teuthology.parallel:result is None
2023-07-27T01:55:46.335 WARNING:teuthology.provision.fog.smithi117:timed out
2023-07-27T01:55:52.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-27T01:55:52.562 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-27T01:55:52.563 DEBUG:teuthology.orchestra.run.smithi117:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-27T01:55:53.190 INFO:teuthology.provision.fog.smithi117:Node is ready
2023-07-27T01:55:53.191 DEBUG:teuthology.orchestra.run.smithi117:> hostname
2023-07-27T01:55:53.197 INFO:teuthology.orchestra.run.smithi117.stdout:smithi117.front.sepia.ceph.com
2023-07-27T01:55:53.197 DEBUG:teuthology.orchestra.run.smithi117:> grep smithi117.front.sepia.ceph.com /etc/hosts
2023-07-27T01:55:53.204 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117 smithi117.front.sepia.ceph.com smithi117
2023-07-27T01:55:53.205 DEBUG:teuthology.orchestra.run.smithi117:> sudo hostname smithi117
2023-07-27T01:55:53.354 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i -e 's/smithi117.front.sepia.ceph.com/smithi117/g' /etc/hosts
2023-07-27T01:55:53.371 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i -e 's/172.21.15.117/172.21.15.117/g' /etc/hosts
2023-07-27T01:55:53.388 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i -e 's/smithi117.front.sepia.ceph.com/smithi117/g' /etc/hostname
2023-07-27T01:55:53.401 DEBUG:teuthology.orchestra.run.smithi117:> sudo hostname smithi117
2023-07-27T01:55:53.413 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release
2023-07-27T01:55:53.460 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="Ubuntu"
2023-07-27T01:55:53.460 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2023-07-27T01:55:53.460 INFO:teuthology.orchestra.run.smithi117.stdout:ID=ubuntu
2023-07-27T01:55:53.461 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE=debian
2023-07-27T01:55:53.461 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2023-07-27T01:55:53.461 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="20.04"
2023-07-27T01:55:53.461 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://www.ubuntu.com/"
2023-07-27T01:55:53.461 INFO:teuthology.orchestra.run.smithi117.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-07-27T01:55:53.461 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-07-27T01:55:53.461 INFO:teuthology.orchestra.run.smithi117.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-07-27T01:55:53.462 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_CODENAME=focal
2023-07-27T01:55:53.462 INFO:teuthology.orchestra.run.smithi117.stdout:UBUNTU_CODENAME=focal
2023-07-27T01:55:53.462 INFO:teuthology.provision.fog.smithi117:Deploy complete!
2023-07-27T01:55:53.463 DEBUG:teuthology.parallel:result is None
2023-07-27T01:56:03.746 INFO:teuthology.lock.ops:Checking smithi096.front.sepia.ceph.com
2023-07-27T01:56:03.747 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-27T01:56:08.774 INFO:teuthology.lock.ops:Checking smithi117.front.sepia.ceph.com
2023-07-27T01:56:08.774 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-27T01:56:08.792 INFO:teuthology.lock.ops:Updating [smithi096.front.sepia.ceph.com]: set os type and version on server
2023-07-27T01:56:08.793 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com'
2023-07-27T01:56:08.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-27T01:56:08.849 DEBUG:teuthology.orchestra.run.smithi096:> true
2023-07-27T01:56:09.066 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi096.front.sepia.ceph.com'
2023-07-27T01:56:09.066 DEBUG:teuthology.orchestra.run.smithi096:> uname -m
2023-07-27T01:56:09.073 INFO:teuthology.orchestra.run.smithi096.stdout:x86_64
2023-07-27T01:56:09.074 DEBUG:teuthology.orchestra.run.smithi096:> cat /etc/os-release
2023-07-27T01:56:09.079 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="Ubuntu"
2023-07-27T01:56:09.079 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2023-07-27T01:56:09.080 INFO:teuthology.orchestra.run.smithi096.stdout:ID=ubuntu
2023-07-27T01:56:09.080 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE=debian
2023-07-27T01:56:09.080 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2023-07-27T01:56:09.080 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="20.04"
2023-07-27T01:56:09.080 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://www.ubuntu.com/"
2023-07-27T01:56:09.081 INFO:teuthology.orchestra.run.smithi096.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-07-27T01:56:09.081 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-07-27T01:56:09.081 INFO:teuthology.orchestra.run.smithi096.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-07-27T01:56:09.081 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_CODENAME=focal
2023-07-27T01:56:09.081 INFO:teuthology.orchestra.run.smithi096.stdout:UBUNTU_CODENAME=focal
2023-07-27T01:56:09.081 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server
2023-07-27T01:56:09.099 INFO:teuthology.lock.ops:Updating [smithi117.front.sepia.ceph.com]: set os type and version on server
2023-07-27T01:56:09.099 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com'
2023-07-27T01:56:09.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-27T01:56:09.154 DEBUG:teuthology.orchestra.run.smithi117:> true
2023-07-27T01:56:09.363 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com'
2023-07-27T01:56:09.364 DEBUG:teuthology.orchestra.run.smithi117:> uname -m
2023-07-27T01:56:09.370 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64
2023-07-27T01:56:09.370 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release
2023-07-27T01:56:09.376 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="Ubuntu"
2023-07-27T01:56:09.376 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2023-07-27T01:56:09.377 INFO:teuthology.orchestra.run.smithi117.stdout:ID=ubuntu
2023-07-27T01:56:09.377 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE=debian
2023-07-27T01:56:09.377 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2023-07-27T01:56:09.378 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="20.04"
2023-07-27T01:56:09.378 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://www.ubuntu.com/"
2023-07-27T01:56:09.378 INFO:teuthology.orchestra.run.smithi117.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-07-27T01:56:09.378 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-07-27T01:56:09.379 INFO:teuthology.orchestra.run.smithi117.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-07-27T01:56:09.379 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_CODENAME=focal
2023-07-27T01:56:09.379 INFO:teuthology.orchestra.run.smithi117.stdout:UBUNTU_CODENAME=focal
2023-07-27T01:56:09.379 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server
2023-07-27T01:56:14.414 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-27T01:56:14.415 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-27T01:56:14.553 INFO:teuthology.dispatcher.supervisor:Running job 7353397
2023-07-27T01:56:14.554 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-26_15:54:22-rados-wip-yuri6-testing-2023-07-24-0819-pacific-distro-default-smithi/7353397 --name yuriw-2023-07-26_15:54:22-rados-wip-yuri6-testing-2023-07-24-0819-pacific-distro-default-smithi --description rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_python} -- /home/teuthworker/archive/yuriw-2023-07-26_15:54:22-rados-wip-yuri6-testing-2023-07-24-0819-pacific-distro-default-smithi/7353397/orig.config.yaml
2023-07-27T01:56:14.558 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-07-26_15:54:22-rados-wip-yuri6-testing-2023-07-24-0819-pacific-distro-default-smithi/7353397
2023-07-27T01:56:14.559 INFO:teuthology.dispatcher.supervisor:Job PID: 1035
2023-07-27T01:56:14.559 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-07-27T01:58:14.648 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-27T01:58:14.649 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-27T02:00:19.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-27T02:00:19.835 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-27T02:02:24.996 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-27T02:02:24.997 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-27T02:04:25.206 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-27T02:04:25.206 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-27T02:06:29.280 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-27T02:06:29.281 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-27T02:08:34.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-27T02:08:34.447 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-27T02:10:39.617 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-27T02:10:39.617 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-27T02:12:44.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-27T02:12:44.787 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-27T02:14:49.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-27T02:14:49.560 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-27T02:16:54.712 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-27T02:16:54.713 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-27T02:18:59.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-27T02:18:59.212 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-27T02:21:04.401 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-27T02:21:04.402 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-27T02:23:09.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-27T02:23:09.590 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-27T02:23:14.667 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-07-27T02:23:18.615 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-07-27T02:23:18.615 INFO:teuthology.nuke:Checking targets against current locks
2023-07-27T02:23:18.657 DEBUG:teuthology.nuke:shortname: smithi096
2023-07-27T02:23:18.658 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-27T02:23:18.684 DEBUG:teuthology.nuke:shortname: smithi117
2023-07-27T02:23:18.686 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-27T02:23:18.690 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi096.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-26_15:54:22-rados-wip-yuri6-testing-2023-07-24-0819-pacific-distro-default-smithi/7353397', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-27 01:49:05.324036', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='}
2023-07-27T02:23:18.716 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi117.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-26_15:54:22-rados-wip-yuri6-testing-2023-07-24-0819-pacific-distro-default-smithi/7353397', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-27 01:49:05.322513', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'}
2023-07-27T02:23:18.743 INFO:teuthology.orchestra.console:Power off smithi096
2023-07-27T02:23:18.744 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-27T02:23:18.766 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off
2023-07-27T02:23:18.767 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-27T02:23:18.792 INFO:teuthology.orchestra.console:Power off smithi117
2023-07-27T02:23:18.793 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-27T02:23:18.805 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-27T02:23:18.817 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off
2023-07-27T02:23:18.817 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-27T02:23:18.838 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-27T02:23:18.907 INFO:teuthology.orchestra.console:Power off for smithi096 completed
2023-07-27T02:23:18.940 INFO:teuthology.orchestra.console:Power off for smithi117 completed
2023-07-27T02:23:19.069 INFO:teuthology.lock.ops:unlocked: smithi096.front.sepia.ceph.com
2023-07-27T02:23:19.097 INFO:teuthology.lock.ops:unlocked: smithi117.front.sepia.ceph.com