2023-09-15T11:38:55.633 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc
2023-09-15T11:38:55.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-15T11:38:55.765 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fc889bf2c70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fc889992c10>, signals=[15])
2023-09-15T11:38:55.767 INFO:teuthology.lock.ops:Start node 'smithi016.front.sepia.ceph.com' reimaging
2023-09-15T11:38:55.767 INFO:teuthology.lock.ops:Updating [smithi016.front.sepia.ceph.com]: reset os type and version on server
2023-09-15T11:38:55.767 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server
2023-09-15T11:38:55.787 INFO:teuthology.lock.ops:Start node 'smithi064.front.sepia.ceph.com' reimaging
2023-09-15T11:38:55.788 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: reset os type and version on server
2023-09-15T11:38:55.788 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server
2023-09-15T11:38:55.789 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /host {"name": "smithi016"}
2023-09-15T11:38:55.813 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /host {"name": "smithi064"}
2023-09-15T11:38:55.845 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-09-15T11:38:55.876 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-09-15T11:38:55.883 DEBUG:teuthology.provision.fog.smithi016:Requesting image smithi_centos_8.stream (ID 3)
2023-09-15T11:38:55.883 DEBUG:teuthology.provision.fog.smithi016:FOG request: PUT /host/122 {"imageID": 3}
2023-09-15T11:38:55.922 DEBUG:teuthology.provision.fog.smithi064:Requesting image smithi_centos_8.stream (ID 3)
2023-09-15T11:38:55.923 DEBUG:teuthology.provision.fog.smithi064:FOG request: PUT /host/169 {"imageID": 3}
2023-09-15T11:38:55.926 INFO:teuthology.provision.fog.smithi016:Scheduling deploy of centos 8.stream
2023-09-15T11:38:55.926 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None
2023-09-15T11:38:55.967 INFO:teuthology.provision.fog.smithi064:Scheduling deploy of centos 8.stream
2023-09-15T11:38:55.967 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-09-15T11:38:56.042 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /tasktype {"name": "deploy"}
2023-09-15T11:38:56.082 DEBUG:teuthology.provision.fog.smithi016:FOG request: POST /host/122/task {"taskTypeID": 1}
2023-09-15T11:38:56.089 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /tasktype {"name": "deploy"}
2023-09-15T11:38:56.127 DEBUG:teuthology.provision.fog.smithi064:FOG request: POST /host/169/task {"taskTypeID": 1}
2023-09-15T11:38:56.147 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None
2023-09-15T11:38:56.169 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-09-15T11:38:56.357 INFO:teuthology.orchestra.console.smithi016:Power off
2023-09-15T11:38:56.358 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-15T11:38:56.369 INFO:teuthology.orchestra.console.smithi064:Power off
2023-09-15T11:38:56.370 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-15T11:38:56.378 DEBUG:teuthology.orchestra.console.smithi016:power off output: Chassis Power Control: Down/Off
2023-09-15T11:38:56.378 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-15T11:38:56.391 DEBUG:teuthology.orchestra.console.smithi064:power off output: Chassis Power Control: Down/Off
2023-09-15T11:38:56.391 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-15T11:38:56.400 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is off
2023-09-15T11:38:56.413 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on
2023-09-15T11:38:56.502 INFO:teuthology.orchestra.console.smithi016:Power off completed
2023-09-15T11:38:56.602 INFO:teuthology.orchestra.console.smithi016:Power on
2023-09-15T11:38:56.603 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-15T11:38:56.623 DEBUG:teuthology.orchestra.console.smithi016:power on output: Chassis Power Control: Up/On
2023-09-15T11:38:56.623 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-15T11:38:56.643 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is off
2023-09-15T11:39:00.418 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-15T11:39:00.527 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on
2023-09-15T11:39:00.643 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-15T11:39:00.751 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is off
2023-09-15T11:39:04.532 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-15T11:39:04.642 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off
2023-09-15T11:39:04.743 INFO:teuthology.orchestra.console.smithi064:Power off completed
2023-09-15T11:39:04.752 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-15T11:39:04.844 INFO:teuthology.orchestra.console.smithi064:Power on
2023-09-15T11:39:04.844 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-15T11:39:04.861 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is on
2023-09-15T11:39:04.873 DEBUG:teuthology.orchestra.console.smithi064:power on output: Chassis Power Control: Up/On
2023-09-15T11:39:04.873 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-15T11:39:04.892 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off
2023-09-15T11:39:04.962 INFO:teuthology.orchestra.console.smithi016:Power on completed
2023-09-15T11:39:05.062 INFO:teuthology.provision.fog.smithi016:Waiting for deploy to finish
2023-09-15T11:39:05.063 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None
2023-09-15T11:39:08.894 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-15T11:39:09.002 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off
2023-09-15T11:39:13.007 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-15T11:39:13.115 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on
2023-09-15T11:39:13.216 INFO:teuthology.orchestra.console.smithi064:Power on completed
2023-09-15T11:39:13.317 INFO:teuthology.provision.fog.smithi064:Waiting for deploy to finish
2023-09-15T11:39:13.317 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-09-15T11:39:20.255 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None
2023-09-15T11:39:28.510 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-09-15T11:39:35.448 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None
2023-09-15T11:39:43.702 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-09-15T11:39:50.625 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None
2023-09-15T11:39:58.878 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-09-15T11:40:05.816 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None
2023-09-15T11:40:14.066 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-09-15T11:40:21.002 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None
2023-09-15T11:40:29.254 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-09-15T11:40:36.204 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None
2023-09-15T11:40:44.475 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-09-15T11:40:51.436 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None
2023-09-15T11:41:21.030 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-09-15T11:41:21.350 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None
2023-09-15T11:41:38.840 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-09-15T11:41:38.945 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None
2023-09-15T11:41:55.853 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-09-15T11:41:55.904 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None
2023-09-15T11:42:12.659 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None
2023-09-15T11:42:12.769 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-09-15T11:42:29.378 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None
2023-09-15T11:42:29.531 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-09-15T11:42:45.654 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None
2023-09-15T11:42:45.808 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-09-15T11:43:01.494 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None
2023-09-15T11:43:01.757 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-09-15T11:43:17.910 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None
2023-09-15T11:43:17.962 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-09-15T11:43:33.526 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None
2023-09-15T11:43:33.819 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-09-15T11:43:33.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-15T11:43:36.922 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16
2023-09-15T11:43:42.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-15T11:43:46.010 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16
2023-09-15T11:43:49.509 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-09-15T11:43:52.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-15T11:43:55.066 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16
2023-09-15T11:44:01.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-15T11:44:04.154 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16
2023-09-15T11:44:04.947 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-09-15T11:44:10.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-15T11:44:13.242 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16
2023-09-15T11:44:19.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-15T11:44:20.244 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-09-15T11:44:35.469 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-09-15T11:44:50.691 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-09-15T11:45:05.939 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-09-15T11:45:19.263 WARNING:teuthology.provision.fog.smithi016:timed out
2023-09-15T11:45:21.118 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-09-15T11:45:25.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-15T11:45:25.489 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-15T11:45:25.490 DEBUG:teuthology.orchestra.run.smithi016:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-15T11:45:25.769 INFO:teuthology.provision.fog.smithi016:Node is ready
2023-09-15T11:45:25.769 DEBUG:teuthology.orchestra.run.smithi016:> hostname
2023-09-15T11:45:25.791 INFO:teuthology.orchestra.run.smithi016.stdout:smithi016.front.sepia.ceph.com
2023-09-15T11:45:25.792 DEBUG:teuthology.orchestra.run.smithi016:> grep smithi016.front.sepia.ceph.com /etc/hosts
2023-09-15T11:45:25.851 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16 smithi016.front.sepia.ceph.com smithi016
2023-09-15T11:45:25.852 DEBUG:teuthology.orchestra.run.smithi016:> sudo hostname smithi016
2023-09-15T11:45:25.970 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i -e 's/smithi016.front.sepia.ceph.com/smithi016/g' /etc/hosts
2023-09-15T11:45:26.003 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i -e 's/172.21.15.16/172.21.15.16/g' /etc/hosts
2023-09-15T11:45:26.072 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i -e 's/smithi016.front.sepia.ceph.com/smithi016/g' /etc/hostname
2023-09-15T11:45:26.144 DEBUG:teuthology.orchestra.run.smithi016:> sudo hostname smithi016
2023-09-15T11:45:26.214 DEBUG:teuthology.orchestra.run.smithi016:> cat /etc/os-release
2023-09-15T11:45:26.274 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="CentOS Stream"
2023-09-15T11:45:26.274 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="8"
2023-09-15T11:45:26.275 INFO:teuthology.orchestra.run.smithi016.stdout:ID="centos"
2023-09-15T11:45:26.275 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE="rhel fedora"
2023-09-15T11:45:26.275 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="8"
2023-09-15T11:45:26.276 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM_ID="platform:el8"
2023-09-15T11:45:26.276 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-15T11:45:26.276 INFO:teuthology.orchestra.run.smithi016.stdout:ANSI_COLOR="0;31"
2023-09-15T11:45:26.276 INFO:teuthology.orchestra.run.smithi016.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-15T11:45:26.277 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://centos.org/"
2023-09-15T11:45:26.277 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-15T11:45:26.277 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-15T11:45:26.277 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-15T11:45:26.278 INFO:teuthology.provision.fog.smithi016:Deploy complete!
2023-09-15T11:45:26.280 DEBUG:teuthology.parallel:result is None
2023-09-15T11:45:36.320 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-09-15T11:45:51.514 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-09-15T11:46:06.714 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-09-15T11:46:21.869 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-09-15T11:46:37.008 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-09-15T11:46:52.146 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-09-15T11:47:07.269 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-09-15T11:47:22.398 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-09-15T11:47:37.522 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-09-15T11:47:52.622 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-09-15T11:47:52.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-15T11:47:55.770 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64
2023-09-15T11:48:01.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-15T11:48:04.858 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64
2023-09-15T11:48:10.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-15T11:48:13.914 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64
2023-09-15T11:48:19.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-15T11:48:23.002 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64
2023-09-15T11:48:29.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-15T11:48:32.090 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64
2023-09-15T11:48:38.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-15T11:48:41.178 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64
2023-09-15T11:48:47.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-15T11:49:05.562 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64
2023-09-15T11:49:11.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-15T11:49:14.618 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64
2023-09-15T11:49:20.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-15T11:49:21.883 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-15T11:49:21.883 DEBUG:teuthology.orchestra.run.smithi064:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-15T11:49:46.992 INFO:teuthology.provision.fog.smithi064:Node is ready
2023-09-15T11:49:46.992 DEBUG:teuthology.orchestra.run.smithi064:> hostname
2023-09-15T11:49:47.017 INFO:teuthology.orchestra.run.smithi064.stdout:smithi064.front.sepia.ceph.com
2023-09-15T11:49:47.018 DEBUG:teuthology.orchestra.run.smithi064:> grep smithi064.front.sepia.ceph.com /etc/hosts
2023-09-15T11:49:47.079 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64 smithi064.front.sepia.ceph.com smithi064
2023-09-15T11:49:47.080 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064
2023-09-15T11:49:47.209 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi064.front.sepia.ceph.com/smithi064/g' /etc/hosts
2023-09-15T11:49:47.242 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/172.21.15.64/172.21.15.64/g' /etc/hosts
2023-09-15T11:49:47.312 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi064.front.sepia.ceph.com/smithi064/g' /etc/hostname
2023-09-15T11:49:47.383 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064
2023-09-15T11:49:47.452 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release
2023-09-15T11:49:47.511 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="CentOS Stream"
2023-09-15T11:49:47.512 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="8"
2023-09-15T11:49:47.512 INFO:teuthology.orchestra.run.smithi064.stdout:ID="centos"
2023-09-15T11:49:47.512 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="rhel fedora"
2023-09-15T11:49:47.512 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="8"
2023-09-15T11:49:47.512 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el8"
2023-09-15T11:49:47.513 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-15T11:49:47.513 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31"
2023-09-15T11:49:47.513 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-15T11:49:47.513 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://centos.org/"
2023-09-15T11:49:47.513 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-15T11:49:47.514 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-15T11:49:47.514 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-15T11:49:47.514 INFO:teuthology.provision.fog.smithi064:Deploy complete!
2023-09-15T11:49:47.515 DEBUG:teuthology.parallel:result is None
2023-09-15T11:49:47.670 INFO:teuthology.lock.ops:Checking smithi016.front.sepia.ceph.com
2023-09-15T11:49:47.671 INFO:teuthology.lock.ops:New key found. Updating...
2023-09-15T11:49:47.695 INFO:teuthology.lock.ops:Checking smithi064.front.sepia.ceph.com
2023-09-15T11:49:47.696 INFO:teuthology.lock.ops:New key found. Updating...
2023-09-15T11:49:47.713 INFO:teuthology.lock.ops:Updating [smithi016.front.sepia.ceph.com]: set os type and version on server
2023-09-15T11:49:47.714 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com'
2023-09-15T11:49:47.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-15T11:49:47.783 DEBUG:teuthology.orchestra.run.smithi016:> true
2023-09-15T11:49:47.921 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi016.front.sepia.ceph.com'
2023-09-15T11:49:47.922 DEBUG:teuthology.orchestra.run.smithi016:> uname -m
2023-09-15T11:49:47.982 INFO:teuthology.orchestra.run.smithi016.stdout:x86_64
2023-09-15T11:49:47.982 DEBUG:teuthology.orchestra.run.smithi016:> cat /etc/os-release
2023-09-15T11:49:48.042 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="CentOS Stream"
2023-09-15T11:49:48.042 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="8"
2023-09-15T11:49:48.042 INFO:teuthology.orchestra.run.smithi016.stdout:ID="centos"
2023-09-15T11:49:48.043 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE="rhel fedora"
2023-09-15T11:49:48.043 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="8"
2023-09-15T11:49:48.043 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM_ID="platform:el8"
2023-09-15T11:49:48.043 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-15T11:49:48.044 INFO:teuthology.orchestra.run.smithi016.stdout:ANSI_COLOR="0;31"
2023-09-15T11:49:48.044 INFO:teuthology.orchestra.run.smithi016.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-15T11:49:48.044 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://centos.org/"
2023-09-15T11:49:48.044 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-15T11:49:48.044 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-15T11:49:48.045 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-15T11:49:48.045 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server
2023-09-15T11:49:48.071 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: set os type and version on server
2023-09-15T11:49:48.071 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com'
2023-09-15T11:49:48.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-15T11:49:48.139 DEBUG:teuthology.orchestra.run.smithi064:> true
2023-09-15T11:49:48.210 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi064.front.sepia.ceph.com'
2023-09-15T11:49:48.210 DEBUG:teuthology.orchestra.run.smithi064:> uname -m
2023-09-15T11:49:48.269 INFO:teuthology.orchestra.run.smithi064.stdout:x86_64
2023-09-15T11:49:48.269 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release
2023-09-15T11:49:48.328 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="CentOS Stream"
2023-09-15T11:49:48.328 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="8"
2023-09-15T11:49:48.328 INFO:teuthology.orchestra.run.smithi064.stdout:ID="centos"
2023-09-15T11:49:48.329 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="rhel fedora"
2023-09-15T11:49:48.329 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="8"
2023-09-15T11:49:48.329 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el8"
2023-09-15T11:49:48.329 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-15T11:49:48.329 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31"
2023-09-15T11:49:48.330 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-15T11:49:48.330 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://centos.org/"
2023-09-15T11:49:48.330 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-15T11:49:48.330 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-15T11:49:48.330 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-15T11:49:48.331 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server
2023-09-15T11:49:48.354 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-15T11:49:48.454 INFO:teuthology.dispatcher.supervisor:Running job 7396942
2023-09-15T11:49:48.454 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_rfriedma@teuthology --archive /home/teuthworker/archive/rfriedma-2023-09-15_11:34:08-rados:thrash-wip-rf-squeue2-distro-default-smithi/7396942 --name rfriedma-2023-09-15_11:34:08-rados:thrash-wip-rf-squeue2-distro-default-smithi --description rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-agent-big} -- /home/teuthworker/archive/rfriedma-2023-09-15_11:34:08-rados:thrash-wip-rf-squeue2-distro-default-smithi/7396942/orig.config.yaml
2023-09-15T11:49:48.457 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rfriedma-2023-09-15_11:34:08-rados:thrash-wip-rf-squeue2-distro-default-smithi/7396942
2023-09-15T11:49:48.458 INFO:teuthology.dispatcher.supervisor:Job PID: 711931
2023-09-15T11:49:48.458 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-09-15T11:51:48.558 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-15T11:53:48.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-15T11:55:48.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-15T11:57:49.086 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-15T11:59:49.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-15T12:01:49.427 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-15T12:03:49.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-15T12:05:49.654 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-15T12:05:49.732 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-09-15T12:05:49.826 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-09-15T12:05:49.827 INFO:teuthology.nuke:Checking targets against current locks
2023-09-15T12:05:49.869 DEBUG:teuthology.nuke:shortname: smithi016
2023-09-15T12:05:49.869 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-15T12:05:49.887 DEBUG:teuthology.nuke:shortname: smithi064
2023-09-15T12:05:49.887 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-15T12:05:49.888 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi016.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rfriedma-2023-09-15_11:34:08-rados:thrash-wip-rf-squeue2-distro-default-smithi/7396942', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-15 11:38:54.875852', 'locked_by': 'scheduled_rfriedma@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBETg6WojzsoQNtNK0g+8FeWOmfOsbprmIIFN+3inLgX2edqz3kit0BMlQ6Obqcl0Jr/DBLtWTy6aohVxPA9kjnI='}
2023-09-15T12:05:49.906 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi064.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rfriedma-2023-09-15_11:34:08-rados:thrash-wip-rf-squeue2-distro-default-smithi/7396942', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-15 11:38:54.874634', 'locked_by': 'scheduled_rfriedma@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKYe7Tn1KTe3wh4JyodLue38cyGWdXjUDLLpoZQvmB6RMGbtrlHDi5WpCmotAqsDmU10LpSDy3UURZwhh2oHJKo='}
2023-09-15T12:05:49.931 INFO:teuthology.orchestra.console.smithi016:Power off
2023-09-15T12:05:49.932 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-15T12:05:49.952 DEBUG:teuthology.orchestra.console.smithi016:power off output: Chassis Power Control: Down/Off
2023-09-15T12:05:49.952 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-15T12:05:49.964 INFO:teuthology.orchestra.console.smithi064:Power off
2023-09-15T12:05:49.964 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-15T12:05:49.972 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is off
2023-09-15T12:05:49.983 DEBUG:teuthology.orchestra.console.smithi064:power off output: Chassis Power Control: Down/Off
2023-09-15T12:05:49.983 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-15T12:05:50.002 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off
2023-09-15T12:05:50.073 INFO:teuthology.orchestra.console.smithi016:Power off completed
2023-09-15T12:05:50.103 INFO:teuthology.orchestra.console.smithi064:Power off completed
2023-09-15T12:05:50.220 INFO:teuthology.lock.ops:unlocked: smithi016.front.sepia.ceph.com
2023-09-15T12:05:50.254 INFO:teuthology.lock.ops:unlocked: smithi064.front.sepia.ceph.com