2023-10-11T23:55:31.252 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07
2023-10-11T23:55:31.254 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-11T23:55:31.394 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fd51d36cb50>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fd51de6f670>, signals=[15])
2023-10-11T23:55:31.400 INFO:teuthology.lock.ops:Start node 'smithi112.front.sepia.ceph.com' reimaging
2023-10-11T23:55:31.401 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: reset os type and version on server
2023-10-11T23:55:31.401 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server
2023-10-11T23:55:31.426 INFO:teuthology.lock.ops:Start node 'smithi118.front.sepia.ceph.com' reimaging
2023-10-11T23:55:31.427 INFO:teuthology.lock.ops:Updating [smithi118.front.sepia.ceph.com]: reset os type and version on server
2023-10-11T23:55:31.427 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server
2023-10-11T23:55:31.429 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /host {"name": "smithi112"}
2023-10-11T23:55:31.453 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /host {"name": "smithi118"}
2023-10-11T23:55:31.505 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-10-11T23:55:31.524 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-10-11T23:55:31.547 DEBUG:teuthology.provision.fog.smithi112:Requesting image smithi_centos_8.stream (ID 3)
2023-10-11T23:55:31.547 DEBUG:teuthology.provision.fog.smithi112:FOG request: PUT /host/217 {"imageID": 3}
2023-10-11T23:55:31.571 DEBUG:teuthology.provision.fog.smithi118:Requesting image smithi_centos_8.stream (ID 3)
2023-10-11T23:55:31.572 DEBUG:teuthology.provision.fog.smithi118:FOG request: PUT /host/223 {"imageID": 3}
2023-10-11T23:55:31.596 INFO:teuthology.provision.fog.smithi112:Scheduling deploy of centos 8.stream
2023-10-11T23:55:31.596 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-10-11T23:55:31.617 INFO:teuthology.provision.fog.smithi118:Scheduling deploy of centos 8.stream
2023-10-11T23:55:31.617 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None
2023-10-11T23:55:31.649 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /tasktype {"name": "deploy"}
2023-10-11T23:55:31.669 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /tasktype {"name": "deploy"}
2023-10-11T23:55:31.690 DEBUG:teuthology.provision.fog.smithi112:FOG request: POST /host/217/task {"taskTypeID": 1}
2023-10-11T23:55:31.709 DEBUG:teuthology.provision.fog.smithi118:FOG request: POST /host/223/task {"taskTypeID": 1}
2023-10-11T23:55:31.752 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-10-11T23:55:31.763 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None
2023-10-11T23:55:31.854 INFO:teuthology.orchestra.console.smithi118:Power off
2023-10-11T23:55:31.855 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-11T23:55:31.870 INFO:teuthology.orchestra.console.smithi112:Power off
2023-10-11T23:55:31.870 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-11T23:55:31.887 DEBUG:teuthology.orchestra.console.smithi118:power off output: Chassis Power Control: Down/Off
2023-10-11T23:55:31.888 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-11T23:55:31.913 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on
2023-10-11T23:55:31.921 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off
2023-10-11T23:55:31.921 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-11T23:55:31.952 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on
2023-10-11T23:55:35.918 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-11T23:55:35.954 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-11T23:55:36.028 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on
2023-10-11T23:55:36.065 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on
2023-10-11T23:55:40.030 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-11T23:55:40.066 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-11T23:55:40.141 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off
2023-10-11T23:55:40.175 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on
2023-10-11T23:55:40.242 INFO:teuthology.orchestra.console.smithi118:Power off completed
2023-10-11T23:55:40.342 INFO:teuthology.orchestra.console.smithi118:Power on
2023-10-11T23:55:40.343 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-11T23:55:40.364 DEBUG:teuthology.orchestra.console.smithi118:power on output: Chassis Power Control: Up/On
2023-10-11T23:55:40.365 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-11T23:55:40.385 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off
2023-10-11T23:55:44.178 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-11T23:55:44.287 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off
2023-10-11T23:55:44.386 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-11T23:55:44.394 INFO:teuthology.orchestra.console.smithi112:Power off completed
2023-10-11T23:55:44.495 INFO:teuthology.orchestra.console.smithi112:Power on
2023-10-11T23:55:44.495 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-11T23:55:44.505 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off
2023-10-11T23:55:44.518 DEBUG:teuthology.orchestra.console.smithi112:power on output: Chassis Power Control: Up/On
2023-10-11T23:55:44.519 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-11T23:55:44.543 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off
2023-10-11T23:55:48.510 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-11T23:55:48.545 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-11T23:55:48.619 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on
2023-10-11T23:55:48.656 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off
2023-10-11T23:55:48.721 INFO:teuthology.orchestra.console.smithi118:Power on completed
2023-10-11T23:55:48.822 INFO:teuthology.provision.fog.smithi118:Waiting for deploy to finish
2023-10-11T23:55:48.822 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None
2023-10-11T23:55:52.658 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-11T23:55:52.769 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on
2023-10-11T23:55:52.870 INFO:teuthology.orchestra.console.smithi112:Power on completed
2023-10-11T23:55:52.971 INFO:teuthology.provision.fog.smithi112:Waiting for deploy to finish
2023-10-11T23:55:52.971 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-10-11T23:56:03.898 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None
2023-10-11T23:56:08.042 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-10-11T23:56:18.974 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None
2023-10-11T23:56:23.115 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-10-11T23:56:34.059 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None
2023-10-11T23:56:38.204 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-10-11T23:56:49.138 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None
2023-10-11T23:56:53.304 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-10-11T23:57:04.226 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None
2023-10-11T23:57:08.380 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-10-11T23:57:19.324 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None
2023-10-11T23:57:23.470 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-10-11T23:57:34.414 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None
2023-10-11T23:57:38.554 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-10-11T23:57:49.534 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None
2023-10-11T23:57:53.659 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-10-11T23:58:04.642 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None
2023-10-11T23:58:08.770 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-10-11T23:58:19.734 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None
2023-10-11T23:58:23.866 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-10-11T23:58:23.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-11T23:58:24.047 ERROR:teuthology.orchestra.connection:Error authenticating with smithi112.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-10-11T23:58:34.844 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None
2023-10-11T23:58:49.933 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None
2023-10-11T23:59:05.025 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None
2023-10-11T23:59:05.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-11T23:59:23.514 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118
2023-10-11T23:59:28.095 WARNING:teuthology.provision.fog.smithi112:timed out
2023-10-11T23:59:29.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-11T23:59:32.570 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118
2023-10-11T23:59:34.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-11T23:59:38.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-11T23:59:41.626 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118
2023-10-11T23:59:47.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-11T23:59:50.686 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118
2023-10-11T23:59:52.442 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2023-10-11T23:59:56.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-11T23:59:58.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-11T23:59:59.742 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118
2023-10-12T00:00:01.498 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2023-10-12T00:00:05.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-12T00:00:07.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-12T00:00:07.716 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-12T00:00:07.717 DEBUG:teuthology.orchestra.run.smithi112:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-12T00:00:08.794 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118
2023-10-12T00:00:14.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-12T00:00:28.056 INFO:teuthology.provision.fog.smithi112:Node is ready
2023-10-12T00:00:28.056 DEBUG:teuthology.orchestra.run.smithi112:> hostname
2023-10-12T00:00:28.120 INFO:teuthology.orchestra.run.smithi112.stdout:smithi112.front.sepia.ceph.com
2023-10-12T00:00:28.121 DEBUG:teuthology.orchestra.run.smithi112:> grep smithi112.front.sepia.ceph.com /etc/hosts
2023-10-12T00:00:28.183 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112 smithi112.front.sepia.ceph.com smithi112
2023-10-12T00:00:28.183 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112
2023-10-12T00:00:28.307 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hosts
2023-10-12T00:00:28.339 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/172.21.15.112/172.21.15.112/g' /etc/hosts
2023-10-12T00:00:28.410 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hostname
2023-10-12T00:00:28.481 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112
2023-10-12T00:00:28.551 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release
2023-10-12T00:00:28.610 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream"
2023-10-12T00:00:28.611 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="8"
2023-10-12T00:00:28.611 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos"
2023-10-12T00:00:28.611 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora"
2023-10-12T00:00:28.611 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="8"
2023-10-12T00:00:28.612 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el8"
2023-10-12T00:00:28.612 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 8"
2023-10-12T00:00:28.612 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31"
2023-10-12T00:00:28.612 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-10-12T00:00:28.612 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/"
2023-10-12T00:00:28.612 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-12T00:00:28.613 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-12T00:00:28.613 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-12T00:00:28.614 INFO:teuthology.provision.fog.smithi112:Deploy complete!
2023-10-12T00:00:28.615 DEBUG:teuthology.parallel:result is None
2023-10-12T00:01:14.799 WARNING:teuthology.provision.fog.smithi118:timed out
2023-10-12T00:01:20.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-12T00:01:21.034 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-12T00:01:21.034 DEBUG:teuthology.orchestra.run.smithi118:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-12T00:01:21.277 INFO:teuthology.provision.fog.smithi118:Node is ready
2023-10-12T00:01:21.278 DEBUG:teuthology.orchestra.run.smithi118:> hostname
2023-10-12T00:01:21.299 INFO:teuthology.orchestra.run.smithi118.stdout:smithi118.front.sepia.ceph.com
2023-10-12T00:01:21.300 DEBUG:teuthology.orchestra.run.smithi118:> grep smithi118.front.sepia.ceph.com /etc/hosts
2023-10-12T00:01:21.362 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118 smithi118.front.sepia.ceph.com smithi118
2023-10-12T00:01:21.362 DEBUG:teuthology.orchestra.run.smithi118:> sudo hostname smithi118
2023-10-12T00:01:21.472 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/smithi118.front.sepia.ceph.com/smithi118/g' /etc/hosts
2023-10-12T00:01:21.507 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/172.21.15.118/172.21.15.118/g' /etc/hosts
2023-10-12T00:01:21.582 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/smithi118.front.sepia.ceph.com/smithi118/g' /etc/hostname
2023-10-12T00:01:21.655 DEBUG:teuthology.orchestra.run.smithi118:> sudo hostname smithi118
2023-10-12T00:01:21.727 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release
2023-10-12T00:01:21.788 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="CentOS Stream"
2023-10-12T00:01:21.789 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="8"
2023-10-12T00:01:21.789 INFO:teuthology.orchestra.run.smithi118.stdout:ID="centos"
2023-10-12T00:01:21.790 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="rhel fedora"
2023-10-12T00:01:21.790 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="8"
2023-10-12T00:01:21.790 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el8"
2023-10-12T00:01:21.791 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="CentOS Stream 8"
2023-10-12T00:01:21.791 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31"
2023-10-12T00:01:21.792 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-10-12T00:01:21.792 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://centos.org/"
2023-10-12T00:01:21.792 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-12T00:01:21.793 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-12T00:01:21.793 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-12T00:01:21.794 INFO:teuthology.provision.fog.smithi118:Deploy complete!
2023-10-12T00:01:21.794 DEBUG:teuthology.parallel:result is None
2023-10-12T00:01:21.945 INFO:teuthology.lock.ops:Checking smithi112.front.sepia.ceph.com
2023-10-12T00:01:21.946 INFO:teuthology.lock.ops:New key found. Updating...
2023-10-12T00:01:21.980 INFO:teuthology.lock.ops:Checking smithi118.front.sepia.ceph.com
2023-10-12T00:01:21.980 INFO:teuthology.lock.ops:New key found. Updating...
2023-10-12T00:01:22.005 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: set os type and version on server
2023-10-12T00:01:22.006 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com'
2023-10-12T00:01:22.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-12T00:01:22.072 DEBUG:teuthology.orchestra.run.smithi112:> true
2023-10-12T00:01:22.209 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com'
2023-10-12T00:01:22.210 DEBUG:teuthology.orchestra.run.smithi112:> uname -m
2023-10-12T00:01:22.268 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64
2023-10-12T00:01:22.268 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release
2023-10-12T00:01:22.326 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream"
2023-10-12T00:01:22.327 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="8"
2023-10-12T00:01:22.327 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos"
2023-10-12T00:01:22.327 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora"
2023-10-12T00:01:22.327 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="8"
2023-10-12T00:01:22.328 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el8"
2023-10-12T00:01:22.328 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 8"
2023-10-12T00:01:22.328 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31"
2023-10-12T00:01:22.328 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-10-12T00:01:22.328 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/"
2023-10-12T00:01:22.329 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-12T00:01:22.329 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-12T00:01:22.329 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-12T00:01:22.330 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server
2023-10-12T00:01:22.353 INFO:teuthology.lock.ops:Updating [smithi118.front.sepia.ceph.com]: set os type and version on server
2023-10-12T00:01:22.353 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com'
2023-10-12T00:01:22.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-12T00:01:22.423 DEBUG:teuthology.orchestra.run.smithi118:> true
2023-10-12T00:01:22.496 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com'
2023-10-12T00:01:22.497 DEBUG:teuthology.orchestra.run.smithi118:> uname -m
2023-10-12T00:01:22.558 INFO:teuthology.orchestra.run.smithi118.stdout:x86_64
2023-10-12T00:01:22.559 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release
2023-10-12T00:01:22.621 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="CentOS Stream"
2023-10-12T00:01:22.621 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="8"
2023-10-12T00:01:22.621 INFO:teuthology.orchestra.run.smithi118.stdout:ID="centos"
2023-10-12T00:01:22.621 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="rhel fedora"
2023-10-12T00:01:22.622 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="8"
2023-10-12T00:01:22.622 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el8"
2023-10-12T00:01:22.622 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="CentOS Stream 8"
2023-10-12T00:01:22.622 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31"
2023-10-12T00:01:22.622 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-10-12T00:01:22.623 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://centos.org/"
2023-10-12T00:01:22.623 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-12T00:01:22.623 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-12T00:01:22.623 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-12T00:01:22.624 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server
2023-10-12T00:01:22.654 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T00:01:22.759 INFO:teuthology.dispatcher.supervisor:Running job 7422157
2023-10-12T00:01:22.759 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-11_18:32:33-rgw-wip-yuri-testing-2023-10-10-0840-reef-distro-default-smithi/7422157 --name yuriw-2023-10-11_18:32:33-rgw-wip-yuri-testing-2023-10-10-0840-reef-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/two-zonegroup supported-random-distro$/{centos_8} tasks/test_multi} -- /home/teuthworker/archive/yuriw-2023-10-11_18:32:33-rgw-wip-yuri-testing-2023-10-10-0840-reef-distro-default-smithi/7422157/orig.config.yaml
2023-10-12T00:01:22.762 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-10-11_18:32:33-rgw-wip-yuri-testing-2023-10-10-0840-reef-distro-default-smithi/7422157
2023-10-12T00:01:22.764 INFO:teuthology.dispatcher.supervisor:Job PID: 2265082
2023-10-12T00:01:22.764 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-10-12T00:03:22.766 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T00:05:22.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T00:07:22.902 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T00:09:22.965 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T00:11:23.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T00:13:23.101 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T00:15:23.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T00:17:23.242 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T00:19:23.313 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T00:21:23.382 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T00:23:23.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T00:25:23.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T00:27:23.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T00:29:23.652 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T00:31:23.729 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T00:33:23.797 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T00:35:23.860 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T00:37:23.926 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T00:39:23.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T00:41:24.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T00:43:24.136 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T00:45:24.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T00:47:24.286 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T00:49:24.357 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T00:51:24.426 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T00:53:24.509 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T00:55:24.582 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T00:57:24.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T00:59:24.914 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T01:01:24.978 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T01:03:25.042 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T01:05:25.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T01:07:25.184 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T01:09:25.266 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T01:11:25.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T01:13:25.398 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T01:15:25.472 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T01:17:25.548 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T01:19:25.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T01:21:25.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T01:23:25.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T01:25:25.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T01:27:25.910 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T01:29:25.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T01:31:26.049 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T01:33:26.115 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T01:35:26.189 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T01:37:26.256 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T01:39:26.322 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T01:41:26.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T01:43:26.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T01:45:26.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T01:47:26.613 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T01:49:26.686 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T01:51:26.753 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T01:53:26.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T01:55:26.894 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T01:57:26.972 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T01:59:27.037 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T02:01:27.116 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T02:03:27.181 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T02:05:27.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T02:07:27.333 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T02:09:27.406 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T02:11:27.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T02:11:27.547 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-10-12T02:11:27.743 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-10-12T02:11:27.744 INFO:teuthology.nuke:Checking targets against current locks
2023-10-12T02:11:27.798 DEBUG:teuthology.nuke:shortname: smithi112
2023-10-12T02:11:27.798 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-12T02:11:27.819 DEBUG:teuthology.nuke:shortname: smithi118
2023-10-12T02:11:27.820 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-12T02:11:27.823 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-11_18:32:33-rgw-wip-yuri-testing-2023-10-10-0840-reef-distro-default-smithi/7422157', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-11 23:55:30.444168', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG2JLp2+vfzHVyxL6Acrw4wk1jHYH8MuiL4DWD9tM4S7ijSMYlbEw5+h08dafiwWGRp9Fogc9JG7tebz2ws0vSE='}
2023-10-12T02:11:27.845 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-11_18:32:33-rgw-wip-yuri-testing-2023-10-10-0840-reef-distro-default-smithi/7422157', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-11 23:55:30.442643', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLZJXmqjfBSt/G/tZUHbg1vA/GOsb80hVRDsm9AHTjNE85QX13Lf8BegOL5Bji68NC+JX6KnRItmilTlMA9TtVA='}
2023-10-12T02:11:27.874 INFO:teuthology.orchestra.console.smithi112:Power off
2023-10-12T02:11:27.875 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-12T02:11:27.897 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off
2023-10-12T02:11:27.897 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-12T02:11:27.915 INFO:teuthology.orchestra.console.smithi118:Power off
2023-10-12T02:11:27.916 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-12T02:11:27.924 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off
2023-10-12T02:11:27.936 DEBUG:teuthology.orchestra.console.smithi118:power off output: Chassis Power Control: Down/Off
2023-10-12T02:11:27.937 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-12T02:11:27.957 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off
2023-10-12T02:11:28.025 INFO:teuthology.orchestra.console.smithi112:Power off completed
2023-10-12T02:11:28.058 INFO:teuthology.orchestra.console.smithi118:Power off completed
2023-10-12T02:11:28.171 INFO:teuthology.lock.ops:unlocked: smithi112.front.sepia.ceph.com
2023-10-12T02:11:28.203 INFO:teuthology.lock.ops:unlocked: smithi118.front.sepia.ceph.com