2023-09-21T21:31:00.810 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc
2023-09-21T21:31:00.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T21:31:00.949 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f82b20acaf0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f82b2b96670>, signals=[15])
2023-09-21T21:31:00.950 INFO:teuthology.lock.ops:Start node 'smithi148.front.sepia.ceph.com' reimaging
2023-09-21T21:31:00.950 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: reset os type and version on server
2023-09-21T21:31:00.950 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server
2023-09-21T21:31:00.976 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging
2023-09-21T21:31:00.976 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server
2023-09-21T21:31:00.976 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server
2023-09-21T21:31:00.977 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /host {"name": "smithi148"}
2023-09-21T21:31:01.000 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /host {"name": "smithi161"}
2023-09-21T21:31:01.055 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-09-21T21:31:01.063 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-09-21T21:31:01.104 DEBUG:teuthology.provision.fog.smithi161:Requesting image smithi_centos_9.stream (ID 10)
2023-09-21T21:31:01.105 DEBUG:teuthology.provision.fog.smithi161:FOG request: PUT /host/266 {"imageID": 10}
2023-09-21T21:31:01.108 DEBUG:teuthology.provision.fog.smithi148:Requesting image smithi_centos_9.stream (ID 10)
2023-09-21T21:31:01.108 DEBUG:teuthology.provision.fog.smithi148:FOG request: PUT /host/253 {"imageID": 10}
2023-09-21T21:31:01.146 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of centos 9.stream
2023-09-21T21:31:01.146 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-09-21T21:31:01.151 INFO:teuthology.provision.fog.smithi148:Scheduling deploy of centos 9.stream
2023-09-21T21:31:01.151 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None
2023-09-21T21:31:01.191 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /tasktype {"name": "deploy"}
2023-09-21T21:31:01.194 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /tasktype {"name": "deploy"}
2023-09-21T21:31:01.226 DEBUG:teuthology.provision.fog.smithi148:FOG request: POST /host/253/task {"taskTypeID": 1}
2023-09-21T21:31:01.229 DEBUG:teuthology.provision.fog.smithi161:FOG request: POST /host/266/task {"taskTypeID": 1}
2023-09-21T21:31:01.283 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-09-21T21:31:01.399 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None
2023-09-21T21:31:01.442 INFO:teuthology.orchestra.console.smithi161:Power off
2023-09-21T21:31:01.443 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T21:31:01.477 INFO:teuthology.orchestra.console.smithi148:Power off
2023-09-21T21:31:01.478 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T21:31:01.486 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off
2023-09-21T21:31:01.486 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T21:31:01.497 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off
2023-09-21T21:31:01.498 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T21:31:01.506 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on
2023-09-21T21:31:01.518 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on
2023-09-21T21:31:05.511 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T21:31:05.519 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T21:31:05.620 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on
2023-09-21T21:31:05.626 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on
2023-09-21T21:31:09.623 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T21:31:09.629 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T21:31:09.731 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off
2023-09-21T21:31:09.736 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on
2023-09-21T21:31:09.833 INFO:teuthology.orchestra.console.smithi161:Power off completed
2023-09-21T21:31:09.933 INFO:teuthology.orchestra.console.smithi161:Power on
2023-09-21T21:31:09.934 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-21T21:31:09.954 DEBUG:teuthology.orchestra.console.smithi161:power on output: Chassis Power Control: Up/On
2023-09-21T21:31:09.955 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T21:31:09.976 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off
2023-09-21T21:31:13.738 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T21:31:13.846 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off
2023-09-21T21:31:13.946 INFO:teuthology.orchestra.console.smithi148:Power off completed
2023-09-21T21:31:13.977 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T21:31:14.048 INFO:teuthology.orchestra.console.smithi148:Power on
2023-09-21T21:31:14.048 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-21T21:31:14.067 DEBUG:teuthology.orchestra.console.smithi148:power on output: Chassis Power Control: Up/On
2023-09-21T21:31:14.068 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T21:31:14.085 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off
2023-09-21T21:31:14.088 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off
2023-09-21T21:31:18.090 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T21:31:18.097 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T21:31:18.198 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on
2023-09-21T21:31:18.204 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on
2023-09-21T21:31:18.300 INFO:teuthology.orchestra.console.smithi161:Power on completed
2023-09-21T21:31:18.305 INFO:teuthology.orchestra.console.smithi148:Power on completed
2023-09-21T21:31:18.401 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish
2023-09-21T21:31:18.401 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-09-21T21:31:18.406 INFO:teuthology.provision.fog.smithi148:Waiting for deploy to finish
2023-09-21T21:31:18.406 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None
2023-09-21T21:31:33.479 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None
2023-09-21T21:31:33.480 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-09-21T21:31:48.554 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-09-21T21:31:48.555 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None
2023-09-21T21:32:03.634 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None
2023-09-21T21:32:03.635 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-09-21T21:32:18.712 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-09-21T21:32:18.713 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None
2023-09-21T21:32:33.798 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None
2023-09-21T21:32:33.799 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-09-21T21:32:48.883 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None
2023-09-21T21:32:48.884 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-09-21T21:33:03.958 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None
2023-09-21T21:33:03.959 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-09-21T21:33:19.035 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-09-21T21:33:19.036 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None
2023-09-21T21:33:34.118 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-09-21T21:33:34.119 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None
2023-09-21T21:33:49.198 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None
2023-09-21T21:33:49.199 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-09-21T21:33:49.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-21T21:34:04.274 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None
2023-09-21T21:34:04.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-21T21:34:07.738 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-09-21T21:34:13.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-21T21:34:16.794 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-09-21T21:34:22.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-21T21:34:22.842 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148
2023-09-21T21:34:25.886 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-09-21T21:34:28.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-21T21:34:31.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-21T21:34:31.898 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148
2023-09-21T21:34:34.970 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-09-21T21:34:37.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-21T21:34:40.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-21T21:34:41.210 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148
2023-09-21T21:34:44.026 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-09-21T21:34:47.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-21T21:34:50.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-21T21:34:50.266 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148
2023-09-21T21:34:56.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-21T21:34:59.322 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148
2023-09-21T21:35:05.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-21T21:35:50.074 WARNING:teuthology.provision.fog.smithi161:timed out
2023-09-21T21:35:56.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-21T21:35:56.500 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-21T21:35:56.501 DEBUG:teuthology.orchestra.run.smithi161:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-21T21:35:56.823 INFO:teuthology.provision.fog.smithi161:Node is ready
2023-09-21T21:35:56.823 DEBUG:teuthology.orchestra.run.smithi161:> hostname
2023-09-21T21:35:56.837 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161.front.sepia.ceph.com
2023-09-21T21:35:56.837 DEBUG:teuthology.orchestra.run.smithi161:> grep smithi161.front.sepia.ceph.com /etc/hosts
2023-09-21T21:35:56.892 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161
2023-09-21T21:35:56.892 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161
2023-09-21T21:35:57.020 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hosts
2023-09-21T21:35:57.048 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/172.21.15.161/172.21.15.161/g' /etc/hosts
2023-09-21T21:35:57.115 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hostname
2023-09-21T21:35:57.182 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161
2023-09-21T21:35:57.248 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release
2023-09-21T21:35:57.302 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream"
2023-09-21T21:35:57.302 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="9"
2023-09-21T21:35:57.302 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos"
2023-09-21T21:35:57.302 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora"
2023-09-21T21:35:57.302 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="9"
2023-09-21T21:35:57.303 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el9"
2023-09-21T21:35:57.303 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 9"
2023-09-21T21:35:57.303 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31"
2023-09-21T21:35:57.303 INFO:teuthology.orchestra.run.smithi161.stdout:LOGO="fedora-logo-icon"
2023-09-21T21:35:57.303 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-09-21T21:35:57.303 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/"
2023-09-21T21:35:57.303 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-21T21:35:57.303 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-09-21T21:35:57.303 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-21T21:35:57.304 INFO:teuthology.provision.fog.smithi161:Deploy complete!
2023-09-21T21:35:57.305 DEBUG:teuthology.parallel:result is None
2023-09-21T21:36:05.473 WARNING:teuthology.provision.fog.smithi148:timed out
2023-09-21T21:36:11.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-21T21:36:11.709 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-21T21:36:11.709 DEBUG:teuthology.orchestra.run.smithi148:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-21T21:36:12.053 INFO:teuthology.provision.fog.smithi148:Node is ready
2023-09-21T21:36:12.054 DEBUG:teuthology.orchestra.run.smithi148:> hostname
2023-09-21T21:36:12.068 INFO:teuthology.orchestra.run.smithi148.stdout:smithi148.front.sepia.ceph.com
2023-09-21T21:36:12.068 DEBUG:teuthology.orchestra.run.smithi148:> grep smithi148.front.sepia.ceph.com /etc/hosts
2023-09-21T21:36:12.124 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148 smithi148.front.sepia.ceph.com smithi148
2023-09-21T21:36:12.124 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148
2023-09-21T21:36:12.231 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148.front.sepia.ceph.com/smithi148/g' /etc/hosts
2023-09-21T21:36:12.259 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/172.21.15.148/172.21.15.148/g' /etc/hosts
2023-09-21T21:36:12.325 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148.front.sepia.ceph.com/smithi148/g' /etc/hostname
2023-09-21T21:36:12.392 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148
2023-09-21T21:36:12.459 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release
2023-09-21T21:36:12.513 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="CentOS Stream"
2023-09-21T21:36:12.513 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="9"
2023-09-21T21:36:12.513 INFO:teuthology.orchestra.run.smithi148.stdout:ID="centos"
2023-09-21T21:36:12.513 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="rhel fedora"
2023-09-21T21:36:12.513 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="9"
2023-09-21T21:36:12.513 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el9"
2023-09-21T21:36:12.513 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="CentOS Stream 9"
2023-09-21T21:36:12.513 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31"
2023-09-21T21:36:12.513 INFO:teuthology.orchestra.run.smithi148.stdout:LOGO="fedora-logo-icon"
2023-09-21T21:36:12.513 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-09-21T21:36:12.514 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://centos.org/"
2023-09-21T21:36:12.514 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-21T21:36:12.514 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-09-21T21:36:12.514 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-21T21:36:12.514 INFO:teuthology.provision.fog.smithi148:Deploy complete!
2023-09-21T21:36:12.514 DEBUG:teuthology.parallel:result is None
2023-09-21T21:36:12.673 INFO:teuthology.lock.ops:Checking smithi148.front.sepia.ceph.com
2023-09-21T21:36:12.673 INFO:teuthology.lock.ops:New key found. Updating...
2023-09-21T21:36:12.695 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com
2023-09-21T21:36:12.695 INFO:teuthology.lock.ops:New key found. Updating...
2023-09-21T21:36:12.713 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: set os type and version on server
2023-09-21T21:36:12.713 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com'
2023-09-21T21:36:12.713 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-21T21:36:12.794 DEBUG:teuthology.orchestra.run.smithi148:> true
2023-09-21T21:36:12.864 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com'
2023-09-21T21:36:12.864 DEBUG:teuthology.orchestra.run.smithi148:> uname -m
2023-09-21T21:36:12.919 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64
2023-09-21T21:36:12.919 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release
2023-09-21T21:36:12.973 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="CentOS Stream"
2023-09-21T21:36:12.973 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="9"
2023-09-21T21:36:12.973 INFO:teuthology.orchestra.run.smithi148.stdout:ID="centos"
2023-09-21T21:36:12.973 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="rhel fedora"
2023-09-21T21:36:12.974 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="9"
2023-09-21T21:36:12.974 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el9"
2023-09-21T21:36:12.974 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="CentOS Stream 9"
2023-09-21T21:36:12.974 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31"
2023-09-21T21:36:12.974 INFO:teuthology.orchestra.run.smithi148.stdout:LOGO="fedora-logo-icon"
2023-09-21T21:36:12.974 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-09-21T21:36:12.974 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://centos.org/"
2023-09-21T21:36:12.974 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-21T21:36:12.974 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-09-21T21:36:12.975 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-21T21:36:12.975 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server
2023-09-21T21:36:12.995 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server
2023-09-21T21:36:12.995 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com'
2023-09-21T21:36:12.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-21T21:36:13.078 DEBUG:teuthology.orchestra.run.smithi161:> true
2023-09-21T21:36:13.244 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com'
2023-09-21T21:36:13.244 DEBUG:teuthology.orchestra.run.smithi161:> uname -m
2023-09-21T21:36:13.299 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64
2023-09-21T21:36:13.299 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release
2023-09-21T21:36:13.354 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream"
2023-09-21T21:36:13.354 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="9"
2023-09-21T21:36:13.354 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos"
2023-09-21T21:36:13.354 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora"
2023-09-21T21:36:13.354 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="9"
2023-09-21T21:36:13.355 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el9"
2023-09-21T21:36:13.355 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 9"
2023-09-21T21:36:13.355 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31"
2023-09-21T21:36:13.355 INFO:teuthology.orchestra.run.smithi161.stdout:LOGO="fedora-logo-icon"
2023-09-21T21:36:13.355 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-09-21T21:36:13.355 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/"
2023-09-21T21:36:13.355 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-21T21:36:13.355 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-09-21T21:36:13.355 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-21T21:36:13.356 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server
2023-09-21T21:36:13.378 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T21:36:13.456 INFO:teuthology.dispatcher.supervisor:Running job 7400370
2023-09-21T21:36:13.457 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_cfsnyder@teuthology --archive /home/teuthworker/archive/cfsnyder-2023-09-21_21:27:43-rgw-wip-62075-distro-default-smithi/7400370 --name cfsnyder-2023-09-21_21:27:43-rgw-wip-62075-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/two-zonegroup supported-random-distro$/{centos_latest} tasks/test_multi} -- /home/teuthworker/archive/cfsnyder-2023-09-21_21:27:43-rgw-wip-62075-distro-default-smithi/7400370/orig.config.yaml
2023-09-21T21:36:13.460 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/cfsnyder-2023-09-21_21:27:43-rgw-wip-62075-distro-default-smithi/7400370
2023-09-21T21:36:13.461 INFO:teuthology.dispatcher.supervisor:Job PID: 1403194
2023-09-21T21:36:13.461 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-09-21T21:38:13.558 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T21:40:13.720 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T21:42:13.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T21:44:14.060 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T21:46:14.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T21:48:14.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T21:50:14.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T21:52:14.740 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T21:54:14.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T21:56:15.081 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T21:58:15.330 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:00:15.476 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:02:15.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:04:15.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:06:15.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:08:16.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:10:16.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:12:16.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:14:16.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:16:16.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:18:16.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:20:17.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:22:17.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:24:17.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:26:17.592 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:28:17.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:30:17.910 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:32:18.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:34:18.232 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:36:18.380 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:38:18.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:40:18.673 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:42:18.826 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:44:19.012 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:46:19.176 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:48:19.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:50:19.474 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:52:19.632 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:54:19.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:56:19.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T22:58:20.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T23:00:20.226 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T23:02:20.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T23:04:20.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T23:06:20.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T23:08:20.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T23:10:21.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T23:12:21.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T23:14:21.314 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T23:16:21.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T23:18:21.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T23:20:21.789 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T23:22:21.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T23:24:22.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T23:26:22.296 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T23:28:22.456 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T23:30:22.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T23:32:22.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T23:34:22.942 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T23:36:23.103 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T23:38:23.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T23:40:23.452 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T23:40:23.516 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-09-21T23:40:23.684 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-09-21T23:40:23.684 INFO:teuthology.nuke:Checking targets against current locks
2023-09-21T23:40:23.726 DEBUG:teuthology.nuke:shortname: smithi148
2023-09-21T23:40:23.726 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-21T23:40:23.747 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cfsnyder-2023-09-21_21:27:43-rgw-wip-62075-distro-default-smithi/7400370', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-21 21:31:00.028163', 'locked_by': 'scheduled_cfsnyder@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMk84GrILm/t8EygfshgvedlSCg5y5CkfdKErMBRVtPr5vautXiKcMAQn5wOgA7cjWoRe0BQw4zSOA6foCNj9hY='}
2023-09-21T23:40:23.750 DEBUG:teuthology.nuke:shortname: smithi161
2023-09-21T23:40:23.751 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-21T23:40:23.769 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cfsnyder-2023-09-21_21:27:43-rgw-wip-62075-distro-default-smithi/7400370', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-21 21:31:00.027010', 'locked_by': 'scheduled_cfsnyder@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBISN6RBXaFhBX58wRdRTGxmL+WRKvatnbZxL707cIzjTlEwQ3Qu9Sa39iR70cvjD20dYLAiToAlZiTBwOI5RPXc='}
2023-09-21T23:40:23.795 INFO:teuthology.orchestra.console.smithi148:Power off
2023-09-21T23:40:23.795 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T23:40:23.808 INFO:teuthology.orchestra.console.smithi161:Power off
2023-09-21T23:40:23.808 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T23:40:23.815 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off
2023-09-21T23:40:23.816 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T23:40:23.827 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off
2023-09-21T23:40:23.827 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T23:40:23.839 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off
2023-09-21T23:40:23.846 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off
2023-09-21T23:40:23.940 INFO:teuthology.orchestra.console.smithi148:Power off completed
2023-09-21T23:40:23.947 INFO:teuthology.orchestra.console.smithi161:Power off completed
2023-09-21T23:40:24.087 INFO:teuthology.lock.ops:unlocked: smithi148.front.sepia.ceph.com
2023-09-21T23:40:24.095 INFO:teuthology.lock.ops:unlocked: smithi161.front.sepia.ceph.com