2023-08-17T20:08:27.990 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc
2023-08-17T20:08:27.992 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T20:08:28.123 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f8e092ed8b0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f8e08bffee0>, signals=[15])
2023-08-17T20:08:28.124 INFO:teuthology.lock.ops:Start node 'smithi112.front.sepia.ceph.com' reimaging
2023-08-17T20:08:28.125 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: reset os type and version on server
2023-08-17T20:08:28.125 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server
2023-08-17T20:08:28.147 INFO:teuthology.lock.ops:Start node 'smithi175.front.sepia.ceph.com' reimaging
2023-08-17T20:08:28.148 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: reset os type and version on server
2023-08-17T20:08:28.148 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server
2023-08-17T20:08:28.149 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /host {"name": "smithi112"}
2023-08-17T20:08:28.172 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /host {"name": "smithi175"}
2023-08-17T20:08:28.226 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-08-17T20:08:28.243 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-08-17T20:08:28.276 DEBUG:teuthology.provision.fog.smithi112:Requesting image smithi_rhel_8.4 (ID 7)
2023-08-17T20:08:28.277 DEBUG:teuthology.provision.fog.smithi112:FOG request: PUT /host/217 {"imageID": 7}
2023-08-17T20:08:28.290 DEBUG:teuthology.provision.fog.smithi175:Requesting image smithi_rhel_8.4 (ID 7)
2023-08-17T20:08:28.291 DEBUG:teuthology.provision.fog.smithi175:FOG request: PUT /host/280 {"imageID": 7}
2023-08-17T20:08:28.331 INFO:teuthology.provision.fog.smithi112:Scheduling deploy of rhel 8.4
2023-08-17T20:08:28.331 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-08-17T20:08:28.340 INFO:teuthology.provision.fog.smithi175:Scheduling deploy of rhel 8.4
2023-08-17T20:08:28.341 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None
2023-08-17T20:08:28.550 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /tasktype {"name": "deploy"}
2023-08-17T20:08:28.591 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /tasktype {"name": "deploy"}
2023-08-17T20:08:28.595 DEBUG:teuthology.provision.fog.smithi112:FOG request: POST /host/217/task {"taskTypeID": 1}
2023-08-17T20:08:28.633 DEBUG:teuthology.provision.fog.smithi175:FOG request: POST /host/280/task {"taskTypeID": 1}
2023-08-17T20:08:28.640 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-08-17T20:08:28.687 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None
2023-08-17T20:08:28.932 INFO:teuthology.orchestra.console.smithi175:Power off
2023-08-17T20:08:28.933 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-17T20:08:28.948 INFO:teuthology.orchestra.console.smithi112:Power off
2023-08-17T20:08:28.948 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-17T20:08:28.958 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off
2023-08-17T20:08:28.959 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-17T20:08:28.971 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off
2023-08-17T20:08:28.972 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-17T20:08:28.981 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off
2023-08-17T20:08:28.993 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on
2023-08-17T20:08:29.083 INFO:teuthology.orchestra.console.smithi175:Power off completed
2023-08-17T20:08:29.184 INFO:teuthology.orchestra.console.smithi175:Power on
2023-08-17T20:08:29.184 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-17T20:08:29.203 DEBUG:teuthology.orchestra.console.smithi175:power on output: Chassis Power Control: Up/On
2023-08-17T20:08:29.204 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-17T20:08:29.223 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off
2023-08-17T20:08:32.996 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-17T20:08:33.106 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on
2023-08-17T20:08:33.225 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-17T20:08:33.335 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on
2023-08-17T20:08:33.436 INFO:teuthology.orchestra.console.smithi175:Power on completed
2023-08-17T20:08:33.536 INFO:teuthology.provision.fog.smithi175:Waiting for deploy to finish
2023-08-17T20:08:33.537 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None
2023-08-17T20:08:37.111 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-17T20:08:37.221 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off
2023-08-17T20:08:37.322 INFO:teuthology.orchestra.console.smithi112:Power off completed
2023-08-17T20:08:37.423 INFO:teuthology.orchestra.console.smithi112:Power on
2023-08-17T20:08:37.423 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-17T20:08:37.443 DEBUG:teuthology.orchestra.console.smithi112:power on output: Chassis Power Control: Up/On
2023-08-17T20:08:37.444 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-17T20:08:37.463 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off
2023-08-17T20:08:41.468 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-17T20:08:41.577 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off
2023-08-17T20:08:45.582 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-17T20:08:45.693 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on
2023-08-17T20:08:45.794 INFO:teuthology.orchestra.console.smithi112:Power on completed
2023-08-17T20:08:45.895 INFO:teuthology.provision.fog.smithi112:Waiting for deploy to finish
2023-08-17T20:08:45.896 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-08-17T20:08:48.727 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None
2023-08-17T20:09:01.138 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-08-17T20:09:03.930 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None
2023-08-17T20:09:16.384 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-08-17T20:09:19.112 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None
2023-08-17T20:09:31.612 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-08-17T20:09:34.341 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None
2023-08-17T20:09:46.840 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-08-17T20:09:49.562 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None
2023-08-17T20:10:03.516 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-08-17T20:10:04.783 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None
2023-08-17T20:10:19.024 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-08-17T20:10:20.166 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None
2023-08-17T20:10:34.382 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-08-17T20:10:37.584 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None
2023-08-17T20:10:49.996 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-08-17T20:10:54.469 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None
2023-08-17T20:11:06.467 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-08-17T20:11:19.805 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None
2023-08-17T20:11:24.399 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-08-17T20:11:35.133 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None
2023-08-17T20:11:42.298 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-08-17T20:11:50.891 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None
2023-08-17T20:12:00.140 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-08-17T20:12:06.440 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None
2023-08-17T20:12:18.210 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-08-17T20:12:21.817 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None
2023-08-17T20:12:34.992 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-08-17T20:12:37.212 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None
2023-08-17T20:12:51.522 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-08-17T20:12:52.613 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None
2023-08-17T20:13:07.621 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-08-17T20:13:08.039 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None
2023-08-17T20:13:08.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T20:13:11.216 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2023-08-17T20:13:17.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T20:13:20.272 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2023-08-17T20:13:23.541 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None
2023-08-17T20:13:26.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T20:13:29.328 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2023-08-17T20:13:35.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T20:13:38.416 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2023-08-17T20:13:39.074 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None
2023-08-17T20:13:44.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T20:13:47.472 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2023-08-17T20:13:53.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T20:13:54.328 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None
2023-08-17T20:13:56.560 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2023-08-17T20:14:02.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T20:14:09.596 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None
2023-08-17T20:14:24.800 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None
2023-08-17T20:14:39.992 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None
2023-08-17T20:14:55.157 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None
2023-08-17T20:14:55.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T20:14:58.384 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2023-08-17T20:15:02.569 WARNING:teuthology.provision.fog.smithi112:timed out
2023-08-17T20:15:04.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T20:15:09.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T20:15:14.402 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2023-08-17T20:15:14.713 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-17T20:15:14.713 DEBUG:teuthology.orchestra.run.smithi112:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-17T20:15:15.008 INFO:teuthology.provision.fog.smithi112:Node is ready
2023-08-17T20:15:15.008 DEBUG:teuthology.orchestra.run.smithi112:> hostname
2023-08-17T20:15:15.023 INFO:teuthology.orchestra.run.smithi112.stdout:smithi112.front.sepia.ceph.com
2023-08-17T20:15:15.023 DEBUG:teuthology.orchestra.run.smithi112:> grep smithi112.front.sepia.ceph.com /etc/hosts
2023-08-17T20:15:15.078 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112 smithi112.front.sepia.ceph.com smithi112
2023-08-17T20:15:15.078 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112
2023-08-17T20:15:15.184 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hosts
2023-08-17T20:15:15.208 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/172.21.15.112/172.21.15.112/g' /etc/hosts
2023-08-17T20:15:15.273 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hostname
2023-08-17T20:15:15.338 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112
2023-08-17T20:15:15.402 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release
2023-08-17T20:15:15.457 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="Red Hat Enterprise Linux"
2023-08-17T20:15:15.457 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="8.4 (Ootpa)"
2023-08-17T20:15:15.457 INFO:teuthology.orchestra.run.smithi112.stdout:ID="rhel"
2023-08-17T20:15:15.457 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="fedora"
2023-08-17T20:15:15.458 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="8.4"
2023-08-17T20:15:15.458 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el8"
2023-08-17T20:15:15.458 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-08-17T20:15:15.458 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31"
2023-08-17T20:15:15.458 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-08-17T20:15:15.459 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://www.redhat.com/"
2023-08-17T20:15:15.459 INFO:teuthology.orchestra.run.smithi112.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-17T20:15:15.459 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-17T20:15:15.459 INFO:teuthology.orchestra.run.smithi112.stdout:
2023-08-17T20:15:15.459 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-17T20:15:15.459 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-08-17T20:15:15.459 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-17T20:15:15.459 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-08-17T20:15:15.460 INFO:teuthology.provision.fog.smithi112:Deploy complete!
2023-08-17T20:15:15.462 DEBUG:teuthology.parallel:result is None
2023-08-17T20:15:20.409 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T20:15:28.464 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2023-08-17T20:15:34.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T20:15:43.632 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2023-08-17T20:15:49.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T20:16:13.168 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2023-08-17T20:16:19.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T20:16:27.248 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2023-08-17T20:16:33.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T20:16:39.548 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-17T20:16:39.549 DEBUG:teuthology.orchestra.run.smithi175:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-17T20:16:55.388 INFO:teuthology.provision.fog.smithi175:Node is ready
2023-08-17T20:16:55.389 DEBUG:teuthology.orchestra.run.smithi175:> hostname
2023-08-17T20:16:55.445 INFO:teuthology.orchestra.run.smithi175.stdout:smithi175.front.sepia.ceph.com
2023-08-17T20:16:55.445 DEBUG:teuthology.orchestra.run.smithi175:> grep smithi175.front.sepia.ceph.com /etc/hosts
2023-08-17T20:16:55.499 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.15.175 smithi175.front.sepia.ceph.com smithi175
2023-08-17T20:16:55.500 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175
2023-08-17T20:16:55.626 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi175.front.sepia.ceph.com/smithi175/g' /etc/hosts
2023-08-17T20:16:55.650 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/172.21.15.175/172.21.15.175/g' /etc/hosts
2023-08-17T20:16:55.716 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi175.front.sepia.ceph.com/smithi175/g' /etc/hostname
2023-08-17T20:16:55.780 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175
2023-08-17T20:16:55.842 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release
2023-08-17T20:16:55.896 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="Red Hat Enterprise Linux"
2023-08-17T20:16:55.896 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="8.4 (Ootpa)"
2023-08-17T20:16:55.897 INFO:teuthology.orchestra.run.smithi175.stdout:ID="rhel"
2023-08-17T20:16:55.897 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="fedora"
2023-08-17T20:16:55.897 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="8.4"
2023-08-17T20:16:55.897 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el8"
2023-08-17T20:16:55.897 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-08-17T20:16:55.897 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31"
2023-08-17T20:16:55.897 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-08-17T20:16:55.897 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://www.redhat.com/"
2023-08-17T20:16:55.898 INFO:teuthology.orchestra.run.smithi175.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-17T20:16:55.898 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-17T20:16:55.898 INFO:teuthology.orchestra.run.smithi175.stdout:
2023-08-17T20:16:55.898 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-17T20:16:55.898 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-08-17T20:16:55.898 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-17T20:16:55.898 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-08-17T20:16:55.899 INFO:teuthology.provision.fog.smithi175:Deploy complete!
2023-08-17T20:16:55.899 DEBUG:teuthology.parallel:result is None
2023-08-17T20:17:21.112 INFO:teuthology.lock.ops:Checking smithi112.front.sepia.ceph.com
2023-08-17T20:17:21.113 INFO:teuthology.lock.ops:New key found. Updating...
2023-08-17T20:17:21.973 INFO:teuthology.lock.ops:Checking smithi175.front.sepia.ceph.com
2023-08-17T20:17:21.974 INFO:teuthology.lock.ops:New key found. Updating...
2023-08-17T20:17:21.991 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: set os type and version on server
2023-08-17T20:17:21.992 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com'
2023-08-17T20:17:21.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T20:17:22.065 DEBUG:teuthology.orchestra.run.smithi112:> true
2023-08-17T20:17:22.187 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com'
2023-08-17T20:17:22.187 DEBUG:teuthology.orchestra.run.smithi112:> uname -m
2023-08-17T20:17:22.242 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64
2023-08-17T20:17:22.242 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release
2023-08-17T20:17:22.297 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="Red Hat Enterprise Linux"
2023-08-17T20:17:22.297 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="8.4 (Ootpa)"
2023-08-17T20:17:22.298 INFO:teuthology.orchestra.run.smithi112.stdout:ID="rhel"
2023-08-17T20:17:22.298 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="fedora"
2023-08-17T20:17:22.298 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="8.4"
2023-08-17T20:17:22.298 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el8"
2023-08-17T20:17:22.298 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-08-17T20:17:22.298 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31"
2023-08-17T20:17:22.299 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-08-17T20:17:22.299 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://www.redhat.com/"
2023-08-17T20:17:22.299 INFO:teuthology.orchestra.run.smithi112.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-17T20:17:22.299 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-17T20:17:22.299 INFO:teuthology.orchestra.run.smithi112.stdout:
2023-08-17T20:17:22.299 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-17T20:17:22.299 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-08-17T20:17:22.299 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-17T20:17:22.300 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-08-17T20:17:22.300 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server
2023-08-17T20:17:22.323 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: set os type and version on server
2023-08-17T20:17:22.324 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com'
2023-08-17T20:17:22.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T20:17:22.393 DEBUG:teuthology.orchestra.run.smithi175:> true
2023-08-17T20:17:22.511 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com'
2023-08-17T20:17:22.512 DEBUG:teuthology.orchestra.run.smithi175:> uname -m
2023-08-17T20:17:22.566 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64
2023-08-17T20:17:22.567 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release
2023-08-17T20:17:22.620 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="Red Hat Enterprise Linux"
2023-08-17T20:17:22.621 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="8.4 (Ootpa)"
2023-08-17T20:17:22.621 INFO:teuthology.orchestra.run.smithi175.stdout:ID="rhel"
2023-08-17T20:17:22.621 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="fedora"
2023-08-17T20:17:22.621 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="8.4"
2023-08-17T20:17:22.621 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el8"
2023-08-17T20:17:22.622 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-08-17T20:17:22.622 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31"
2023-08-17T20:17:22.622 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-08-17T20:17:22.622 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://www.redhat.com/"
2023-08-17T20:17:22.622 INFO:teuthology.orchestra.run.smithi175.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-17T20:17:22.622 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-17T20:17:22.622 INFO:teuthology.orchestra.run.smithi175.stdout:
2023-08-17T20:17:22.623 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-17T20:17:22.623 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-08-17T20:17:22.623 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-17T20:17:22.623 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-08-17T20:17:22.624 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server
2023-08-17T20:17:22.640 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T20:17:22.718 INFO:teuthology.dispatcher.supervisor:Running job 7371954
2023-08-17T20:17:22.718 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-08-17_20:06:11-rados-wip-yuri7-testing-2023-08-16-1309-pacific-distro-default-smithi/7371954 --name yuriw-2023-08-17_20:06:11-rados-wip-yuri7-testing-2023-08-16-1309-pacific-distro-default-smithi --description rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/rados_cls_all} -- /home/teuthworker/archive/yuriw-2023-08-17_20:06:11-rados-wip-yuri7-testing-2023-08-16-1309-pacific-distro-default-smithi/7371954/orig.config.yaml
2023-08-17T20:17:22.724 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-08-17_20:06:11-rados-wip-yuri7-testing-2023-08-16-1309-pacific-distro-default-smithi/7371954
2023-08-17T20:17:22.725 INFO:teuthology.dispatcher.supervisor:Job PID: 14616
2023-08-17T20:17:22.726 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-08-17T20:19:22.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T20:21:27.993 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T20:23:33.185 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T20:25:38.401 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T20:27:43.613 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T20:29:43.801 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T20:31:44.049 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T20:33:44.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T20:35:44.389 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T20:37:44.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T20:39:44.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T20:41:44.861 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T20:43:45.016 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T20:43:45.095 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-08-17T20:43:45.231 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-08-17T20:43:45.232 INFO:teuthology.nuke:Checking targets against current locks
2023-08-17T20:43:45.277 DEBUG:teuthology.nuke:shortname: smithi112
2023-08-17T20:43:45.278 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-17T20:43:45.291 DEBUG:teuthology.nuke:shortname: smithi175
2023-08-17T20:43:45.291 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-17T20:43:45.296 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-17_20:06:11-rados-wip-yuri7-testing-2023-08-16-1309-pacific-distro-default-smithi/7371954', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-17 20:08:27.233240', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDbwIsUrdTCwOL0aOUHJGu5mWX1yj/UK09rgcvs2pe/VBd4DzHnER7fPVoP+/8A1KcaDfeetCnf8FOuFe2L9ddMAvxAyqJcxh2qBDqUIKMVyQH0r7CO9LiJgzRmY01ikXj35ISvjflK7nN6gqk/YtwIM/lItzuAK/PzPFuqf3i/0nCRSUxcKJ7xPZy32evs+TZnt1nXwX5SosisLaEixfF+/FZlObUnnJ+qIyGXTuQFmIgeraf5oMYW3rDSxxM7wpeEw7ixkkhBY43dYdjMtFwxyXF+o7Sd8a1V89qYWohbAJlcTCytE+j+oXmilz2AdlytK9hpmGSI6YMwTEU+lo0OZXp9ATWmxZmNLxAF6xUAJhW75HnJHSyqsQDGzcpumYtOHM3Fd77WRZuf6Rf+hoBBB1MW+vTErfTKu2QdGLV/cJiHiUwEBB4VDGDv1HGvbRgLm1EWJVy82h53Rm4/x2CvsokwRnsNi6Ey/WFXKd3VsUiPhAeUZJgVy4D5IEDD8CM='}
2023-08-17T20:43:45.309 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-17_20:06:11-rados-wip-yuri7-testing-2023-08-16-1309-pacific-distro-default-smithi/7371954', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-17 20:08:27.231396', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA+WxEFqTsZ45jxqOAwr84y4snrE9YQVpQ3VQ15/d5Ep5MJFHL+grxAfJuXeacxD0hvhHG9zgDzCqN5MVT/1tpk='}
2023-08-17T20:43:45.337 INFO:teuthology.orchestra.console.smithi112:Power off
2023-08-17T20:43:45.338 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-17T20:43:45.353 INFO:teuthology.orchestra.console.smithi175:Power off
2023-08-17T20:43:45.353 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-17T20:43:45.362 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off
2023-08-17T20:43:45.362 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-17T20:43:45.372 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off
2023-08-17T20:43:45.373 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-17T20:43:45.382 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off
2023-08-17T20:43:45.391 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off
2023-08-17T20:43:45.484 INFO:teuthology.orchestra.console.smithi112:Power off completed
2023-08-17T20:43:45.492 INFO:teuthology.orchestra.console.smithi175:Power off completed
2023-08-17T20:43:45.636 INFO:teuthology.lock.ops:unlocked: smithi112.front.sepia.ceph.com
2023-08-17T20:43:45.646 INFO:teuthology.lock.ops:unlocked: smithi175.front.sepia.ceph.com