2023-11-10T18:20:50.705 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2
2023-11-10T18:20:50.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T18:20:50.843 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fbbf70d9a90>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fbbf7bcc670>, signals=[15])
2023-11-10T18:20:50.844 INFO:teuthology.lock.ops:Start node 'smithi081.front.sepia.ceph.com' reimaging
2023-11-10T18:20:50.845 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: reset os type and version on server
2023-11-10T18:20:50.845 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server
2023-11-10T18:20:50.863 INFO:teuthology.lock.ops:Start node 'smithi159.front.sepia.ceph.com' reimaging
2023-11-10T18:20:50.863 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: reset os type and version on server
2023-11-10T18:20:50.864 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server
2023-11-10T18:20:50.865 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /host {"name": "smithi081"}
2023-11-10T18:20:50.888 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /host {"name": "smithi159"}
2023-11-10T18:20:50.934 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-11-10T18:20:50.953 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-11-10T18:20:50.974 DEBUG:teuthology.provision.fog.smithi081:Requesting image smithi_rhel_8.4 (ID 7)
2023-11-10T18:20:50.974 DEBUG:teuthology.provision.fog.smithi081:FOG request: PUT /host/186 {"imageID": 7}
2023-11-10T18:20:50.991 DEBUG:teuthology.provision.fog.smithi159:Requesting image smithi_rhel_8.4 (ID 7)
2023-11-10T18:20:50.991 DEBUG:teuthology.provision.fog.smithi159:FOG request: PUT /host/264 {"imageID": 7}
2023-11-10T18:20:51.014 INFO:teuthology.provision.fog.smithi081:Scheduling deploy of rhel 8.4
2023-11-10T18:20:51.015 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-10T18:20:51.038 INFO:teuthology.provision.fog.smithi159:Scheduling deploy of rhel 8.4
2023-11-10T18:20:51.038 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-10T18:20:51.109 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /tasktype {"name": "deploy"}
2023-11-10T18:20:51.118 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /tasktype {"name": "deploy"}
2023-11-10T18:20:51.145 DEBUG:teuthology.provision.fog.smithi081:FOG request: POST /host/186/task {"taskTypeID": 1}
2023-11-10T18:20:51.156 DEBUG:teuthology.provision.fog.smithi159:FOG request: POST /host/264/task {"taskTypeID": 1}
2023-11-10T18:20:51.201 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-10T18:20:51.206 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-10T18:20:51.345 INFO:teuthology.orchestra.console.smithi081:Power off
2023-11-10T18:20:51.346 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-10T18:20:51.360 INFO:teuthology.orchestra.console.smithi159:Power off
2023-11-10T18:20:51.361 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-10T18:20:51.368 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off
2023-11-10T18:20:51.368 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-10T18:20:51.380 DEBUG:teuthology.orchestra.console.smithi159:power off output: Chassis Power Control: Down/Off
2023-11-10T18:20:51.380 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-10T18:20:51.389 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on
2023-11-10T18:20:51.401 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on
2023-11-10T18:20:55.394 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-10T18:20:55.402 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-10T18:20:55.505 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on
2023-11-10T18:20:55.511 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on
2023-11-10T18:20:59.510 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-10T18:20:59.517 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-10T18:20:59.620 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off
2023-11-10T18:20:59.625 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on
2023-11-10T18:20:59.722 INFO:teuthology.orchestra.console.smithi081:Power off completed
2023-11-10T18:20:59.822 INFO:teuthology.orchestra.console.smithi081:Power on
2023-11-10T18:20:59.823 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-10T18:20:59.842 DEBUG:teuthology.orchestra.console.smithi081:power on output: Chassis Power Control: Up/On
2023-11-10T18:20:59.843 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-10T18:20:59.864 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off
2023-11-10T18:21:03.626 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-10T18:21:03.735 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off
2023-11-10T18:21:03.836 INFO:teuthology.orchestra.console.smithi159:Power off completed
2023-11-10T18:21:03.865 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-10T18:21:03.937 INFO:teuthology.orchestra.console.smithi159:Power on
2023-11-10T18:21:03.938 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-10T18:21:03.959 DEBUG:teuthology.orchestra.console.smithi159:power on output: Chassis Power Control: Up/On
2023-11-10T18:21:03.959 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-10T18:21:03.974 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off
2023-11-10T18:21:03.979 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off
2023-11-10T18:21:07.980 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-10T18:21:07.986 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-10T18:21:08.089 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on
2023-11-10T18:21:08.095 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on
2023-11-10T18:21:08.191 INFO:teuthology.orchestra.console.smithi081:Power on completed
2023-11-10T18:21:08.196 INFO:teuthology.orchestra.console.smithi159:Power on completed
2023-11-10T18:21:08.292 INFO:teuthology.provision.fog.smithi081:Waiting for deploy to finish
2023-11-10T18:21:08.293 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-10T18:21:08.299 INFO:teuthology.provision.fog.smithi159:Waiting for deploy to finish
2023-11-10T18:21:08.299 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-10T18:21:23.520 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-10T18:21:23.523 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-10T18:21:38.723 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-10T18:21:38.724 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-10T18:21:53.936 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-10T18:21:53.947 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-10T18:22:09.141 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-10T18:22:09.144 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-10T18:22:24.356 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-10T18:22:24.358 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-10T18:22:39.600 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-10T18:22:39.620 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-10T18:22:54.869 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-10T18:22:54.870 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-10T18:23:10.144 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-10T18:23:10.145 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-10T18:23:25.586 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-10T18:23:25.588 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-10T18:23:40.911 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-10T18:23:40.913 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-10T18:23:56.318 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-10T18:23:56.338 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-10T18:24:11.651 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-10T18:24:11.654 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-10T18:24:26.946 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-10T18:24:26.948 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-10T18:24:42.231 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-10T18:24:42.234 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-10T18:24:57.552 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-10T18:24:57.555 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-10T18:25:12.857 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-10T18:25:12.859 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-10T18:25:28.130 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-10T18:25:28.132 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-10T18:25:28.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T18:25:28.445 ERROR:teuthology.orchestra.connection:Error authenticating with smithi081.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-10T18:25:43.353 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-10T18:25:58.589 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-10T18:26:13.789 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-10T18:26:28.998 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-10T18:26:32.449 WARNING:teuthology.provision.fog.smithi081:timed out
2023-11-10T18:26:38.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T18:26:44.170 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-10T18:26:57.018 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-11-10T18:26:59.311 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-10T18:27:03.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T18:27:06.074 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-11-10T18:27:12.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T18:27:13.139 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-10T18:27:13.141 DEBUG:teuthology.orchestra.run.smithi081:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-10T18:27:14.441 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-10T18:27:29.606 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-10T18:27:33.409 INFO:teuthology.provision.fog.smithi081:Node is ready
2023-11-10T18:27:33.409 DEBUG:teuthology.orchestra.run.smithi081:> hostname
2023-11-10T18:27:33.425 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081.front.sepia.ceph.com
2023-11-10T18:27:33.426 DEBUG:teuthology.orchestra.run.smithi081:> grep smithi081.front.sepia.ceph.com /etc/hosts
2023-11-10T18:27:33.480 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81 smithi081.front.sepia.ceph.com smithi081
2023-11-10T18:27:33.480 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081
2023-11-10T18:27:33.656 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081.front.sepia.ceph.com/smithi081/g' /etc/hosts
2023-11-10T18:27:33.681 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/172.21.15.81/172.21.15.81/g' /etc/hosts
2023-11-10T18:27:33.745 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081.front.sepia.ceph.com/smithi081/g' /etc/hostname
2023-11-10T18:27:33.810 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081
2023-11-10T18:27:33.875 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release
2023-11-10T18:27:33.929 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Red Hat Enterprise Linux"
2023-11-10T18:27:33.929 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8.4 (Ootpa)"
2023-11-10T18:27:33.929 INFO:teuthology.orchestra.run.smithi081.stdout:ID="rhel"
2023-11-10T18:27:33.929 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="fedora"
2023-11-10T18:27:33.929 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8.4"
2023-11-10T18:27:33.930 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8"
2023-11-10T18:27:33.930 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-11-10T18:27:33.930 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31"
2023-11-10T18:27:33.930 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-11-10T18:27:33.930 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.redhat.com/"
2023-11-10T18:27:33.931 INFO:teuthology.orchestra.run.smithi081.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-10T18:27:33.931 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-10T18:27:33.931 INFO:teuthology.orchestra.run.smithi081.stdout:
2023-11-10T18:27:33.931 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-10T18:27:33.931 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-11-10T18:27:33.932 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-10T18:27:33.932 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-11-10T18:27:33.932 INFO:teuthology.provision.fog.smithi081:Deploy complete!
2023-11-10T18:27:33.934 DEBUG:teuthology.parallel:result is None
2023-11-10T18:27:44.776 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-10T18:27:59.888 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-10T18:28:15.021 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-10T18:28:30.118 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-10T18:28:45.210 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-10T18:29:00.294 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-10T18:29:15.404 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-10T18:29:15.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T18:29:18.554 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-11-10T18:29:24.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T18:29:27.610 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-11-10T18:29:33.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T18:29:36.666 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-11-10T18:29:42.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T18:29:45.726 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-11-10T18:29:51.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T18:29:54.782 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-11-10T18:30:00.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T18:30:03.870 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-11-10T18:30:09.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T18:30:12.927 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-11-10T18:30:18.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T18:31:18.931 WARNING:teuthology.provision.fog.smithi159:timed out
2023-11-10T18:31:24.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T18:31:25.280 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-10T18:31:25.280 DEBUG:teuthology.orchestra.run.smithi159:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-10T18:31:25.544 INFO:teuthology.provision.fog.smithi159:Node is ready
2023-11-10T18:31:25.545 DEBUG:teuthology.orchestra.run.smithi159:> hostname
2023-11-10T18:31:25.600 INFO:teuthology.orchestra.run.smithi159.stdout:smithi159
2023-11-10T18:31:25.600 DEBUG:teuthology.orchestra.run.smithi159:> grep smithi159 /etc/hosts
2023-11-10T18:31:25.656 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159 smithi159.front.sepia.ceph.com smithi159
2023-11-10T18:31:25.657 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159
2023-11-10T18:31:25.763 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159/smithi159/g' /etc/hosts
2023-11-10T18:31:25.789 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/172.21.15.159/172.21.15.159/g' /etc/hosts
2023-11-10T18:31:25.853 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159/smithi159/g' /etc/hostname
2023-11-10T18:31:25.918 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159
2023-11-10T18:31:25.981 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release
2023-11-10T18:31:26.036 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="Red Hat Enterprise Linux"
2023-11-10T18:31:26.036 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="8.4 (Ootpa)"
2023-11-10T18:31:26.037 INFO:teuthology.orchestra.run.smithi159.stdout:ID="rhel"
2023-11-10T18:31:26.037 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="fedora"
2023-11-10T18:31:26.037 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="8.4"
2023-11-10T18:31:26.037 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el8"
2023-11-10T18:31:26.038 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-11-10T18:31:26.038 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31"
2023-11-10T18:31:26.038 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-11-10T18:31:26.039 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://www.redhat.com/"
2023-11-10T18:31:26.039 INFO:teuthology.orchestra.run.smithi159.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-10T18:31:26.039 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-10T18:31:26.040 INFO:teuthology.orchestra.run.smithi159.stdout:
2023-11-10T18:31:26.040 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-10T18:31:26.041 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-11-10T18:31:26.041 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-10T18:31:26.041 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-11-10T18:31:26.042 INFO:teuthology.provision.fog.smithi159:Deploy complete!
2023-11-10T18:31:26.043 DEBUG:teuthology.parallel:result is None
2023-11-10T18:31:26.197 INFO:teuthology.lock.ops:Checking smithi081.front.sepia.ceph.com
2023-11-10T18:31:26.198 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-10T18:31:26.218 INFO:teuthology.lock.ops:Checking smithi159.front.sepia.ceph.com
2023-11-10T18:31:26.218 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-10T18:31:26.244 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: set os type and version on server
2023-11-10T18:31:26.246 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com'
2023-11-10T18:31:26.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T18:31:26.316 DEBUG:teuthology.orchestra.run.smithi081:> true
2023-11-10T18:31:26.437 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com'
2023-11-10T18:31:26.438 DEBUG:teuthology.orchestra.run.smithi081:> uname -m
2023-11-10T18:31:26.492 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64
2023-11-10T18:31:26.493 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release
2023-11-10T18:31:26.547 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Red Hat Enterprise Linux"
2023-11-10T18:31:26.548 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8.4 (Ootpa)"
2023-11-10T18:31:26.548 INFO:teuthology.orchestra.run.smithi081.stdout:ID="rhel"
2023-11-10T18:31:26.548 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="fedora"
2023-11-10T18:31:26.548 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8.4"
2023-11-10T18:31:26.548 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8"
2023-11-10T18:31:26.549 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-11-10T18:31:26.549 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31"
2023-11-10T18:31:26.549 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-11-10T18:31:26.549 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.redhat.com/"
2023-11-10T18:31:26.550 INFO:teuthology.orchestra.run.smithi081.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-10T18:31:26.550 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-10T18:31:26.550 INFO:teuthology.orchestra.run.smithi081.stdout:
2023-11-10T18:31:26.550 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-10T18:31:26.551 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-11-10T18:31:26.551 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-10T18:31:26.551 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-11-10T18:31:26.552 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server
2023-11-10T18:31:26.577 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: set os type and version on server
2023-11-10T18:31:26.578 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com'
2023-11-10T18:31:26.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T18:31:26.643 DEBUG:teuthology.orchestra.run.smithi159:> true
2023-11-10T18:31:26.708 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com'
2023-11-10T18:31:26.709 DEBUG:teuthology.orchestra.run.smithi159:> uname -m
2023-11-10T18:31:26.763 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64
2023-11-10T18:31:26.764 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release
2023-11-10T18:31:26.818 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="Red Hat Enterprise Linux"
2023-11-10T18:31:26.819 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="8.4 (Ootpa)"
2023-11-10T18:31:26.819 INFO:teuthology.orchestra.run.smithi159.stdout:ID="rhel"
2023-11-10T18:31:26.819 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="fedora"
2023-11-10T18:31:26.819 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="8.4"
2023-11-10T18:31:26.820 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el8"
2023-11-10T18:31:26.820 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-11-10T18:31:26.820 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31"
2023-11-10T18:31:26.821 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-11-10T18:31:26.821 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://www.redhat.com/"
2023-11-10T18:31:26.822 INFO:teuthology.orchestra.run.smithi159.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-10T18:31:26.822 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-10T18:31:26.823 INFO:teuthology.orchestra.run.smithi159.stdout:
2023-11-10T18:31:26.823 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-10T18:31:26.823 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-11-10T18:31:26.824 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-10T18:31:26.824 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-11-10T18:31:26.824 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server
2023-11-10T18:31:26.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T18:31:26.948 INFO:teuthology.dispatcher.supervisor:Running job 7454287
2023-11-10T18:31:26.949 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-11-10_18:18:41-rados-wip-yuri3-testing-2023-11-09-1355-quincy-distro-default-smithi/7454287 --name yuriw-2023-11-10_18:18:41-rados-wip-yuri3-testing-2023-11-09-1355-quincy-distro-default-smithi --description rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/rados_cls_all} -- /home/teuthworker/archive/yuriw-2023-11-10_18:18:41-rados-wip-yuri3-testing-2023-11-09-1355-quincy-distro-default-smithi/7454287/orig.config.yaml
2023-11-10T18:31:26.952 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-11-10_18:18:41-rados-wip-yuri3-testing-2023-11-09-1355-quincy-distro-default-smithi/7454287
2023-11-10T18:31:26.952 INFO:teuthology.dispatcher.supervisor:Job PID: 1336848
2023-11-10T18:31:26.953 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-10T18:33:26.954 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T18:35:27.033 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T18:37:27.105 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T18:39:27.184 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T18:41:27.270 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T18:43:27.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T18:45:27.406 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T18:47:27.470 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T18:49:27.537 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T18:51:27.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T18:53:27.661 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T18:55:27.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T18:57:27.789 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T18:59:27.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T18:59:27.957 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-11-10T18:59:28.147 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-11-10T18:59:28.148 INFO:teuthology.nuke:Checking targets against current locks
2023-11-10T18:59:28.201 DEBUG:teuthology.nuke:shortname: smithi081
2023-11-10T18:59:28.202 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-10T18:59:28.223 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-10_18:18:41-rados-wip-yuri3-testing-2023-11-09-1355-quincy-distro-default-smithi/7454287', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-10 18:20:49.895731', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBVsacgZL5hYCVut6+7vssFtzbUNCstOFOZBWZ20HPnS6W5mxx+ZLmse0arQjJ0vKqawy7ibe+86BE5+TBSTGyU='}
2023-11-10T18:59:28.227 DEBUG:teuthology.nuke:shortname: smithi159
2023-11-10T18:59:28.227 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-10T18:59:28.249 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi159.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-10_18:18:41-rados-wip-yuri3-testing-2023-11-09-1355-quincy-distro-default-smithi/7454287', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-10 18:20:49.896932', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPkcfaLhvlcCG+wPZePhXHQrh/23pxqqig/E3byFfeb4m0wJAdPw+YnWyRemkiw1JuoU/wqJHfTGZyVSzqdap7I='}
2023-11-10T18:59:28.271 INFO:teuthology.orchestra.console.smithi081:Power off
2023-11-10T18:59:28.272 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-10T18:59:28.302 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off
2023-11-10T18:59:28.302 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-10T18:59:28.317 INFO:teuthology.orchestra.console.smithi159:Power off
2023-11-10T18:59:28.317 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-10T18:59:28.326 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off
2023-11-10T18:59:28.339 DEBUG:teuthology.orchestra.console.smithi159:power off output: Chassis Power Control: Down/Off
2023-11-10T18:59:28.340 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-10T18:59:28.362 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off
2023-11-10T18:59:28.428 INFO:teuthology.orchestra.console.smithi081:Power off completed
2023-11-10T18:59:28.463 INFO:teuthology.orchestra.console.smithi159:Power off completed
2023-11-10T18:59:28.581 INFO:teuthology.lock.ops:unlocked: smithi081.front.sepia.ceph.com
2023-11-10T18:59:28.611 INFO:teuthology.lock.ops:unlocked: smithi159.front.sepia.ceph.com