2023-11-14T21:26:00.718 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2
2023-11-14T21:26:00.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-14T21:26:00.866 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fa1adedfb20>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fa1ae9cb670>, signals=[15])
2023-11-14T21:26:00.867 INFO:teuthology.lock.ops:Start node 'smithi105.front.sepia.ceph.com' reimaging
2023-11-14T21:26:00.868 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: reset os type and version on server
2023-11-14T21:26:00.868 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server
2023-11-14T21:26:00.888 INFO:teuthology.lock.ops:Start node 'smithi157.front.sepia.ceph.com' reimaging
2023-11-14T21:26:00.888 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: reset os type and version on server
2023-11-14T21:26:00.888 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server
2023-11-14T21:26:00.890 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /host {"name": "smithi105"}
2023-11-14T21:26:00.912 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /host {"name": "smithi157"}
2023-11-14T21:26:00.968 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-11-14T21:26:00.980 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-11-14T21:26:01.010 DEBUG:teuthology.provision.fog.smithi105:Requesting image smithi_rhel_8.4 (ID 7)
2023-11-14T21:26:01.010 DEBUG:teuthology.provision.fog.smithi105:FOG request: PUT /host/210 {"imageID": 7}
2023-11-14T21:26:01.027 DEBUG:teuthology.provision.fog.smithi157:Requesting image smithi_rhel_8.4 (ID 7)
2023-11-14T21:26:01.027 DEBUG:teuthology.provision.fog.smithi157:FOG request: PUT /host/262 {"imageID": 7}
2023-11-14T21:26:01.064 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of rhel 8.4
2023-11-14T21:26:01.065 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-11-14T21:26:01.072 INFO:teuthology.provision.fog.smithi157:Scheduling deploy of rhel 8.4
2023-11-14T21:26:01.072 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None
2023-11-14T21:26:01.127 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /tasktype {"name": "deploy"}
2023-11-14T21:26:01.130 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /tasktype {"name": "deploy"}
2023-11-14T21:26:01.167 DEBUG:teuthology.provision.fog.smithi105:FOG request: POST /host/210/task {"taskTypeID": 1}
2023-11-14T21:26:01.170 DEBUG:teuthology.provision.fog.smithi157:FOG request: POST /host/262/task {"taskTypeID": 1}
2023-11-14T21:26:01.234 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None
2023-11-14T21:26:01.237 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-11-14T21:26:01.334 INFO:teuthology.orchestra.console.smithi105:Power off
2023-11-14T21:26:01.335 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-14T21:26:01.346 INFO:teuthology.orchestra.console.smithi157:Power off
2023-11-14T21:26:01.347 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-14T21:26:01.357 DEBUG:teuthology.orchestra.console.smithi105:power off output: Chassis Power Control: Down/Off
2023-11-14T21:26:01.357 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-14T21:26:01.369 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off
2023-11-14T21:26:01.370 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-14T21:26:01.381 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on
2023-11-14T21:26:01.394 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on
2023-11-14T21:26:05.386 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-14T21:26:05.395 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-14T21:26:05.496 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on
2023-11-14T21:26:05.504 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on
2023-11-14T21:26:09.501 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-14T21:26:09.509 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-14T21:26:09.611 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off
2023-11-14T21:26:09.618 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off
2023-11-14T21:26:09.713 INFO:teuthology.orchestra.console.smithi105:Power off completed
2023-11-14T21:26:09.719 INFO:teuthology.orchestra.console.smithi157:Power off completed
2023-11-14T21:26:09.815 INFO:teuthology.orchestra.console.smithi105:Power on
2023-11-14T21:26:09.815 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-14T21:26:09.823 INFO:teuthology.orchestra.console.smithi157:Power on
2023-11-14T21:26:09.824 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-14T21:26:09.839 DEBUG:teuthology.orchestra.console.smithi105:power on output: Chassis Power Control: Up/On
2023-11-14T21:26:09.840 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-14T21:26:09.852 DEBUG:teuthology.orchestra.console.smithi157:power on output: Chassis Power Control: Up/On
2023-11-14T21:26:09.853 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-14T21:26:09.864 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off
2023-11-14T21:26:09.874 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off
2023-11-14T21:26:13.868 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-14T21:26:13.876 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-14T21:26:13.978 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off
2023-11-14T21:26:13.987 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off
2023-11-14T21:26:17.982 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-14T21:26:17.990 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-14T21:26:18.092 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on
2023-11-14T21:26:18.193 INFO:teuthology.orchestra.console.smithi105:Power on completed
2023-11-14T21:26:18.200 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on
2023-11-14T21:26:18.294 INFO:teuthology.provision.fog.smithi105:Waiting for deploy to finish
2023-11-14T21:26:18.295 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-11-14T21:26:18.301 INFO:teuthology.orchestra.console.smithi157:Power on completed
2023-11-14T21:26:18.402 INFO:teuthology.provision.fog.smithi157:Waiting for deploy to finish
2023-11-14T21:26:18.402 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None
2023-11-14T21:26:33.378 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-11-14T21:26:33.462 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None
2023-11-14T21:26:48.458 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-11-14T21:26:48.520 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None
2023-11-14T21:27:03.538 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-11-14T21:27:03.577 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None
2023-11-14T21:27:18.622 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-11-14T21:27:18.653 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None
2023-11-14T21:27:33.703 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-11-14T21:27:33.713 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None
2023-11-14T21:27:48.782 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-11-14T21:27:48.784 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None
2023-11-14T21:28:03.882 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-11-14T21:28:03.884 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None
2023-11-14T21:28:18.961 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None
2023-11-14T21:28:18.963 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-11-14T21:28:34.058 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-11-14T21:28:34.059 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None
2023-11-14T21:28:49.145 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-11-14T21:28:49.148 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None
2023-11-14T21:29:04.236 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-11-14T21:29:04.238 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None
2023-11-14T21:29:04.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-14T21:29:07.387 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2023-11-14T21:29:13.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-14T21:29:16.474 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2023-11-14T21:29:19.322 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None
2023-11-14T21:29:19.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-14T21:29:22.462 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2023-11-14T21:29:22.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-14T21:29:25.534 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2023-11-14T21:29:28.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-14T21:29:31.538 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-14T21:29:31.546 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2023-11-14T21:29:34.618 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2023-11-14T21:29:37.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-14T21:29:40.602 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2023-11-14T21:29:40.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-14T21:29:43.674 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2023-11-14T21:29:46.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-14T21:29:49.658 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2023-11-14T21:29:49.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-14T21:29:52.734 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2023-11-14T21:29:55.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-14T21:29:58.718 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2023-11-14T21:29:58.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-14T21:30:04.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-14T21:30:07.802 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2023-11-14T21:30:13.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-14T21:30:16.890 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2023-11-14T21:30:22.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-14T21:30:25.946 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2023-11-14T21:30:31.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-14T21:30:35.006 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2023-11-14T21:30:41.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-14T21:30:58.756 WARNING:teuthology.provision.fog.smithi105:timed out
2023-11-14T21:31:04.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-14T21:31:05.118 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-14T21:31:05.119 DEBUG:teuthology.orchestra.run.smithi105:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-14T21:31:05.360 INFO:teuthology.provision.fog.smithi105:Node is ready
2023-11-14T21:31:05.361 DEBUG:teuthology.orchestra.run.smithi105:> hostname
2023-11-14T21:31:05.415 INFO:teuthology.orchestra.run.smithi105.stdout:smithi105.front.sepia.ceph.com
2023-11-14T21:31:05.416 DEBUG:teuthology.orchestra.run.smithi105:> grep smithi105.front.sepia.ceph.com /etc/hosts
2023-11-14T21:31:05.470 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.15.105 smithi105.front.sepia.ceph.com smithi105
2023-11-14T21:31:05.471 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105
2023-11-14T21:31:05.584 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hosts
2023-11-14T21:31:05.609 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/172.21.15.105/172.21.15.105/g' /etc/hosts
2023-11-14T21:31:05.674 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hostname
2023-11-14T21:31:05.739 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105
2023-11-14T21:31:05.803 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release
2023-11-14T21:31:05.858 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="Red Hat Enterprise Linux"
2023-11-14T21:31:05.860 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="8.4 (Ootpa)"
2023-11-14T21:31:05.860 INFO:teuthology.orchestra.run.smithi105.stdout:ID="rhel"
2023-11-14T21:31:05.860 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="fedora"
2023-11-14T21:31:05.860 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="8.4"
2023-11-14T21:31:05.861 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el8"
2023-11-14T21:31:05.861 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-11-14T21:31:05.862 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31"
2023-11-14T21:31:05.862 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-11-14T21:31:05.862 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://www.redhat.com/"
2023-11-14T21:31:05.863 INFO:teuthology.orchestra.run.smithi105.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-14T21:31:05.863 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-14T21:31:05.864 INFO:teuthology.orchestra.run.smithi105.stdout:
2023-11-14T21:31:05.864 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-14T21:31:05.864 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-11-14T21:31:05.865 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-14T21:31:05.865 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-11-14T21:31:05.866 INFO:teuthology.provision.fog.smithi105:Deploy complete!
2023-11-14T21:31:05.867 DEBUG:teuthology.parallel:result is None
2023-11-14T21:31:41.046 WARNING:teuthology.provision.fog.smithi157:timed out
2023-11-14T21:31:47.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-14T21:31:47.414 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-14T21:31:47.414 DEBUG:teuthology.orchestra.run.smithi157:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-14T21:31:47.707 INFO:teuthology.provision.fog.smithi157:Node is ready
2023-11-14T21:31:47.708 DEBUG:teuthology.orchestra.run.smithi157:> hostname
2023-11-14T21:31:47.721 INFO:teuthology.orchestra.run.smithi157.stdout:smithi157.front.sepia.ceph.com
2023-11-14T21:31:47.722 DEBUG:teuthology.orchestra.run.smithi157:> grep smithi157.front.sepia.ceph.com /etc/hosts
2023-11-14T21:31:47.775 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.15.157 smithi157.front.sepia.ceph.com smithi157
2023-11-14T21:31:47.776 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157
2023-11-14T21:31:47.897 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157.front.sepia.ceph.com/smithi157/g' /etc/hosts
2023-11-14T21:31:47.921 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/172.21.15.157/172.21.15.157/g' /etc/hosts
2023-11-14T21:31:47.984 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157.front.sepia.ceph.com/smithi157/g' /etc/hostname
2023-11-14T21:31:48.049 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157
2023-11-14T21:31:48.112 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release
2023-11-14T21:31:48.166 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Red Hat Enterprise Linux"
2023-11-14T21:31:48.166 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8.4 (Ootpa)"
2023-11-14T21:31:48.166 INFO:teuthology.orchestra.run.smithi157.stdout:ID="rhel"
2023-11-14T21:31:48.167 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="fedora"
2023-11-14T21:31:48.167 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8.4"
2023-11-14T21:31:48.167 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8"
2023-11-14T21:31:48.167 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-11-14T21:31:48.167 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31"
2023-11-14T21:31:48.167 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-11-14T21:31:48.168 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.redhat.com/"
2023-11-14T21:31:48.168 INFO:teuthology.orchestra.run.smithi157.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-14T21:31:48.168 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-14T21:31:48.168 INFO:teuthology.orchestra.run.smithi157.stdout:
2023-11-14T21:31:48.169 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-14T21:31:48.169 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-11-14T21:31:48.169 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-14T21:31:48.169 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-11-14T21:31:48.169 INFO:teuthology.provision.fog.smithi157:Deploy complete!
2023-11-14T21:31:48.170 DEBUG:teuthology.parallel:result is None
2023-11-14T21:31:48.321 INFO:teuthology.lock.ops:Checking smithi105.front.sepia.ceph.com
2023-11-14T21:31:48.322 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-14T21:31:48.350 INFO:teuthology.lock.ops:Checking smithi157.front.sepia.ceph.com
2023-11-14T21:31:48.351 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-14T21:31:48.376 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: set os type and version on server
2023-11-14T21:31:48.377 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com'
2023-11-14T21:31:48.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-14T21:31:48.447 DEBUG:teuthology.orchestra.run.smithi105:> true
2023-11-14T21:31:48.564 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi105.front.sepia.ceph.com'
2023-11-14T21:31:48.565 DEBUG:teuthology.orchestra.run.smithi105:> uname -m
2023-11-14T21:31:48.619 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64
2023-11-14T21:31:48.620 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release
2023-11-14T21:31:48.674 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="Red Hat Enterprise Linux"
2023-11-14T21:31:48.675 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="8.4 (Ootpa)"
2023-11-14T21:31:48.675 INFO:teuthology.orchestra.run.smithi105.stdout:ID="rhel"
2023-11-14T21:31:48.675 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="fedora"
2023-11-14T21:31:48.675 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="8.4"
2023-11-14T21:31:48.676 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el8"
2023-11-14T21:31:48.676 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-11-14T21:31:48.676 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31"
2023-11-14T21:31:48.676 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-11-14T21:31:48.676 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://www.redhat.com/"
2023-11-14T21:31:48.677 INFO:teuthology.orchestra.run.smithi105.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-14T21:31:48.677 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-14T21:31:48.677 INFO:teuthology.orchestra.run.smithi105.stdout:
2023-11-14T21:31:48.677 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-14T21:31:48.677 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-11-14T21:31:48.678 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-14T21:31:48.678 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-11-14T21:31:48.679 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server
2023-11-14T21:31:48.700 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: set os type and version on server
2023-11-14T21:31:48.701 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com'
2023-11-14T21:31:48.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-14T21:31:48.763 DEBUG:teuthology.orchestra.run.smithi157:> true
2023-11-14T21:31:48.784 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com'
2023-11-14T21:31:48.784 DEBUG:teuthology.orchestra.run.smithi157:> uname -m
2023-11-14T21:31:48.836 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64
2023-11-14T21:31:48.836 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release
2023-11-14T21:31:48.887 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Red Hat Enterprise Linux"
2023-11-14T21:31:48.888 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8.4 (Ootpa)"
2023-11-14T21:31:48.888 INFO:teuthology.orchestra.run.smithi157.stdout:ID="rhel"
2023-11-14T21:31:48.888 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="fedora"
2023-11-14T21:31:48.888 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8.4"
2023-11-14T21:31:48.889 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8"
2023-11-14T21:31:48.889 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-11-14T21:31:48.889 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31"
2023-11-14T21:31:48.889 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-11-14T21:31:48.890 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.redhat.com/"
2023-11-14T21:31:48.890 INFO:teuthology.orchestra.run.smithi157.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-14T21:31:48.890 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-14T21:31:48.890 INFO:teuthology.orchestra.run.smithi157.stdout:
2023-11-14T21:31:48.890 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-14T21:31:48.891 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-11-14T21:31:48.891 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-14T21:31:48.891 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-11-14T21:31:48.892 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server
2023-11-14T21:31:48.917 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-14T21:31:49.010 INFO:teuthology.dispatcher.supervisor:Running job 7457764
2023-11-14T21:31:49.010 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-11-14_15:40:04-rados-wip-yuri2-testing-2023-11-13-0820-pacific-distro-default-smithi/7457764 --name yuriw-2023-11-14_15:40:04-rados-wip-yuri2-testing-2023-11-13-0820-pacific-distro-default-smithi --description rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} -- /home/teuthworker/archive/yuriw-2023-11-14_15:40:04-rados-wip-yuri2-testing-2023-11-13-0820-pacific-distro-default-smithi/7457764/orig.config.yaml
2023-11-14T21:31:49.014 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-11-14_15:40:04-rados-wip-yuri2-testing-2023-11-13-0820-pacific-distro-default-smithi/7457764
2023-11-14T21:31:49.014 INFO:teuthology.dispatcher.supervisor:Job PID: 1940296
2023-11-14T21:31:49.015 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-14T21:33:49.115 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-14T21:35:49.296 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-14T21:37:49.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-14T21:39:49.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-14T21:41:49.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-14T21:43:49.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-14T21:45:50.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-14T21:47:50.323 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-14T21:49:50.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-14T21:51:50.661 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-14T21:53:50.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-14T21:55:50.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-14T21:57:51.164 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-14T21:59:51.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-14T22:01:51.496 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-14T22:01:51.561 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-11-14T22:01:51.656 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-11-14T22:01:51.657 INFO:teuthology.nuke:Checking targets against current locks
2023-11-14T22:01:51.705 DEBUG:teuthology.nuke:shortname: smithi105
2023-11-14T22:01:51.706 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-14T22:01:51.730 DEBUG:teuthology.nuke:shortname: smithi157
2023-11-14T22:01:51.731 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-14T22:01:51.734 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi105.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-14_15:40:04-rados-wip-yuri2-testing-2023-11-13-0820-pacific-distro-default-smithi/7457764', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-14 21:25:59.905691', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOYXLrU9oMorgc0GE3EUZoSsGoMj6BFPdsU9O977q+z56QEEII4zP2e/hOLD5E6S1iczMmhefUbkxaAa5GsRLd4='}
2023-11-14T22:01:51.757 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-14_15:40:04-rados-wip-yuri2-testing-2023-11-13-0820-pacific-distro-default-smithi/7457764', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-14 21:25:59.907576', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCSRajnJ1QQztUMKzqEO2MNfOLr2EkAC/EzZodELewkXvS6CRoyC6+8oMfEZKndya1lzl/lQvyPNM9vP3CTeyng='}
2023-11-14T22:01:51.790 INFO:teuthology.orchestra.console.smithi105:Power off
2023-11-14T22:01:51.790 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-14T22:01:51.816 DEBUG:teuthology.orchestra.console.smithi105:power off output: Chassis Power Control: Down/Off
2023-11-14T22:01:51.817 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-14T22:01:51.838 INFO:teuthology.orchestra.console.smithi157:Power off
2023-11-14T22:01:51.839 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-14T22:01:51.850 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off
2023-11-14T22:01:51.863 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off
2023-11-14T22:01:51.864 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-14T22:01:51.887 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off
2023-11-14T22:01:51.951 INFO:teuthology.orchestra.console.smithi105:Power off completed
2023-11-14T22:01:51.989 INFO:teuthology.orchestra.console.smithi157:Power off completed
2023-11-14T22:01:52.114 INFO:teuthology.lock.ops:unlocked: smithi105.front.sepia.ceph.com
2023-11-14T22:01:52.145 INFO:teuthology.lock.ops:unlocked: smithi157.front.sepia.ceph.com