2023-08-16T00:58:00.048 INFO:root:teuthology version: 0.0.1.dev183+g5435569
2023-08-16T00:58:00.050 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-16T00:58:00.195 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f12606d37c0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f125ffafee0>, signals=[15])
2023-08-16T00:58:00.198 INFO:teuthology.lock.ops:Start node 'smithi105.front.sepia.ceph.com' reimaging
2023-08-16T00:58:00.198 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: reset os type and version on server
2023-08-16T00:58:00.199 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server
2023-08-16T00:58:00.223 INFO:teuthology.lock.ops:Start node 'smithi162.front.sepia.ceph.com' reimaging
2023-08-16T00:58:00.223 INFO:teuthology.lock.ops:Updating [smithi162.front.sepia.ceph.com]: reset os type and version on server
2023-08-16T00:58:00.223 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server
2023-08-16T00:58:00.225 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /host {"name": "smithi105"}
2023-08-16T00:58:00.247 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /host {"name": "smithi162"}
2023-08-16T00:58:00.296 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-08-16T00:58:00.326 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-08-16T00:58:00.339 DEBUG:teuthology.provision.fog.smithi105:Requesting image smithi_rhel_8.4 (ID 7)
2023-08-16T00:58:00.339 DEBUG:teuthology.provision.fog.smithi105:FOG request: PUT /host/210 {"imageID": 7}
2023-08-16T00:58:00.378 DEBUG:teuthology.provision.fog.smithi162:Requesting image smithi_rhel_8.4 (ID 7)
2023-08-16T00:58:00.379 DEBUG:teuthology.provision.fog.smithi162:FOG request: PUT /host/267 {"imageID": 7}
2023-08-16T00:58:00.382 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of rhel 8.4
2023-08-16T00:58:00.382 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-08-16T00:58:00.429 INFO:teuthology.provision.fog.smithi162:Scheduling deploy of rhel 8.4
2023-08-16T00:58:00.430 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None
2023-08-16T00:58:00.433 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /tasktype {"name": "deploy"}
2023-08-16T00:58:00.469 DEBUG:teuthology.provision.fog.smithi105:FOG request: POST /host/210/task {"taskTypeID": 1}
2023-08-16T00:58:00.479 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /tasktype {"name": "deploy"}
2023-08-16T00:58:00.515 DEBUG:teuthology.provision.fog.smithi162:FOG request: POST /host/267/task {"taskTypeID": 1}
2023-08-16T00:58:00.522 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-08-16T00:58:00.562 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None
2023-08-16T00:58:00.602 INFO:teuthology.orchestra.console.smithi105:Power off
2023-08-16T00:58:00.604 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-16T00:58:00.630 DEBUG:teuthology.orchestra.console.smithi105:power off output: Chassis Power Control: Down/Off
2023-08-16T00:58:00.630 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T00:58:00.650 INFO:teuthology.orchestra.console.smithi162:Power off
2023-08-16T00:58:00.651 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-16T00:58:00.662 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off
2023-08-16T00:58:00.676 DEBUG:teuthology.orchestra.console.smithi162:power off output: Chassis Power Control: Down/Off
2023-08-16T00:58:00.676 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T00:58:00.698 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off
2023-08-16T00:58:00.763 INFO:teuthology.orchestra.console.smithi105:Power off completed
2023-08-16T00:58:00.800 INFO:teuthology.orchestra.console.smithi162:Power off completed
2023-08-16T00:58:00.865 INFO:teuthology.orchestra.console.smithi105:Power on
2023-08-16T00:58:00.865 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-16T00:58:00.888 DEBUG:teuthology.orchestra.console.smithi105:power on output: Chassis Power Control: Up/On
2023-08-16T00:58:00.889 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T00:58:00.901 INFO:teuthology.orchestra.console.smithi162:Power on
2023-08-16T00:58:00.902 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-16T00:58:00.914 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off
2023-08-16T00:58:00.925 DEBUG:teuthology.orchestra.console.smithi162:power on output: Chassis Power Control: Up/On
2023-08-16T00:58:00.925 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T00:58:00.953 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off
2023-08-16T00:58:04.920 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T00:58:04.955 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T00:58:05.033 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on
2023-08-16T00:58:05.067 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off
2023-08-16T00:58:05.134 INFO:teuthology.orchestra.console.smithi105:Power on completed
2023-08-16T00:58:05.235 INFO:teuthology.provision.fog.smithi105:Waiting for deploy to finish
2023-08-16T00:58:05.235 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-08-16T00:58:15.245 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T00:58:15.355 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on
2023-08-16T00:58:15.456 INFO:teuthology.orchestra.console.smithi162:Power on completed
2023-08-16T00:58:15.557 INFO:teuthology.provision.fog.smithi162:Waiting for deploy to finish
2023-08-16T00:58:15.558 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None
2023-08-16T00:58:30.316 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-08-16T00:58:35.618 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None
2023-08-16T00:58:50.388 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-08-16T00:58:55.687 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None
2023-08-16T00:59:10.453 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-08-16T00:59:20.756 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None
2023-08-16T00:59:30.524 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-08-16T00:59:40.823 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None
2023-08-16T00:59:50.588 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-08-16T01:00:00.892 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None
2023-08-16T01:00:10.660 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-08-16T01:00:20.976 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None
2023-08-16T01:00:25.892 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-08-16T01:00:36.077 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None
2023-08-16T01:00:45.983 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-08-16T01:00:51.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-16T01:00:56.053 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None
2023-08-16T01:01:01.059 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2023-08-16T01:01:01.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-16T01:01:04.176 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162
2023-08-16T01:01:07.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-16T01:01:10.128 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2023-08-16T01:01:10.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-16T01:01:13.232 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162
2023-08-16T01:01:16.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-16T01:01:21.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-16T01:01:24.208 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162
2023-08-16T01:01:24.209 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2023-08-16T01:01:30.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-16T01:01:30.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-16T01:01:35.216 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162
2023-08-16T01:01:38.288 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2023-08-16T01:01:41.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-16T01:01:46.225 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-16T01:01:51.229 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162
2023-08-16T01:01:57.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-16T01:02:23.227 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-16T01:02:23.228 DEBUG:teuthology.orchestra.run.smithi105:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-16T01:02:43.986 INFO:teuthology.provision.fog.smithi105:Node is ready
2023-08-16T01:02:43.987 DEBUG:teuthology.orchestra.run.smithi105:> hostname
2023-08-16T01:02:44.003 INFO:teuthology.orchestra.run.smithi105.stdout:smithi105.front.sepia.ceph.com
2023-08-16T01:02:44.003 DEBUG:teuthology.orchestra.run.smithi105:> grep smithi105.front.sepia.ceph.com /etc/hosts
2023-08-16T01:02:44.058 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.15.105 smithi105.front.sepia.ceph.com smithi105
2023-08-16T01:02:44.058 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105
2023-08-16T01:02:44.174 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hosts
2023-08-16T01:02:44.198 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/172.21.15.105/172.21.15.105/g' /etc/hosts
2023-08-16T01:02:44.262 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hostname
2023-08-16T01:02:44.325 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105
2023-08-16T01:02:44.388 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release
2023-08-16T01:02:44.442 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="Red Hat Enterprise Linux"
2023-08-16T01:02:44.442 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="8.4 (Ootpa)"
2023-08-16T01:02:44.443 INFO:teuthology.orchestra.run.smithi105.stdout:ID="rhel"
2023-08-16T01:02:44.443 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="fedora"
2023-08-16T01:02:44.443 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="8.4"
2023-08-16T01:02:44.443 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el8"
2023-08-16T01:02:44.443 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-08-16T01:02:44.443 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31"
2023-08-16T01:02:44.443 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-08-16T01:02:44.444 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://www.redhat.com/"
2023-08-16T01:02:44.444 INFO:teuthology.orchestra.run.smithi105.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-16T01:02:44.444 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-16T01:02:44.444 INFO:teuthology.orchestra.run.smithi105.stdout:
2023-08-16T01:02:44.444 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-16T01:02:44.444 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-08-16T01:02:44.445 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-16T01:02:44.445 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-08-16T01:02:44.445 INFO:teuthology.provision.fog.smithi105:Deploy complete!
2023-08-16T01:02:44.447 DEBUG:teuthology.parallel:result is None
2023-08-16T01:03:02.253 WARNING:teuthology.provision.fog.smithi162:timed out
2023-08-16T01:03:08.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-16T01:03:08.468 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-16T01:03:08.468 DEBUG:teuthology.orchestra.run.smithi162:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-16T01:03:08.704 INFO:teuthology.provision.fog.smithi162:Node is ready
2023-08-16T01:03:08.704 DEBUG:teuthology.orchestra.run.smithi162:> hostname
2023-08-16T01:03:08.758 INFO:teuthology.orchestra.run.smithi162.stdout:smithi162.front.sepia.ceph.com
2023-08-16T01:03:08.758 DEBUG:teuthology.orchestra.run.smithi162:> grep smithi162.front.sepia.ceph.com /etc/hosts
2023-08-16T01:03:08.812 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.15.162 smithi162.front.sepia.ceph.com smithi162
2023-08-16T01:03:08.813 DEBUG:teuthology.orchestra.run.smithi162:> sudo hostname smithi162
2023-08-16T01:03:08.922 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/smithi162.front.sepia.ceph.com/smithi162/g' /etc/hosts
2023-08-16T01:03:08.947 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/172.21.15.162/172.21.15.162/g' /etc/hosts
2023-08-16T01:03:09.012 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/smithi162.front.sepia.ceph.com/smithi162/g' /etc/hostname
2023-08-16T01:03:09.076 DEBUG:teuthology.orchestra.run.smithi162:> sudo hostname smithi162
2023-08-16T01:03:09.139 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release
2023-08-16T01:03:09.193 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="Red Hat Enterprise Linux"
2023-08-16T01:03:09.193 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="8.4 (Ootpa)"
2023-08-16T01:03:09.194 INFO:teuthology.orchestra.run.smithi162.stdout:ID="rhel"
2023-08-16T01:03:09.194 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="fedora"
2023-08-16T01:03:09.194 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="8.4"
2023-08-16T01:03:09.194 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el8"
2023-08-16T01:03:09.194 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-08-16T01:03:09.194 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31"
2023-08-16T01:03:09.195 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-08-16T01:03:09.195 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://www.redhat.com/"
2023-08-16T01:03:09.195 INFO:teuthology.orchestra.run.smithi162.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-16T01:03:09.195 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-16T01:03:09.195 INFO:teuthology.orchestra.run.smithi162.stdout:
2023-08-16T01:03:09.195 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-16T01:03:09.195 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-08-16T01:03:09.196 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-16T01:03:09.196 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-08-16T01:03:09.196 INFO:teuthology.provision.fog.smithi162:Deploy complete!
2023-08-16T01:03:09.197 DEBUG:teuthology.parallel:result is None
2023-08-16T01:04:04.369 INFO:teuthology.lock.ops:Checking smithi105.front.sepia.ceph.com
2023-08-16T01:04:04.370 INFO:teuthology.lock.ops:New key found. Updating...
2023-08-16T01:04:08.784 INFO:teuthology.lock.ops:Checking smithi162.front.sepia.ceph.com
2023-08-16T01:04:08.785 INFO:teuthology.lock.ops:New key found. Updating...
2023-08-16T01:04:08.802 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: set os type and version on server
2023-08-16T01:04:08.803 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com'
2023-08-16T01:04:08.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-16T01:04:08.872 DEBUG:teuthology.orchestra.run.smithi105:> true
2023-08-16T01:04:08.996 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi105.front.sepia.ceph.com'
2023-08-16T01:04:08.996 DEBUG:teuthology.orchestra.run.smithi105:> uname -m
2023-08-16T01:04:09.052 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64
2023-08-16T01:04:09.052 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release
2023-08-16T01:04:09.107 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="Red Hat Enterprise Linux"
2023-08-16T01:04:09.107 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="8.4 (Ootpa)"
2023-08-16T01:04:09.108 INFO:teuthology.orchestra.run.smithi105.stdout:ID="rhel"
2023-08-16T01:04:09.108 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="fedora"
2023-08-16T01:04:09.108 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="8.4"
2023-08-16T01:04:09.108 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el8"
2023-08-16T01:04:09.108 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-08-16T01:04:09.108 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31"
2023-08-16T01:04:09.108 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-08-16T01:04:09.109 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://www.redhat.com/"
2023-08-16T01:04:09.109 INFO:teuthology.orchestra.run.smithi105.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-16T01:04:09.109 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-16T01:04:09.109 INFO:teuthology.orchestra.run.smithi105.stdout:
2023-08-16T01:04:09.109 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-16T01:04:09.109 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-08-16T01:04:09.109 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-16T01:04:09.110 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-08-16T01:04:09.110 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server
2023-08-16T01:04:09.134 INFO:teuthology.lock.ops:Updating [smithi162.front.sepia.ceph.com]: set os type and version on server
2023-08-16T01:04:09.135 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com'
2023-08-16T01:04:09.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-16T01:04:09.200 DEBUG:teuthology.orchestra.run.smithi162:> true
2023-08-16T01:04:09.319 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com'
2023-08-16T01:04:09.320 DEBUG:teuthology.orchestra.run.smithi162:> uname -m
2023-08-16T01:04:09.374 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64
2023-08-16T01:04:09.375 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release
2023-08-16T01:04:09.430 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="Red Hat Enterprise Linux"
2023-08-16T01:04:09.431 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="8.4 (Ootpa)"
2023-08-16T01:04:09.431 INFO:teuthology.orchestra.run.smithi162.stdout:ID="rhel"
2023-08-16T01:04:09.431 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="fedora"
2023-08-16T01:04:09.431 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="8.4"
2023-08-16T01:04:09.431 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el8"
2023-08-16T01:04:09.431 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-08-16T01:04:09.431 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31"
2023-08-16T01:04:09.432 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-08-16T01:04:09.432 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://www.redhat.com/"
2023-08-16T01:04:09.432 INFO:teuthology.orchestra.run.smithi162.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-16T01:04:09.432 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-16T01:04:09.432 INFO:teuthology.orchestra.run.smithi162.stdout:
2023-08-16T01:04:09.432 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-16T01:04:09.432 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-08-16T01:04:09.433 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-16T01:04:09.433 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-08-16T01:04:09.434 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server
2023-08-16T01:04:14.474 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-16T01:04:14.599 INFO:teuthology.dispatcher.supervisor:Running job 7369135
2023-08-16T01:04:14.599 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-08-15_17:00:18-rbd-wip-yuri7-testing-2023-08-15-0741-pacific-distro-default-smithi/7369135 --name yuriw-2023-08-15_17:00:18-rbd-wip-yuri7-testing-2023-08-15-0741-pacific-distro-default-smithi --description rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} -- /home/teuthworker/archive/yuriw-2023-08-15_17:00:18-rbd-wip-yuri7-testing-2023-08-15-0741-pacific-distro-default-smithi/7369135/orig.config.yaml
2023-08-16T01:04:14.604 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-08-15_17:00:18-rbd-wip-yuri7-testing-2023-08-15-0741-pacific-distro-default-smithi/7369135
2023-08-16T01:04:14.605 INFO:teuthology.dispatcher.supervisor:Job PID: 16444
2023-08-16T01:04:14.606 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-08-16T01:06:14.704 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-16T01:08:19.870 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-16T01:10:25.041 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-16T01:12:28.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-16T01:14:33.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-16T01:16:39.069 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-16T01:18:44.233 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-16T01:20:49.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-16T01:22:54.569 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-16T01:24:54.745 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-16T01:26:59.917 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-16T01:29:03.341 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-16T01:31:08.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-16T01:31:13.583 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-08-16T01:31:23.704 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-08-16T01:31:23.705 INFO:teuthology.nuke:Checking targets against current locks
2023-08-16T01:31:38.773 DEBUG:teuthology.nuke:shortname: smithi105
2023-08-16T01:31:38.774 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-16T01:31:38.783 DEBUG:teuthology.nuke:shortname: smithi162
2023-08-16T01:31:38.783 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-16T01:31:38.797 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi105.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-15_17:00:18-rbd-wip-yuri7-testing-2023-08-15-0741-pacific-distro-default-smithi/7369135', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-16 00:57:59.162930', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCfFmRffLFI9dlKgEgXjA+OcJPxa53sBOPCTrFYVJvOxgcVQK0Plu777cDOcmTRZadTzMF3m5aJZ/vfDNX5tLamuRxNMOqQq+1dgOdMaKLWxhHUrYvlvHuMvA741CBzhpef264IsS43LDoStgZc6qWD6XlZzCET+NC0ktSfAJ+nMk4LiFd+iBFEVzU6JV6U72kC+xO+oMG83QjG63d9Tu6DKvPWxNpg/f1K+d4J/Gpv0eHgCLaPj86P21vu/rTp3dtl73zKcxZaW8BnBZwZzUwSm2prvfmdgsDMPGVZtyUiZswNZRSJoBvM3fwdb2lC4e0iBK4Y01AAy3MptfPDhp0WKeKG1oIvM0PvqKHGFd1RGhf9gM0nvJuJYHdCcapFR7s+GIW5SGkv92pbHwdgMLJyo4Afb0irnZe1jJ/LAaenzcsgLaq2qjwJMwcBrpUdqw2EjGP4QUIEbm/PvOfkOdU40OUeyfaNvisR26obQnEZrKvfTGTGb+OaX3y1ovUWwKc='}
2023-08-16T01:31:38.812 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi162.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-15_17:00:18-rbd-wip-yuri7-testing-2023-08-15-0741-pacific-distro-default-smithi/7369135', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-16 00:57:59.163803', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDWTfIP9cCY2XQArNDGs9S/JQdSvdLPk0jhrEGfEP2H+b35vJcMqFjWPByr5lLCd3Of6d9oONlv+QQLyQkhEtiJxVSK1lvQTBoJkxXnGvIrDgZfgbQFn/NwYwd6a3hHje9w1e2pKQZq18LLTkFPHcDv0U8TyGJWOwU2Ys6TU+kIIctE/FcoDH58DL/GdjNTnaHdwlTMWOTDZ7da5RX3KxaG9vocDnESegnfge0ouc7tw9rWY1YPWlhpY5jRxguoXRIDTQMZ5T+axn+udyrma3zUe/qTAXyPdqsmJOIqQ1ydJt4jbBzg0TaEFLYIQ9fuFqDrcmr4ytw+mPe0RZ95xnqd/qTvJnE8V9daqasxP2az5IDnbmeXVW0tTnN8r9V7fcSTSTpAJs/ypIY/xWGTSLc7uL34zM7do3a40ViDGtLgqEY8T+Z6TNvFDyE7b8xr14WcmkcDHpylDSoS4dqI8YgvkY1BOaGtyM6nAM/9p7LZgoBp9vvMmLPNXFmJrkIokXk='}
2023-08-16T01:31:38.850 INFO:teuthology.orchestra.console.smithi105:Power off
2023-08-16T01:31:38.851 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-16T01:31:38.869 INFO:teuthology.orchestra.console.smithi162:Power off
2023-08-16T01:31:38.869 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-16T01:31:38.881 DEBUG:teuthology.orchestra.console.smithi105:power off output: Chassis Power Control: Down/Off
2023-08-16T01:31:38.882 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T01:31:38.893 DEBUG:teuthology.orchestra.console.smithi162:power off output: Chassis Power Control: Down/Off
2023-08-16T01:31:38.894 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T01:31:38.906 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off
2023-08-16T01:31:38.916 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off
2023-08-16T01:31:39.008 INFO:teuthology.orchestra.console.smithi105:Power off completed
2023-08-16T01:31:39.018 INFO:teuthology.orchestra.console.smithi162:Power off completed
2023-08-16T01:31:59.182 INFO:teuthology.lock.ops:unlocked: smithi162.front.sepia.ceph.com
2023-08-16T01:31:59.190 INFO:teuthology.lock.ops:unlocked: smithi105.front.sepia.ceph.com