2024-01-24T08:28:34.487 INFO:root:teuthology version: 0.0.1.dev251+gc856e0f
2024-01-24T08:28:34.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T08:28:34.643 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fba3e20af40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fba3f270c10>, signals=[15])
2024-01-24T08:28:34.643 INFO:teuthology.lock.ops:Start node 'smithi088.front.sepia.ceph.com' reimaging
2024-01-24T08:28:34.644 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: reset os type and version on server
2024-01-24T08:28:34.644 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server
2024-01-24T08:28:34.668 INFO:teuthology.lock.ops:Start node 'smithi112.front.sepia.ceph.com' reimaging
2024-01-24T08:28:34.668 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: reset os type and version on server
2024-01-24T08:28:34.668 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server
2024-01-24T08:28:34.798 DEBUG:teuthology.provision.fog.smithi088:Requesting image smithi_rhel_8.6 (ID 5)
2024-01-24T08:28:34.804 DEBUG:teuthology.provision.fog.smithi112:Requesting image smithi_rhel_8.6 (ID 5)
2024-01-24T08:28:34.848 INFO:teuthology.provision.fog.smithi088:Scheduling deploy of rhel 8.6
2024-01-24T08:28:34.852 INFO:teuthology.provision.fog.smithi112:Scheduling deploy of rhel 8.6
2024-01-24T08:28:35.141 INFO:teuthology.orchestra.console.smithi112:Power off
2024-01-24T08:28:35.141 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-24T08:28:35.155 INFO:teuthology.orchestra.console.smithi088:Power off
2024-01-24T08:28:35.155 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-24T08:28:35.166 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off
2024-01-24T08:28:35.166 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T08:28:35.178 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off
2024-01-24T08:28:35.179 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T08:28:35.187 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on
2024-01-24T08:28:35.200 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on
2024-01-24T08:28:39.188 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T08:28:39.201 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T08:28:39.298 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on
2024-01-24T08:28:39.310 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on
2024-01-24T08:28:43.303 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T08:28:43.310 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T08:28:43.412 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on
2024-01-24T08:28:43.418 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off
2024-01-24T08:28:43.519 INFO:teuthology.orchestra.console.smithi088:Power off completed
2024-01-24T08:28:43.619 INFO:teuthology.orchestra.console.smithi088:Power on
2024-01-24T08:28:43.619 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-24T08:28:43.640 DEBUG:teuthology.orchestra.console.smithi088:power on output: Chassis Power Control: Up/On
2024-01-24T08:28:43.641 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T08:28:43.662 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off
2024-01-24T08:28:47.416 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T08:28:47.525 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off
2024-01-24T08:28:47.626 INFO:teuthology.orchestra.console.smithi112:Power off completed
2024-01-24T08:28:47.663 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T08:28:47.727 INFO:teuthology.orchestra.console.smithi112:Power on
2024-01-24T08:28:47.728 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-24T08:28:47.747 DEBUG:teuthology.orchestra.console.smithi112:power on output: Chassis Power Control: Up/On
2024-01-24T08:28:47.747 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T08:28:47.768 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off
2024-01-24T08:28:47.772 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off
2024-01-24T08:28:51.772 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T08:28:51.778 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T08:28:51.880 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on
2024-01-24T08:28:51.961 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on
2024-01-24T08:28:51.981 INFO:teuthology.orchestra.console.smithi112:Power on completed
2024-01-24T08:28:52.062 INFO:teuthology.orchestra.console.smithi088:Power on completed
2024-01-24T08:28:52.082 INFO:teuthology.provision.fog.smithi112:Waiting for deploy to finish
2024-01-24T08:28:52.162 INFO:teuthology.provision.fog.smithi088:Waiting for deploy to finish
2024-01-24T08:31:38.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T08:31:41.148 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2024-01-24T08:31:47.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T08:31:50.204 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2024-01-24T08:31:53.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T08:31:56.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T08:31:56.224 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2024-01-24T08:31:59.260 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2024-01-24T08:32:02.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T08:32:05.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T08:32:05.308 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2024-01-24T08:32:08.316 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2024-01-24T08:32:11.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T08:32:14.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T08:32:14.364 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2024-01-24T08:32:17.408 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2024-01-24T08:32:20.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T08:32:23.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T08:32:23.420 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2024-01-24T08:32:26.496 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2024-01-24T08:32:29.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T08:32:32.480 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2024-01-24T08:32:32.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T08:32:35.552 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2024-01-24T08:32:38.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T08:32:41.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T08:32:41.564 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2024-01-24T08:32:47.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T08:32:50.652 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2024-01-24T08:32:56.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T08:33:15.068 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2024-01-24T08:33:21.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T08:33:24.124 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2024-01-24T08:33:30.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T08:33:30.349 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-24T08:33:30.350 DEBUG:teuthology.orchestra.run.smithi088:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-24T08:33:41.559 WARNING:teuthology.provision.fog.smithi112:timed out
2024-01-24T08:33:47.561 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T08:33:47.816 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-24T08:33:47.816 DEBUG:teuthology.orchestra.run.smithi112:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-24T08:33:48.080 INFO:teuthology.provision.fog.smithi112:Node is ready
2024-01-24T08:33:48.080 DEBUG:teuthology.orchestra.run.smithi112:> hostname
2024-01-24T08:33:48.141 INFO:teuthology.orchestra.run.smithi112.stdout:smithi112.front.sepia.ceph.com
2024-01-24T08:33:48.141 DEBUG:teuthology.orchestra.run.smithi112:> grep smithi112.front.sepia.ceph.com /etc/hosts
2024-01-24T08:33:48.201 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112 smithi112.front.sepia.ceph.com smithi112
2024-01-24T08:33:48.201 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112
2024-01-24T08:33:48.318 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hosts
2024-01-24T08:33:48.348 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/172.21.15.112/172.21.15.112/g' /etc/hosts
2024-01-24T08:33:48.417 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hostname
2024-01-24T08:33:48.486 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112
2024-01-24T08:33:48.554 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release
2024-01-24T08:33:48.611 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="Red Hat Enterprise Linux"
2024-01-24T08:33:48.611 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="8.6 (Ootpa)"
2024-01-24T08:33:48.611 INFO:teuthology.orchestra.run.smithi112.stdout:ID="rhel"
2024-01-24T08:33:48.611 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="fedora"
2024-01-24T08:33:48.611 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="8.6"
2024-01-24T08:33:48.611 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el8"
2024-01-24T08:33:48.611 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-24T08:33:48.612 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31"
2024-01-24T08:33:48.612 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-24T08:33:48.612 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://www.redhat.com/"
2024-01-24T08:33:48.612 INFO:teuthology.orchestra.run.smithi112.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-24T08:33:48.612 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-24T08:33:48.612 INFO:teuthology.orchestra.run.smithi112.stdout:
2024-01-24T08:33:48.612 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-24T08:33:48.612 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-24T08:33:48.612 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-24T08:33:48.612 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-24T08:33:48.613 INFO:teuthology.provision.fog.smithi112:Deploy complete!
2024-01-24T08:33:48.614 DEBUG:teuthology.parallel:result is None
2024-01-24T08:33:55.316 INFO:teuthology.provision.fog.smithi088:Node is ready
2024-01-24T08:33:55.316 DEBUG:teuthology.orchestra.run.smithi088:> hostname
2024-01-24T08:33:55.338 INFO:teuthology.orchestra.run.smithi088.stdout:smithi088.front.sepia.ceph.com
2024-01-24T08:33:55.339 DEBUG:teuthology.orchestra.run.smithi088:> grep smithi088.front.sepia.ceph.com /etc/hosts
2024-01-24T08:33:55.399 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88 smithi088.front.sepia.ceph.com smithi088
2024-01-24T08:33:55.399 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088
2024-01-24T08:33:55.535 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hosts
2024-01-24T08:33:55.565 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/172.21.15.88/172.21.15.88/g' /etc/hosts
2024-01-24T08:33:55.634 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hostname
2024-01-24T08:33:55.702 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088
2024-01-24T08:33:55.768 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release
2024-01-24T08:33:55.827 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="Red Hat Enterprise Linux"
2024-01-24T08:33:55.827 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="8.6 (Ootpa)"
2024-01-24T08:33:55.827 INFO:teuthology.orchestra.run.smithi088.stdout:ID="rhel"
2024-01-24T08:33:55.827 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="fedora"
2024-01-24T08:33:55.827 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="8.6"
2024-01-24T08:33:55.827 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el8"
2024-01-24T08:33:55.827 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-24T08:33:55.827 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31"
2024-01-24T08:33:55.827 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-24T08:33:55.827 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://www.redhat.com/"
2024-01-24T08:33:55.827 INFO:teuthology.orchestra.run.smithi088.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-24T08:33:55.828 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-24T08:33:55.828 INFO:teuthology.orchestra.run.smithi088.stdout:
2024-01-24T08:33:55.828 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-24T08:33:55.828 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-24T08:33:55.828 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-24T08:33:55.828 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-24T08:33:55.828 INFO:teuthology.provision.fog.smithi088:Deploy complete!
2024-01-24T08:33:55.829 DEBUG:teuthology.parallel:result is None
2024-01-24T08:33:56.012 INFO:teuthology.lock.ops:Checking smithi088.front.sepia.ceph.com
2024-01-24T08:33:56.013 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-24T08:33:56.032 INFO:teuthology.lock.ops:Checking smithi112.front.sepia.ceph.com
2024-01-24T08:33:56.032 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-24T08:33:56.050 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: set os type and version on server
2024-01-24T08:33:56.050 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com'
2024-01-24T08:33:56.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T08:33:56.120 DEBUG:teuthology.orchestra.run.smithi088:> true
2024-01-24T08:33:56.189 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com'
2024-01-24T08:33:56.189 DEBUG:teuthology.orchestra.run.smithi088:> uname -m
2024-01-24T08:33:56.246 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64
2024-01-24T08:33:56.246 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release
2024-01-24T08:33:56.302 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="Red Hat Enterprise Linux"
2024-01-24T08:33:56.302 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="8.6 (Ootpa)"
2024-01-24T08:33:56.303 INFO:teuthology.orchestra.run.smithi088.stdout:ID="rhel"
2024-01-24T08:33:56.303 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="fedora"
2024-01-24T08:33:56.303 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="8.6"
2024-01-24T08:33:56.303 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el8"
2024-01-24T08:33:56.303 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-24T08:33:56.303 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31"
2024-01-24T08:33:56.303 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-24T08:33:56.303 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://www.redhat.com/"
2024-01-24T08:33:56.303 INFO:teuthology.orchestra.run.smithi088.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-24T08:33:56.303 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-24T08:33:56.303 INFO:teuthology.orchestra.run.smithi088.stdout:
2024-01-24T08:33:56.303 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-24T08:33:56.303 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-24T08:33:56.303 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-24T08:33:56.304 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-24T08:33:56.304 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server
2024-01-24T08:33:56.324 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: set os type and version on server
2024-01-24T08:33:56.324 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com'
2024-01-24T08:33:56.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T08:33:56.400 DEBUG:teuthology.orchestra.run.smithi112:> true
2024-01-24T08:33:56.473 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com'
2024-01-24T08:33:56.473 DEBUG:teuthology.orchestra.run.smithi112:> uname -m
2024-01-24T08:33:56.532 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64
2024-01-24T08:33:56.533 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release
2024-01-24T08:33:56.592 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="Red Hat Enterprise Linux"
2024-01-24T08:33:56.592 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="8.6 (Ootpa)"
2024-01-24T08:33:56.592 INFO:teuthology.orchestra.run.smithi112.stdout:ID="rhel"
2024-01-24T08:33:56.592 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="fedora"
2024-01-24T08:33:56.592 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="8.6"
2024-01-24T08:33:56.592 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el8"
2024-01-24T08:33:56.593 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-24T08:33:56.593 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31"
2024-01-24T08:33:56.593 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-24T08:33:56.593 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://www.redhat.com/"
2024-01-24T08:33:56.593 INFO:teuthology.orchestra.run.smithi112.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-24T08:33:56.593 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-24T08:33:56.593 INFO:teuthology.orchestra.run.smithi112.stdout:
2024-01-24T08:33:56.593 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-24T08:33:56.593 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-24T08:33:56.593 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-24T08:33:56.593 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-24T08:33:56.594 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server
2024-01-24T08:33:56.624 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T08:33:56.719 INFO:teuthology.dispatcher.supervisor:Running job 7528198
2024-01-24T08:33:56.719 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-01-23_14:05:57-fs-wip-vshankar-testing1-reef-2024-01-23-1317-testing-default-smithi/7528198 --name vshankar-2024-01-23_14:05:57-fs-wip-vshankar-testing1-reef-2024-01-23-1317-testing-default-smithi --description fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_fsstress}} -- /home/teuthworker/archive/vshankar-2024-01-23_14:05:57-fs-wip-vshankar-testing1-reef-2024-01-23-1317-testing-default-smithi/7528198/orig.config.yaml
2024-01-24T08:33:56.722 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-01-23_14:05:57-fs-wip-vshankar-testing1-reef-2024-01-23-1317-testing-default-smithi/7528198
2024-01-24T08:33:56.722 INFO:teuthology.dispatcher.supervisor:Job PID: 1462997
2024-01-24T08:33:56.722 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-01-24T08:35:56.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T08:37:57.004 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T08:39:57.173 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T08:41:57.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T08:43:57.518 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T08:43:57.579 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-01-24T08:43:57.694 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2024-01-24T08:43:57.694 INFO:teuthology.nuke:Checking targets against current locks
2024-01-24T08:43:57.742 DEBUG:teuthology.nuke:shortname: smithi088
2024-01-24T08:43:57.742 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-24T08:43:57.762 DEBUG:teuthology.nuke:shortname: smithi112
2024-01-24T08:43:57.762 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-24T08:43:57.765 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-23_14:05:57-fs-wip-vshankar-testing1-reef-2024-01-23-1317-testing-default-smithi/7528198', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-24 08:28:33.415834', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBEcWvUz3wUw3iZKRdhIUFat724Cm3AbpAHGghL38S0rmXetplrF3iLC8++6O1pm8ZLV2I4tEuECAhfkPrD0yVo='}
2024-01-24T08:43:57.785 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-23_14:05:57-fs-wip-vshankar-testing1-reef-2024-01-23-1317-testing-default-smithi/7528198', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-24 08:28:33.413945', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGgbIDifUNCdRNrLnZETvAwniL0xuHEUED8DERmY7/54jKf3KEu4xMjMTVTM69w7pXpeBhfN3qCFT69FecmOp/E='}
2024-01-24T08:43:57.811 INFO:teuthology.orchestra.console.smithi088:Power off
2024-01-24T08:43:57.811 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-24T08:43:57.833 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off
2024-01-24T08:43:57.833 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T08:43:57.849 INFO:teuthology.orchestra.console.smithi112:Power off
2024-01-24T08:43:57.850 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-24T08:43:57.856 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off
2024-01-24T08:43:57.870 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off
2024-01-24T08:43:57.870 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T08:43:57.890 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off
2024-01-24T08:43:57.957 INFO:teuthology.orchestra.console.smithi088:Power off completed
2024-01-24T08:43:57.991 INFO:teuthology.orchestra.console.smithi112:Power off completed
2024-01-24T08:43:58.115 INFO:teuthology.lock.ops:unlocked: smithi088.front.sepia.ceph.com
2024-01-24T08:43:58.136 INFO:teuthology.lock.ops:unlocked: smithi112.front.sepia.ceph.com