2023-12-14T15:20:46.769 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e
2023-12-14T15:20:46.770 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T15:20:46.948 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f90d1eba2e0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f90d2e15940>, signals=[15])
2023-12-14T15:20:46.948 INFO:teuthology.lock.ops:Start node 'smithi039.front.sepia.ceph.com' reimaging
2023-12-14T15:20:46.948 INFO:teuthology.lock.ops:Updating [smithi039.front.sepia.ceph.com]: reset os type and version on server
2023-12-14T15:20:46.949 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server
2023-12-14T15:20:46.971 INFO:teuthology.lock.ops:Start node 'smithi144.front.sepia.ceph.com' reimaging
2023-12-14T15:20:46.971 INFO:teuthology.lock.ops:Updating [smithi144.front.sepia.ceph.com]: reset os type and version on server
2023-12-14T15:20:46.971 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server
2023-12-14T15:20:47.085 DEBUG:teuthology.provision.fog.smithi039:Requesting image smithi_rhel_8.4 (ID 7)
2023-12-14T15:20:47.105 DEBUG:teuthology.provision.fog.smithi144:Requesting image smithi_rhel_8.4 (ID 7)
2023-12-14T15:20:47.125 INFO:teuthology.provision.fog.smithi039:Scheduling deploy of rhel 8.4
2023-12-14T15:20:47.148 INFO:teuthology.provision.fog.smithi144:Scheduling deploy of rhel 8.4
2023-12-14T15:20:47.606 INFO:teuthology.orchestra.console.smithi039:Power off
2023-12-14T15:20:47.606 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-14T15:20:47.627 DEBUG:teuthology.orchestra.console.smithi039:power off output: Chassis Power Control: Down/Off
2023-12-14T15:20:47.628 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T15:20:47.650 INFO:teuthology.orchestra.console.smithi144:Power off
2023-12-14T15:20:47.650 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-14T15:20:47.659 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is off
2023-12-14T15:20:47.674 DEBUG:teuthology.orchestra.console.smithi144:power off output: Chassis Power Control: Down/Off
2023-12-14T15:20:47.674 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T15:20:47.695 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on
2023-12-14T15:20:47.760 INFO:teuthology.orchestra.console.smithi039:Power off completed
2023-12-14T15:20:47.860 INFO:teuthology.orchestra.console.smithi039:Power on
2023-12-14T15:20:47.861 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-14T15:20:47.884 DEBUG:teuthology.orchestra.console.smithi039:power on output: Chassis Power Control: Up/On
2023-12-14T15:20:47.885 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T15:20:47.905 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is off
2023-12-14T15:20:51.697 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T15:20:51.806 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on
2023-12-14T15:20:51.906 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T15:20:52.017 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on
2023-12-14T15:20:52.117 INFO:teuthology.orchestra.console.smithi039:Power on completed
2023-12-14T15:20:52.218 INFO:teuthology.provision.fog.smithi039:Waiting for deploy to finish
2023-12-14T15:20:55.810 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T15:20:55.919 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on
2023-12-14T15:20:59.921 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T15:21:00.030 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off
2023-12-14T15:21:00.130 INFO:teuthology.orchestra.console.smithi144:Power off completed
2023-12-14T15:21:00.232 INFO:teuthology.orchestra.console.smithi144:Power on
2023-12-14T15:21:00.232 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-14T15:21:00.252 DEBUG:teuthology.orchestra.console.smithi144:power on output: Chassis Power Control: Up/On
2023-12-14T15:21:00.252 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T15:21:00.272 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off
2023-12-14T15:21:04.274 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T15:21:04.382 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on
2023-12-14T15:21:04.482 INFO:teuthology.orchestra.console.smithi144:Power on completed
2023-12-14T15:21:04.583 INFO:teuthology.provision.fog.smithi144:Waiting for deploy to finish
2023-12-14T15:25:08.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T15:25:11.702 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2023-12-14T15:25:17.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T15:25:20.786 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2023-12-14T15:25:26.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T15:25:29.842 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2023-12-14T15:25:35.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T15:25:38.902 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2023-12-14T15:25:44.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T15:25:47.985 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2023-12-14T15:25:53.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T15:25:57.041 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2023-12-14T15:26:03.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T15:26:06.130 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2023-12-14T15:26:11.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T15:26:12.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T15:26:14.321 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144
2023-12-14T15:26:15.186 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2023-12-14T15:26:20.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T15:26:21.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T15:26:23.377 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144
2023-12-14T15:26:24.241 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2023-12-14T15:26:29.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T15:26:30.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T15:26:32.434 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144
2023-12-14T15:26:38.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T15:26:41.522 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144
2023-12-14T15:26:47.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T15:26:50.609 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144
2023-12-14T15:26:56.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T15:26:59.697 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144
2023-12-14T15:27:05.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T15:27:08.753 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144
2023-12-14T15:27:14.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T15:27:20.882 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144
2023-12-14T15:27:26.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T15:27:29.969 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144
2023-12-14T15:27:30.248 WARNING:teuthology.provision.fog.smithi039:timed out
2023-12-14T15:27:35.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T15:27:36.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T15:27:36.512 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-14T15:27:36.512 DEBUG:teuthology.orchestra.run.smithi039:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-14T15:27:36.786 INFO:teuthology.provision.fog.smithi039:Node is ready
2023-12-14T15:27:36.786 DEBUG:teuthology.orchestra.run.smithi039:> hostname
2023-12-14T15:27:36.802 INFO:teuthology.orchestra.run.smithi039.stdout:smithi039.front.sepia.ceph.com
2023-12-14T15:27:36.802 DEBUG:teuthology.orchestra.run.smithi039:> grep smithi039.front.sepia.ceph.com /etc/hosts
2023-12-14T15:27:36.857 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39 smithi039.front.sepia.ceph.com smithi039
2023-12-14T15:27:36.858 DEBUG:teuthology.orchestra.run.smithi039:> sudo hostname smithi039
2023-12-14T15:27:36.989 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/smithi039.front.sepia.ceph.com/smithi039/g' /etc/hosts
2023-12-14T15:27:37.016 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/172.21.15.39/172.21.15.39/g' /etc/hosts
2023-12-14T15:27:37.082 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/smithi039.front.sepia.ceph.com/smithi039/g' /etc/hostname
2023-12-14T15:27:37.147 DEBUG:teuthology.orchestra.run.smithi039:> sudo hostname smithi039
2023-12-14T15:27:37.212 DEBUG:teuthology.orchestra.run.smithi039:> cat /etc/os-release
2023-12-14T15:27:37.266 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="Red Hat Enterprise Linux"
2023-12-14T15:27:37.266 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="8.4 (Ootpa)"
2023-12-14T15:27:37.266 INFO:teuthology.orchestra.run.smithi039.stdout:ID="rhel"
2023-12-14T15:27:37.266 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE="fedora"
2023-12-14T15:27:37.267 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="8.4"
2023-12-14T15:27:37.267 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM_ID="platform:el8"
2023-12-14T15:27:37.267 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-12-14T15:27:37.267 INFO:teuthology.orchestra.run.smithi039.stdout:ANSI_COLOR="0;31"
2023-12-14T15:27:37.267 INFO:teuthology.orchestra.run.smithi039.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-12-14T15:27:37.267 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://www.redhat.com/"
2023-12-14T15:27:37.267 INFO:teuthology.orchestra.run.smithi039.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-14T15:27:37.267 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-14T15:27:37.267 INFO:teuthology.orchestra.run.smithi039.stdout:
2023-12-14T15:27:37.267 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-14T15:27:37.267 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-12-14T15:27:37.267 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-14T15:27:37.268 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-12-14T15:27:37.268 INFO:teuthology.provision.fog.smithi039:Deploy complete!
2023-12-14T15:27:37.270 DEBUG:teuthology.parallel:result is None
2023-12-14T15:27:39.025 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144
2023-12-14T15:27:45.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T15:27:48.081 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144
2023-12-14T15:27:54.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T15:27:54.442 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-14T15:27:54.443 DEBUG:teuthology.orchestra.run.smithi144:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-14T15:28:14.817 INFO:teuthology.provision.fog.smithi144:Node is ready
2023-12-14T15:28:14.818 DEBUG:teuthology.orchestra.run.smithi144:> hostname
2023-12-14T15:28:14.833 INFO:teuthology.orchestra.run.smithi144.stdout:smithi144
2023-12-14T15:28:14.834 DEBUG:teuthology.orchestra.run.smithi144:> grep smithi144 /etc/hosts
2023-12-14T15:28:14.888 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.15.144 smithi144.front.sepia.ceph.com smithi144
2023-12-14T15:28:14.888 DEBUG:teuthology.orchestra.run.smithi144:> sudo hostname smithi144
2023-12-14T15:28:15.016 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/smithi144/smithi144/g' /etc/hosts
2023-12-14T15:28:15.040 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/172.21.15.144/172.21.15.144/g' /etc/hosts
2023-12-14T15:28:15.104 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/smithi144/smithi144/g' /etc/hostname
2023-12-14T15:28:15.168 DEBUG:teuthology.orchestra.run.smithi144:> sudo hostname smithi144
2023-12-14T15:28:15.231 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release
2023-12-14T15:28:15.286 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="Red Hat Enterprise Linux"
2023-12-14T15:28:15.286 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="8.4 (Ootpa)"
2023-12-14T15:28:15.286 INFO:teuthology.orchestra.run.smithi144.stdout:ID="rhel"
2023-12-14T15:28:15.286 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="fedora"
2023-12-14T15:28:15.286 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="8.4"
2023-12-14T15:28:15.286 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el8"
2023-12-14T15:28:15.287 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-12-14T15:28:15.287 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31"
2023-12-14T15:28:15.287 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-12-14T15:28:15.287 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://www.redhat.com/"
2023-12-14T15:28:15.287 INFO:teuthology.orchestra.run.smithi144.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-14T15:28:15.287 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-14T15:28:15.287 INFO:teuthology.orchestra.run.smithi144.stdout:
2023-12-14T15:28:15.287 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-14T15:28:15.287 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-12-14T15:28:15.287 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-14T15:28:15.288 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-12-14T15:28:15.288 INFO:teuthology.provision.fog.smithi144:Deploy complete!
2023-12-14T15:28:15.288 DEBUG:teuthology.parallel:result is None
2023-12-14T15:28:15.437 INFO:teuthology.lock.ops:Checking smithi039.front.sepia.ceph.com
2023-12-14T15:28:15.437 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-14T15:28:15.458 INFO:teuthology.lock.ops:Checking smithi144.front.sepia.ceph.com
2023-12-14T15:28:15.459 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-14T15:28:15.476 INFO:teuthology.lock.ops:Updating [smithi039.front.sepia.ceph.com]: set os type and version on server
2023-12-14T15:28:15.477 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com'
2023-12-14T15:28:15.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T15:28:15.547 DEBUG:teuthology.orchestra.run.smithi039:> true
2023-12-14T15:28:15.665 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi039.front.sepia.ceph.com'
2023-12-14T15:28:15.666 DEBUG:teuthology.orchestra.run.smithi039:> uname -m
2023-12-14T15:28:15.722 INFO:teuthology.orchestra.run.smithi039.stdout:x86_64
2023-12-14T15:28:15.722 DEBUG:teuthology.orchestra.run.smithi039:> cat /etc/os-release
2023-12-14T15:28:15.779 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="Red Hat Enterprise Linux"
2023-12-14T15:28:15.779 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="8.4 (Ootpa)"
2023-12-14T15:28:15.779 INFO:teuthology.orchestra.run.smithi039.stdout:ID="rhel"
2023-12-14T15:28:15.779 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE="fedora"
2023-12-14T15:28:15.779 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="8.4"
2023-12-14T15:28:15.779 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM_ID="platform:el8"
2023-12-14T15:28:15.779 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-12-14T15:28:15.779 INFO:teuthology.orchestra.run.smithi039.stdout:ANSI_COLOR="0;31"
2023-12-14T15:28:15.779 INFO:teuthology.orchestra.run.smithi039.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-12-14T15:28:15.780 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://www.redhat.com/"
2023-12-14T15:28:15.780 INFO:teuthology.orchestra.run.smithi039.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-14T15:28:15.780 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-14T15:28:15.780 INFO:teuthology.orchestra.run.smithi039.stdout:
2023-12-14T15:28:15.780 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-14T15:28:15.780 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-12-14T15:28:15.780 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-14T15:28:15.780 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-12-14T15:28:15.781 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server
2023-12-14T15:28:15.800 INFO:teuthology.lock.ops:Updating [smithi144.front.sepia.ceph.com]: set os type and version on server
2023-12-14T15:28:15.800 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com'
2023-12-14T15:28:15.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T15:28:15.864 DEBUG:teuthology.orchestra.run.smithi144:> true
2023-12-14T15:28:15.928 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com'
2023-12-14T15:28:15.928 DEBUG:teuthology.orchestra.run.smithi144:> uname -m
2023-12-14T15:28:15.982 INFO:teuthology.orchestra.run.smithi144.stdout:x86_64
2023-12-14T15:28:15.982 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release
2023-12-14T15:28:16.035 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="Red Hat Enterprise Linux"
2023-12-14T15:28:16.035 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="8.4 (Ootpa)"
2023-12-14T15:28:16.035 INFO:teuthology.orchestra.run.smithi144.stdout:ID="rhel"
2023-12-14T15:28:16.035 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="fedora"
2023-12-14T15:28:16.036 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="8.4"
2023-12-14T15:28:16.036 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el8"
2023-12-14T15:28:16.036 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-12-14T15:28:16.036 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31"
2023-12-14T15:28:16.036 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-12-14T15:28:16.036 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://www.redhat.com/"
2023-12-14T15:28:16.036 INFO:teuthology.orchestra.run.smithi144.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-14T15:28:16.036 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-14T15:28:16.036 INFO:teuthology.orchestra.run.smithi144.stdout:
2023-12-14T15:28:16.036 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-14T15:28:16.036 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-12-14T15:28:16.036 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-14T15:28:16.036 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-12-14T15:28:16.037 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server
2023-12-14T15:28:16.058 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T15:28:16.147 INFO:teuthology.dispatcher.supervisor:Running job 7491279
2023-12-14T15:28:16.148 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-14_15:19:03-rbd-wip-yuri4-testing-2023-12-13-0748-quincy-distro-default-smithi/7491279 --name yuriw-2023-12-14_15:19:03-rbd-wip-yuri4-testing-2023-12-13-0748-quincy-distro-default-smithi --description rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} conf/{disable-pool-app} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-workunit-fast-diff} -- /home/teuthworker/archive/yuriw-2023-12-14_15:19:03-rbd-wip-yuri4-testing-2023-12-13-0748-quincy-distro-default-smithi/7491279/orig.config.yaml
2023-12-14T15:28:16.150 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-14_15:19:03-rbd-wip-yuri4-testing-2023-12-13-0748-quincy-distro-default-smithi/7491279
2023-12-14T15:28:16.151 INFO:teuthology.dispatcher.supervisor:Job PID: 3916595
2023-12-14T15:28:16.151 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-12-14T15:30:16.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T15:32:16.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T15:34:16.610 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T15:36:16.797 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T15:38:16.996 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T15:40:17.170 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T15:42:17.346 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T15:42:17.415 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-12-14T15:42:17.552 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-12-14T15:42:17.552 INFO:teuthology.nuke:Checking targets against current locks
2023-12-14T15:42:17.600 DEBUG:teuthology.nuke:shortname: smithi039
2023-12-14T15:42:17.600 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-14T15:42:17.624 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi039.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-14_15:19:03-rbd-wip-yuri4-testing-2023-12-13-0748-quincy-distro-default-smithi/7491279', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-14 15:20:45.989113', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAIrUDRijzE2WHV85baHCP1k65YUcrjo8E0khNNBDSMBygEv0ao//5Z9H4kcyJbyv0wwciDsqZ9WwUW4II9sV5g='}
2023-12-14T15:42:17.627 DEBUG:teuthology.nuke:shortname: smithi144
2023-12-14T15:42:17.628 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-14T15:42:17.651 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi144.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-14_15:19:03-rbd-wip-yuri4-testing-2023-12-13-0748-quincy-distro-default-smithi/7491279', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-14 15:20:45.991663', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC5Uhjz+gOR1pURJ6fPhth83CGlSlq2IKsaS/KcDAawx/lUdYxwxox0qJJtPobhDWcVyM8TzOFX8Ehro/zyzAEs='}
2023-12-14T15:42:17.671 INFO:teuthology.orchestra.console.smithi039:Power off
2023-12-14T15:42:17.672 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-14T15:42:17.693 DEBUG:teuthology.orchestra.console.smithi039:power off output: Chassis Power Control: Down/Off
2023-12-14T15:42:17.693 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T15:42:17.708 INFO:teuthology.orchestra.console.smithi144:Power off
2023-12-14T15:42:17.708 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-14T15:42:17.717 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is off
2023-12-14T15:42:17.729 DEBUG:teuthology.orchestra.console.smithi144:power off output: Chassis Power Control: Down/Off
2023-12-14T15:42:17.729 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T15:42:17.750 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off
2023-12-14T15:42:17.817 INFO:teuthology.orchestra.console.smithi039:Power off completed
2023-12-14T15:42:17.851 INFO:teuthology.orchestra.console.smithi144:Power off completed
2023-12-14T15:42:17.972 INFO:teuthology.lock.ops:unlocked: smithi039.front.sepia.ceph.com
2023-12-14T15:42:17.997 INFO:teuthology.lock.ops:unlocked: smithi144.front.sepia.ceph.com