2023-12-01T21:43:26.428 INFO:root:teuthology version: 0.0.1.dev214+gf2de108
2023-12-01T21:43:26.428 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-01T21:43:26.562 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7efcf08e6430>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7efcf180f550>, signals=[15])
2023-12-01T21:43:26.562 INFO:teuthology.lock.ops:Start node 'smithi092.front.sepia.ceph.com' reimaging
2023-12-01T21:43:26.563 INFO:teuthology.lock.ops:Updating [smithi092.front.sepia.ceph.com]: reset os type and version on server
2023-12-01T21:43:26.563 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server
2023-12-01T21:43:26.583 INFO:teuthology.lock.ops:Start node 'smithi196.front.sepia.ceph.com' reimaging
2023-12-01T21:43:26.583 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: reset os type and version on server
2023-12-01T21:43:26.583 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server
2023-12-01T21:43:26.703 DEBUG:teuthology.provision.fog.smithi092:Requesting image smithi_rhel_8.4 (ID 7)
2023-12-01T21:43:26.730 DEBUG:teuthology.provision.fog.smithi196:Requesting image smithi_rhel_8.4 (ID 7)
2023-12-01T21:43:26.749 INFO:teuthology.provision.fog.smithi092:Scheduling deploy of rhel 8.4
2023-12-01T21:43:26.777 INFO:teuthology.provision.fog.smithi196:Scheduling deploy of rhel 8.4
2023-12-01T21:43:26.965 INFO:teuthology.orchestra.console.smithi092:Power off
2023-12-01T21:43:26.965 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-01T21:43:26.987 DEBUG:teuthology.orchestra.console.smithi092:power off output: Chassis Power Control: Down/Off
2023-12-01T21:43:26.987 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-01T21:43:27.005 INFO:teuthology.orchestra.console.smithi196:Power off
2023-12-01T21:43:27.005 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-01T21:43:27.013 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on
2023-12-01T21:43:27.026 DEBUG:teuthology.orchestra.console.smithi196:power off output: Chassis Power Control: Down/Off
2023-12-01T21:43:27.026 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-01T21:43:27.049 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on
2023-12-01T21:43:31.018 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-01T21:43:31.050 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-01T21:43:31.127 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on
2023-12-01T21:43:31.158 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on
2023-12-01T21:43:35.131 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-01T21:43:35.160 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-01T21:43:35.240 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on
2023-12-01T21:43:35.268 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off
2023-12-01T21:43:35.369 INFO:teuthology.orchestra.console.smithi196:Power off completed
2023-12-01T21:43:35.469 INFO:teuthology.orchestra.console.smithi196:Power on
2023-12-01T21:43:35.470 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-01T21:43:35.494 DEBUG:teuthology.orchestra.console.smithi196:power on output: Chassis Power Control: Up/On
2023-12-01T21:43:35.494 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-01T21:43:35.515 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off
2023-12-01T21:43:39.242 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-01T21:43:39.351 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off
2023-12-01T21:43:39.451 INFO:teuthology.orchestra.console.smithi092:Power off completed
2023-12-01T21:43:39.516 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-01T21:43:39.553 INFO:teuthology.orchestra.console.smithi092:Power on
2023-12-01T21:43:39.553 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-01T21:43:39.572 DEBUG:teuthology.orchestra.console.smithi092:power on output: Chassis Power Control: Up/On
2023-12-01T21:43:39.573 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-01T21:43:39.595 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off
2023-12-01T21:43:39.625 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off
2023-12-01T21:43:43.598 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-01T21:43:43.626 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-01T21:43:43.707 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on
2023-12-01T21:43:43.785 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on
2023-12-01T21:43:43.808 INFO:teuthology.orchestra.console.smithi092:Power on completed
2023-12-01T21:43:43.886 INFO:teuthology.orchestra.console.smithi196:Power on completed
2023-12-01T21:43:43.909 INFO:teuthology.provision.fog.smithi092:Waiting for deploy to finish
2023-12-01T21:43:43.986 INFO:teuthology.provision.fog.smithi196:Waiting for deploy to finish
2023-12-01T21:46:14.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-01T21:46:17.894 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-12-01T21:46:23.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-01T21:46:26.978 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-12-01T21:46:29.877 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-01T21:46:32.934 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92
2023-12-01T21:46:32.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-01T21:46:36.034 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-12-01T21:46:38.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-01T21:46:42.022 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92
2023-12-01T21:46:42.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-01T21:46:45.097 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-12-01T21:46:48.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-01T21:46:51.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-01T21:46:51.110 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92
2023-12-01T21:46:54.182 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-12-01T21:46:57.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-01T21:47:00.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-01T21:47:00.198 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92
2023-12-01T21:47:03.270 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-12-01T21:47:06.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-01T21:47:09.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-01T21:47:09.282 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92
2023-12-01T21:47:12.354 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-12-01T21:47:15.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-01T21:47:18.338 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92
2023-12-01T21:47:18.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-01T21:47:24.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-01T21:47:42.821 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92
2023-12-01T21:47:48.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-01T21:47:51.874 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92
2023-12-01T21:47:57.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-01T21:48:00.934 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92
2023-12-01T21:48:06.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-01T21:48:07.827 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-01T21:48:07.827 DEBUG:teuthology.orchestra.run.smithi092:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-01T21:48:18.358 WARNING:teuthology.provision.fog.smithi196:timed out
2023-12-01T21:48:23.787 INFO:teuthology.provision.fog.smithi092:Node is ready
2023-12-01T21:48:23.788 DEBUG:teuthology.orchestra.run.smithi092:> hostname
2023-12-01T21:48:23.805 INFO:teuthology.orchestra.run.smithi092.stdout:smithi092.front.sepia.ceph.com
2023-12-01T21:48:23.805 DEBUG:teuthology.orchestra.run.smithi092:> grep smithi092.front.sepia.ceph.com /etc/hosts
2023-12-01T21:48:23.859 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92 smithi092.front.sepia.ceph.com smithi092
2023-12-01T21:48:23.860 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname smithi092
2023-12-01T21:48:23.996 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/smithi092.front.sepia.ceph.com/smithi092/g' /etc/hosts
2023-12-01T21:48:24.021 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/172.21.15.92/172.21.15.92/g' /etc/hosts
2023-12-01T21:48:24.085 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/smithi092.front.sepia.ceph.com/smithi092/g' /etc/hostname
2023-12-01T21:48:24.149 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname smithi092
2023-12-01T21:48:24.213 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release
2023-12-01T21:48:24.267 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="Red Hat Enterprise Linux"
2023-12-01T21:48:24.267 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="8.4 (Ootpa)"
2023-12-01T21:48:24.267 INFO:teuthology.orchestra.run.smithi092.stdout:ID="rhel"
2023-12-01T21:48:24.267 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="fedora"
2023-12-01T21:48:24.268 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="8.4"
2023-12-01T21:48:24.268 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el8"
2023-12-01T21:48:24.268 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-12-01T21:48:24.268 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31"
2023-12-01T21:48:24.268 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-12-01T21:48:24.268 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://www.redhat.com/"
2023-12-01T21:48:24.268 INFO:teuthology.orchestra.run.smithi092.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-01T21:48:24.269 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-01T21:48:24.269 INFO:teuthology.orchestra.run.smithi092.stdout:
2023-12-01T21:48:24.269 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-01T21:48:24.269 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-12-01T21:48:24.269 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-01T21:48:24.269 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-12-01T21:48:24.270 INFO:teuthology.provision.fog.smithi092:Deploy complete!
2023-12-01T21:48:24.271 DEBUG:teuthology.parallel:result is None
2023-12-01T21:48:24.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-01T21:48:24.731 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-01T21:48:24.731 DEBUG:teuthology.orchestra.run.smithi196:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-01T21:48:24.987 INFO:teuthology.provision.fog.smithi196:Node is ready
2023-12-01T21:48:24.988 DEBUG:teuthology.orchestra.run.smithi196:> hostname
2023-12-01T21:48:25.003 INFO:teuthology.orchestra.run.smithi196.stdout:smithi196
2023-12-01T21:48:25.003 DEBUG:teuthology.orchestra.run.smithi196:> grep smithi196 /etc/hosts
2023-12-01T21:48:25.058 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.15.196 smithi196.front.sepia.ceph.com smithi196
2023-12-01T21:48:25.059 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196
2023-12-01T21:48:25.168 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi196/smithi196/g' /etc/hosts
2023-12-01T21:48:25.192 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/172.21.15.196/172.21.15.196/g' /etc/hosts
2023-12-01T21:48:25.257 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi196/smithi196/g' /etc/hostname
2023-12-01T21:48:25.321 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196
2023-12-01T21:48:25.384 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release
2023-12-01T21:48:25.438 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="Red Hat Enterprise Linux"
2023-12-01T21:48:25.438 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="8.4 (Ootpa)"
2023-12-01T21:48:25.438 INFO:teuthology.orchestra.run.smithi196.stdout:ID="rhel"
2023-12-01T21:48:25.438 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="fedora"
2023-12-01T21:48:25.438 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="8.4"
2023-12-01T21:48:25.438 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el8"
2023-12-01T21:48:25.438 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-12-01T21:48:25.438 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31"
2023-12-01T21:48:25.439 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-12-01T21:48:25.439 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://www.redhat.com/"
2023-12-01T21:48:25.439 INFO:teuthology.orchestra.run.smithi196.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-01T21:48:25.439 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-01T21:48:25.439 INFO:teuthology.orchestra.run.smithi196.stdout:
2023-12-01T21:48:25.439 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-01T21:48:25.439 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-12-01T21:48:25.439 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-01T21:48:25.439 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-12-01T21:48:25.439 INFO:teuthology.provision.fog.smithi196:Deploy complete!
2023-12-01T21:48:25.440 DEBUG:teuthology.parallel:result is None
2023-12-01T21:48:25.609 INFO:teuthology.lock.ops:Checking smithi092.front.sepia.ceph.com
2023-12-01T21:48:25.609 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-01T21:48:25.630 INFO:teuthology.lock.ops:Checking smithi196.front.sepia.ceph.com
2023-12-01T21:48:25.631 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-01T21:48:25.648 INFO:teuthology.lock.ops:Updating [smithi092.front.sepia.ceph.com]: set os type and version on server
2023-12-01T21:48:25.648 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com'
2023-12-01T21:48:25.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-01T21:48:25.713 DEBUG:teuthology.orchestra.run.smithi092:> true
2023-12-01T21:48:25.776 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com'
2023-12-01T21:48:25.776 DEBUG:teuthology.orchestra.run.smithi092:> uname -m
2023-12-01T21:48:25.827 INFO:teuthology.orchestra.run.smithi092.stdout:x86_64
2023-12-01T21:48:25.828 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release
2023-12-01T21:48:25.879 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="Red Hat Enterprise Linux"
2023-12-01T21:48:25.879 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="8.4 (Ootpa)"
2023-12-01T21:48:25.879 INFO:teuthology.orchestra.run.smithi092.stdout:ID="rhel"
2023-12-01T21:48:25.879 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="fedora"
2023-12-01T21:48:25.879 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="8.4"
2023-12-01T21:48:25.880 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el8"
2023-12-01T21:48:25.880 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-12-01T21:48:25.880 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31"
2023-12-01T21:48:25.880 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-12-01T21:48:25.880 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://www.redhat.com/"
2023-12-01T21:48:25.880 INFO:teuthology.orchestra.run.smithi092.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-01T21:48:25.880 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-01T21:48:25.880 INFO:teuthology.orchestra.run.smithi092.stdout:
2023-12-01T21:48:25.880 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-01T21:48:25.880 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-12-01T21:48:25.880 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-01T21:48:25.880 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-12-01T21:48:25.881 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server
2023-12-01T21:48:25.905 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: set os type and version on server
2023-12-01T21:48:25.905 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com'
2023-12-01T21:48:25.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-01T21:48:25.971 DEBUG:teuthology.orchestra.run.smithi196:> true
2023-12-01T21:48:26.040 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com'
2023-12-01T21:48:26.040 DEBUG:teuthology.orchestra.run.smithi196:> uname -m
2023-12-01T21:48:26.094 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64
2023-12-01T21:48:26.094 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release
2023-12-01T21:48:26.148 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="Red Hat Enterprise Linux"
2023-12-01T21:48:26.148 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="8.4 (Ootpa)"
2023-12-01T21:48:26.148 INFO:teuthology.orchestra.run.smithi196.stdout:ID="rhel"
2023-12-01T21:48:26.148 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="fedora"
2023-12-01T21:48:26.148 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="8.4"
2023-12-01T21:48:26.148 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el8"
2023-12-01T21:48:26.148 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-12-01T21:48:26.148 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31"
2023-12-01T21:48:26.149 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-12-01T21:48:26.149 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://www.redhat.com/"
2023-12-01T21:48:26.149 INFO:teuthology.orchestra.run.smithi196.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-01T21:48:26.149 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-01T21:48:26.149 INFO:teuthology.orchestra.run.smithi196.stdout:
2023-12-01T21:48:26.149 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-01T21:48:26.149 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-12-01T21:48:26.149 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-01T21:48:26.149 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-12-01T21:48:26.150 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server
2023-12-01T21:48:26.180 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-01T21:48:26.281 INFO:teuthology.dispatcher.supervisor:Running job 7474311
2023-12-01T21:48:26.282 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-01_16:53:58-rados-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7474311 --name yuriw-2023-12-01_16:53:58-rados-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi --description rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} -- /home/teuthworker/archive/yuriw-2023-12-01_16:53:58-rados-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7474311/orig.config.yaml
2023-12-01T21:48:26.285 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-01_16:53:58-rados-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7474311
2023-12-01T21:48:26.286 INFO:teuthology.dispatcher.supervisor:Job PID: 2627796
2023-12-01T21:48:26.286 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-12-01T21:50:26.386 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-01T21:52:26.550 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-01T21:54:26.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-01T21:56:26.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-01T21:58:27.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-01T22:00:27.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-01T22:02:27.392 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-01T22:04:27.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-01T22:06:27.721 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-01T22:08:27.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-01T22:10:28.060 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-01T22:12:28.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-01T22:14:28.421 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-01T22:16:28.592 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-01T22:18:28.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-01T22:20:28.908 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-01T22:22:29.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-01T22:24:29.242 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-01T22:26:29.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-01T22:28:29.592 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-01T22:28:29.663 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-12-01T22:28:29.812 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-12-01T22:28:29.812 INFO:teuthology.nuke:Checking targets against current locks
2023-12-01T22:28:29.865 DEBUG:teuthology.nuke:shortname: smithi092
2023-12-01T22:28:29.866 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-01T22:28:29.881 DEBUG:teuthology.nuke:shortname: smithi196
2023-12-01T22:28:29.881 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-01T22:28:29.889 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi092.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-01_16:53:58-rados-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7474311', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-01 21:43:25.585913', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAvRnDL2G8RcZ1fq3/P9oM6PpMQGJj0oBbZcZ3G0uYGSH5rZw0KoHdwcBWhwj87zTK0Ua7ATVsGQTSiq98qxGCU='}
2023-12-01T22:28:29.907 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi196.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-01_16:53:58-rados-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7474311', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-01 21:43:25.587479', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDdpVnPq8ug0Nb4iwx1D1gKnQ3guZgx5lZStyxX36CJRyOVQGnrqdylwf/Mc/4o+AX5WBqd6iyu7jnBRKMbnYsY='}
2023-12-01T22:28:29.942 INFO:teuthology.orchestra.console.smithi092:Power off
2023-12-01T22:28:29.943 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-01T22:28:29.984 INFO:teuthology.orchestra.console.smithi196:Power off
2023-12-01T22:28:29.985 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-01T22:28:30.000 DEBUG:teuthology.orchestra.console.smithi092:power off output: Chassis Power Control: Down/Off
2023-12-01T22:28:30.000 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-01T22:28:30.020 DEBUG:teuthology.orchestra.console.smithi196:power off output: Chassis Power Control: Down/Off
2023-12-01T22:28:30.020 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-01T22:28:30.037 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off
2023-12-01T22:28:30.056 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off
2023-12-01T22:28:30.139 INFO:teuthology.orchestra.console.smithi092:Power off completed
2023-12-01T22:28:30.157 INFO:teuthology.orchestra.console.smithi196:Power off completed
2023-12-01T22:28:30.351 INFO:teuthology.lock.ops:unlocked: smithi196.front.sepia.ceph.com
2023-12-01T22:28:30.352 INFO:teuthology.lock.ops:unlocked: smithi092.front.sepia.ceph.com