2024-04-12T02:48:36.357 INFO:root:teuthology version: 0.0.1.dev267+g6c63784
2024-04-12T02:48:36.357 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T02:48:36.540 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fd7e40d2f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fd7e5072c10>, signals=[15])
2024-04-12T02:48:36.540 INFO:teuthology.lock.ops:Start node 'smithi105.front.sepia.ceph.com' reimaging
2024-04-12T02:48:36.540 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: reset os type and version on server
2024-04-12T02:48:36.540 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server
2024-04-12T02:48:36.567 INFO:teuthology.lock.ops:Start node 'smithi170.front.sepia.ceph.com' reimaging
2024-04-12T02:48:36.567 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: reset os type and version on server
2024-04-12T02:48:36.567 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server
2024-04-12T02:48:36.723 DEBUG:teuthology.provision.fog.smithi105:Requesting image smithi_rhel_8.6 (ID 5)
2024-04-12T02:48:36.745 DEBUG:teuthology.provision.fog.smithi170:Requesting image smithi_rhel_8.6 (ID 5)
2024-04-12T02:48:36.777 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of rhel 8.6
2024-04-12T02:48:36.807 INFO:teuthology.provision.fog.smithi170:Scheduling deploy of rhel 8.6
2024-04-12T02:48:37.072 INFO:teuthology.orchestra.console.smithi105:Power off
2024-04-12T02:48:37.073 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-12T02:48:37.102 INFO:teuthology.orchestra.console.smithi170:Power off
2024-04-12T02:48:37.102 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-12T02:48:37.123 DEBUG:teuthology.orchestra.console.smithi105:power off output: Chassis Power Control: Down/Off
2024-04-12T02:48:37.123 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T02:48:37.131 DEBUG:teuthology.orchestra.console.smithi170:power off output: Chassis Power Control: Down/Off
2024-04-12T02:48:37.132 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T02:48:37.153 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off
2024-04-12T02:48:37.161 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off
2024-04-12T02:48:37.255 INFO:teuthology.orchestra.console.smithi105:Power off completed
2024-04-12T02:48:37.262 INFO:teuthology.orchestra.console.smithi170:Power off completed
2024-04-12T02:48:37.356 INFO:teuthology.orchestra.console.smithi105:Power on
2024-04-12T02:48:37.356 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-12T02:48:37.363 INFO:teuthology.orchestra.console.smithi170:Power on
2024-04-12T02:48:37.364 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-12T02:48:37.387 DEBUG:teuthology.orchestra.console.smithi105:power on output: Chassis Power Control: Up/On
2024-04-12T02:48:37.388 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T02:48:37.401 DEBUG:teuthology.orchestra.console.smithi170:power on output: Chassis Power Control: Up/On
2024-04-12T02:48:37.401 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T02:48:37.422 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off
2024-04-12T02:48:37.435 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off
2024-04-12T02:48:41.426 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T02:48:41.435 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T02:48:41.536 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off
2024-04-12T02:48:41.546 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on
2024-04-12T02:48:41.646 INFO:teuthology.orchestra.console.smithi170:Power on completed
2024-04-12T02:48:41.747 INFO:teuthology.provision.fog.smithi170:Waiting for deploy to finish
2024-04-12T02:48:45.541 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T02:48:45.650 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on
2024-04-12T02:48:45.751 INFO:teuthology.orchestra.console.smithi105:Power on completed
2024-04-12T02:48:45.851 INFO:teuthology.provision.fog.smithi105:Waiting for deploy to finish
2024-04-12T02:51:27.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T02:51:31.070 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170
2024-04-12T02:51:31.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T02:51:35.070 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2024-04-12T02:51:37.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T02:51:40.158 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170
2024-04-12T02:51:41.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T02:51:44.158 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2024-04-12T02:51:46.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T02:51:49.246 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170
2024-04-12T02:51:50.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T02:51:53.246 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2024-04-12T02:51:55.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T02:51:58.334 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170
2024-04-12T02:51:59.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T02:52:02.334 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2024-04-12T02:52:04.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T02:52:07.422 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170
2024-04-12T02:52:08.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T02:52:11.422 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2024-04-12T02:52:13.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T02:52:17.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T02:52:20.510 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2024-04-12T02:52:26.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T02:52:44.958 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2024-04-12T02:52:50.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T02:52:54.046 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2024-04-12T02:53:00.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T02:53:03.134 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2024-04-12T02:53:09.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T02:53:09.389 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-12T02:53:09.390 DEBUG:teuthology.orchestra.run.smithi105:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-12T02:53:13.453 WARNING:teuthology.provision.fog.smithi170:timed out
2024-04-12T02:53:19.455 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T02:53:19.715 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-12T02:53:19.715 DEBUG:teuthology.orchestra.run.smithi170:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-12T02:53:19.979 INFO:teuthology.provision.fog.smithi170:Node is ready
2024-04-12T02:53:19.979 DEBUG:teuthology.orchestra.run.smithi170:> hostname
2024-04-12T02:53:19.997 INFO:teuthology.orchestra.run.smithi170.stdout:smithi170
2024-04-12T02:53:19.997 DEBUG:teuthology.orchestra.run.smithi170:> grep smithi170 /etc/hosts
2024-04-12T02:53:20.055 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170 smithi170.front.sepia.ceph.com smithi170
2024-04-12T02:53:20.055 DEBUG:teuthology.orchestra.run.smithi170:> sudo hostname smithi170
2024-04-12T02:53:20.171 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/smithi170/smithi170/g' /etc/hosts
2024-04-12T02:53:20.200 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/172.21.15.170/172.21.15.170/g' /etc/hosts
2024-04-12T02:53:20.267 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/smithi170/smithi170/g' /etc/hostname
2024-04-12T02:53:20.335 DEBUG:teuthology.orchestra.run.smithi170:> sudo hostname smithi170
2024-04-12T02:53:20.401 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release
2024-04-12T02:53:20.457 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="Red Hat Enterprise Linux"
2024-04-12T02:53:20.458 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="8.6 (Ootpa)"
2024-04-12T02:53:20.458 INFO:teuthology.orchestra.run.smithi170.stdout:ID="rhel"
2024-04-12T02:53:20.458 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="fedora"
2024-04-12T02:53:20.458 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="8.6"
2024-04-12T02:53:20.458 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el8"
2024-04-12T02:53:20.458 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-12T02:53:20.458 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31"
2024-04-12T02:53:20.458 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-12T02:53:20.458 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://www.redhat.com/"
2024-04-12T02:53:20.458 INFO:teuthology.orchestra.run.smithi170.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-12T02:53:20.458 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-12T02:53:20.458 INFO:teuthology.orchestra.run.smithi170.stdout:
2024-04-12T02:53:20.458 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-12T02:53:20.458 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-12T02:53:20.459 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-12T02:53:20.459 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-12T02:53:20.459 INFO:teuthology.provision.fog.smithi170:Deploy complete!
2024-04-12T02:53:20.461 DEBUG:teuthology.parallel:result is None
2024-04-12T02:53:29.630 INFO:teuthology.provision.fog.smithi105:Node is ready
2024-04-12T02:53:29.630 DEBUG:teuthology.orchestra.run.smithi105:> hostname
2024-04-12T02:53:29.652 INFO:teuthology.orchestra.run.smithi105.stdout:smithi105.front.sepia.ceph.com
2024-04-12T02:53:29.652 DEBUG:teuthology.orchestra.run.smithi105:> grep smithi105.front.sepia.ceph.com /etc/hosts
2024-04-12T02:53:29.711 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.15.105 smithi105.front.sepia.ceph.com smithi105
2024-04-12T02:53:29.712 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105
2024-04-12T02:53:29.833 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hosts
2024-04-12T02:53:29.863 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/172.21.15.105/172.21.15.105/g' /etc/hosts
2024-04-12T02:53:29.932 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hostname
2024-04-12T02:53:29.999 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105
2024-04-12T02:53:30.067 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release
2024-04-12T02:53:30.124 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="Red Hat Enterprise Linux"
2024-04-12T02:53:30.124 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="8.6 (Ootpa)"
2024-04-12T02:53:30.124 INFO:teuthology.orchestra.run.smithi105.stdout:ID="rhel"
2024-04-12T02:53:30.124 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="fedora"
2024-04-12T02:53:30.124 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="8.6"
2024-04-12T02:53:30.125 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el8"
2024-04-12T02:53:30.125 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-12T02:53:30.125 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31"
2024-04-12T02:53:30.125 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-12T02:53:30.125 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://www.redhat.com/"
2024-04-12T02:53:30.125 INFO:teuthology.orchestra.run.smithi105.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-12T02:53:30.125 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-12T02:53:30.125 INFO:teuthology.orchestra.run.smithi105.stdout:
2024-04-12T02:53:30.125 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-12T02:53:30.125 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-12T02:53:30.125 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-12T02:53:30.125 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-12T02:53:30.125 INFO:teuthology.provision.fog.smithi105:Deploy complete!
2024-04-12T02:53:30.126 DEBUG:teuthology.parallel:result is None
2024-04-12T02:53:30.392 INFO:teuthology.lock.ops:Checking smithi105.front.sepia.ceph.com
2024-04-12T02:53:30.392 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-12T02:53:30.470 INFO:teuthology.lock.ops:Checking smithi170.front.sepia.ceph.com
2024-04-12T02:53:30.470 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-12T02:53:30.496 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: set os type and version on server
2024-04-12T02:53:30.496 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com'
2024-04-12T02:53:30.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T02:53:30.582 DEBUG:teuthology.orchestra.run.smithi105:> true
2024-04-12T02:53:30.647 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi105.front.sepia.ceph.com'
2024-04-12T02:53:30.647 DEBUG:teuthology.orchestra.run.smithi105:> uname -m
2024-04-12T02:53:30.704 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64
2024-04-12T02:53:30.704 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release
2024-04-12T02:53:30.761 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="Red Hat Enterprise Linux"
2024-04-12T02:53:30.761 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="8.6 (Ootpa)"
2024-04-12T02:53:30.761 INFO:teuthology.orchestra.run.smithi105.stdout:ID="rhel"
2024-04-12T02:53:30.761 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="fedora"
2024-04-12T02:53:30.761 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="8.6"
2024-04-12T02:53:30.762 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el8"
2024-04-12T02:53:30.762 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-12T02:53:30.762 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31"
2024-04-12T02:53:30.762 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-12T02:53:30.762 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://www.redhat.com/"
2024-04-12T02:53:30.762 INFO:teuthology.orchestra.run.smithi105.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-12T02:53:30.762 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-12T02:53:30.762 INFO:teuthology.orchestra.run.smithi105.stdout:
2024-04-12T02:53:30.762 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-12T02:53:30.762 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-12T02:53:30.762 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-12T02:53:30.762 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-12T02:53:30.763 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server
2024-04-12T02:53:30.795 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: set os type and version on server
2024-04-12T02:53:30.796 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com'
2024-04-12T02:53:30.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T02:53:30.877 DEBUG:teuthology.orchestra.run.smithi170:> true
2024-04-12T02:53:31.016 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi170.front.sepia.ceph.com'
2024-04-12T02:53:31.016 DEBUG:teuthology.orchestra.run.smithi170:> uname -m
2024-04-12T02:53:31.075 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64
2024-04-12T02:53:31.075 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release
2024-04-12T02:53:31.132 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="Red Hat Enterprise Linux"
2024-04-12T02:53:31.133 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="8.6 (Ootpa)"
2024-04-12T02:53:31.133 INFO:teuthology.orchestra.run.smithi170.stdout:ID="rhel"
2024-04-12T02:53:31.133 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="fedora"
2024-04-12T02:53:31.133 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="8.6"
2024-04-12T02:53:31.133 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el8"
2024-04-12T02:53:31.133 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-12T02:53:31.133 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31"
2024-04-12T02:53:31.133 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-12T02:53:31.133 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://www.redhat.com/"
2024-04-12T02:53:31.133 INFO:teuthology.orchestra.run.smithi170.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-12T02:53:31.133 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-12T02:53:31.133 INFO:teuthology.orchestra.run.smithi170.stdout:
2024-04-12T02:53:31.133 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-12T02:53:31.133 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-12T02:53:31.134 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-12T02:53:31.134 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-12T02:53:31.134 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server
2024-04-12T02:53:31.162 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T02:53:31.256 INFO:teuthology.dispatcher.supervisor:Running job 7652599
2024-04-12T02:53:31.257 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-04-11_20:30:42-rgw-reef-release-distro-default-smithi/7652599 --name yuriw-2024-04-11_20:30:42-rgw-reef-release-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/three-zones supported-random-distro$/{rhel_8} tasks/test_multi} -- /home/teuthworker/archive/yuriw-2024-04-11_20:30:42-rgw-reef-release-distro-default-smithi/7652599/orig.config.yaml
2024-04-12T02:53:31.260 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-04-11_20:30:42-rgw-reef-release-distro-default-smithi/7652599
2024-04-12T02:53:31.261 INFO:teuthology.dispatcher.supervisor:Job PID: 565404
2024-04-12T02:53:31.261 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-04-12T02:55:31.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T02:57:31.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T02:59:31.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T03:01:31.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T03:03:32.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T03:05:32.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T03:07:32.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T03:09:32.677 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T03:11:32.856 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T03:13:33.036 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T03:15:33.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T03:17:33.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T03:19:33.565 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T03:21:33.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T03:23:33.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T03:25:34.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T03:27:34.292 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T03:29:34.462 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T03:31:34.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T03:33:34.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T03:35:34.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T03:37:35.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T03:39:35.278 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T03:41:35.459 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T03:43:35.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T03:45:35.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T03:47:36.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T03:49:36.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T03:51:36.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T03:53:36.576 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T03:55:36.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T03:57:36.920 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T03:59:37.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:01:37.282 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:03:37.474 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:05:37.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:07:37.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:09:38.013 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:11:38.182 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:13:38.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:15:38.461 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:17:38.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:19:38.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:21:39.006 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:23:39.188 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:25:39.361 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:27:39.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:29:39.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:31:39.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:33:40.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:35:40.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:37:40.422 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:39:40.596 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:41:40.776 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:43:40.951 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:45:41.122 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:47:41.300 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:49:41.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:51:41.674 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:53:41.858 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:55:42.000 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:57:42.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:59:42.368 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T05:01:42.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T05:03:42.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T05:05:42.933 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T05:07:43.104 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T05:09:43.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T05:11:43.432 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T05:13:43.599 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T05:15:43.780 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T05:17:43.944 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T05:19:44.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T05:21:44.266 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T05:23:44.436 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T05:25:44.615 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T05:27:44.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T05:29:45.049 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T05:31:45.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T05:33:45.385 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T05:35:45.581 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T05:37:45.754 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T05:39:45.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T05:41:46.060 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T05:43:46.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T05:45:46.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T05:47:46.595 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T05:49:46.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T05:51:46.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T05:53:47.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T05:55:47.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T05:57:47.422 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T05:59:47.584 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T06:01:47.748 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T06:03:47.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T06:05:48.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T06:07:48.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T06:09:48.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T06:11:48.578 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T06:13:48.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T06:15:48.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T06:17:49.096 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T06:19:49.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T06:21:49.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T06:23:49.661 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T06:25:49.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T06:27:50.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T06:29:50.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T06:31:50.358 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T06:33:50.536 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T06:35:50.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T06:37:50.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T06:39:51.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T06:41:51.254 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T06:43:51.417 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T06:45:51.521 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T06:45:51.599 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1