2024-03-08T03:16:46.324 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-08T03:16:46.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T03:16:46.466 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fc6f7a67f70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fc6f8ac8c10>, signals=[15])
2024-03-08T03:16:46.466 INFO:teuthology.lock.ops:Start node 'smithi146.front.sepia.ceph.com' reimaging
2024-03-08T03:16:46.466 INFO:teuthology.lock.ops:Updating [smithi146.front.sepia.ceph.com]: reset os type and version on server
2024-03-08T03:16:46.466 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server
2024-03-08T03:16:46.487 INFO:teuthology.lock.ops:Start node 'smithi183.front.sepia.ceph.com' reimaging
2024-03-08T03:16:46.487 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: reset os type and version on server
2024-03-08T03:16:46.487 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server
2024-03-08T03:16:46.609 DEBUG:teuthology.provision.fog.smithi146:Requesting image smithi_centos_9.stream (ID 10)
2024-03-08T03:16:46.622 DEBUG:teuthology.provision.fog.smithi183:Requesting image smithi_centos_9.stream (ID 10)
2024-03-08T03:16:46.656 INFO:teuthology.provision.fog.smithi146:Scheduling deploy of centos 9.stream
2024-03-08T03:16:46.672 INFO:teuthology.provision.fog.smithi183:Scheduling deploy of centos 9.stream
2024-03-08T03:16:46.851 INFO:teuthology.orchestra.console.smithi146:Power off
2024-03-08T03:16:46.852 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-08T03:16:46.866 INFO:teuthology.orchestra.console.smithi183:Power off
2024-03-08T03:16:46.867 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-08T03:16:46.876 DEBUG:teuthology.orchestra.console.smithi146:power off output: Chassis Power Control: Down/Off
2024-03-08T03:16:46.877 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-08T03:16:46.888 DEBUG:teuthology.orchestra.console.smithi183:power off output: Chassis Power Control: Down/Off
2024-03-08T03:16:46.888 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-08T03:16:46.897 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on
2024-03-08T03:16:46.909 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on
2024-03-08T03:16:50.898 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-08T03:16:50.910 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-08T03:16:51.007 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on
2024-03-08T03:16:51.018 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on
2024-03-08T03:16:55.013 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-08T03:16:55.020 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-08T03:16:55.122 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on
2024-03-08T03:16:55.128 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on
2024-03-08T03:16:59.128 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-08T03:16:59.135 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-08T03:16:59.239 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off
2024-03-08T03:16:59.244 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off
2024-03-08T03:16:59.340 INFO:teuthology.orchestra.console.smithi146:Power off completed
2024-03-08T03:16:59.345 INFO:teuthology.orchestra.console.smithi183:Power off completed
2024-03-08T03:16:59.441 INFO:teuthology.orchestra.console.smithi146:Power on
2024-03-08T03:16:59.441 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-08T03:16:59.449 INFO:teuthology.orchestra.console.smithi183:Power on
2024-03-08T03:16:59.450 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-08T03:16:59.463 DEBUG:teuthology.orchestra.console.smithi146:power on output: Chassis Power Control: Up/On
2024-03-08T03:16:59.463 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-08T03:16:59.471 DEBUG:teuthology.orchestra.console.smithi183:power on output: Chassis Power Control: Up/On
2024-03-08T03:16:59.472 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-08T03:16:59.484 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off
2024-03-08T03:16:59.491 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off
2024-03-08T03:17:03.489 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-08T03:17:03.496 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-08T03:17:03.598 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off
2024-03-08T03:17:03.604 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on
2024-03-08T03:17:03.704 INFO:teuthology.orchestra.console.smithi183:Power on completed
2024-03-08T03:17:03.805 INFO:teuthology.provision.fog.smithi183:Waiting for deploy to finish
2024-03-08T03:17:07.603 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-08T03:17:07.799 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on
2024-03-08T03:17:07.900 INFO:teuthology.orchestra.console.smithi146:Power on completed
2024-03-08T03:17:08.001 INFO:teuthology.provision.fog.smithi146:Waiting for deploy to finish
2024-03-08T03:19:34.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-08T03:19:53.119 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2024-03-08T03:19:53.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-08T03:19:59.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-08T03:20:02.206 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2024-03-08T03:20:08.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-08T03:20:11.262 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2024-03-08T03:20:12.322 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146
2024-03-08T03:20:17.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-08T03:20:18.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-08T03:20:20.318 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2024-03-08T03:20:21.378 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146
2024-03-08T03:20:26.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-08T03:20:27.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-08T03:20:29.410 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2024-03-08T03:20:30.430 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146
2024-03-08T03:20:35.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-08T03:20:36.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-08T03:20:39.490 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146
2024-03-08T03:20:45.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-08T03:20:48.574 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146
2024-03-08T03:20:54.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-08T03:21:35.454 WARNING:teuthology.provision.fog.smithi183:timed out
2024-03-08T03:21:41.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-08T03:21:41.714 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-08T03:21:41.714 DEBUG:teuthology.orchestra.run.smithi183:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-08T03:21:42.029 INFO:teuthology.provision.fog.smithi183:Node is ready
2024-03-08T03:21:42.030 DEBUG:teuthology.orchestra.run.smithi183:> hostname
2024-03-08T03:21:42.044 INFO:teuthology.orchestra.run.smithi183.stdout:smithi183.front.sepia.ceph.com
2024-03-08T03:21:42.044 DEBUG:teuthology.orchestra.run.smithi183:> grep smithi183.front.sepia.ceph.com /etc/hosts
2024-03-08T03:21:42.099 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.15.183 smithi183.front.sepia.ceph.com smithi183
2024-03-08T03:21:42.100 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname smithi183
2024-03-08T03:21:42.197 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/smithi183.front.sepia.ceph.com/smithi183/g' /etc/hosts
2024-03-08T03:21:42.224 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/172.21.15.183/172.21.15.183/g' /etc/hosts
2024-03-08T03:21:42.292 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/smithi183.front.sepia.ceph.com/smithi183/g' /etc/hostname
2024-03-08T03:21:42.359 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname smithi183
2024-03-08T03:21:42.425 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release
2024-03-08T03:21:42.480 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="CentOS Stream"
2024-03-08T03:21:42.480 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="9"
2024-03-08T03:21:42.480 INFO:teuthology.orchestra.run.smithi183.stdout:ID="centos"
2024-03-08T03:21:42.480 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="rhel fedora"
2024-03-08T03:21:42.480 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="9"
2024-03-08T03:21:42.480 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el9"
2024-03-08T03:21:42.481 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-08T03:21:42.481 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31"
2024-03-08T03:21:42.481 INFO:teuthology.orchestra.run.smithi183.stdout:LOGO="fedora-logo-icon"
2024-03-08T03:21:42.481 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-08T03:21:42.481 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://centos.org/"
2024-03-08T03:21:42.481 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-08T03:21:42.481 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-08T03:21:42.481 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-08T03:21:42.482 INFO:teuthology.provision.fog.smithi183:Deploy complete!
2024-03-08T03:21:42.483 DEBUG:teuthology.parallel:result is None
2024-03-08T03:21:54.590 WARNING:teuthology.provision.fog.smithi146:timed out
2024-03-08T03:22:00.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-08T03:22:00.911 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-08T03:22:00.911 DEBUG:teuthology.orchestra.run.smithi146:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-08T03:22:01.243 INFO:teuthology.provision.fog.smithi146:Node is ready
2024-03-08T03:22:01.243 DEBUG:teuthology.orchestra.run.smithi146:> hostname
2024-03-08T03:22:01.259 INFO:teuthology.orchestra.run.smithi146.stdout:smithi146.front.sepia.ceph.com
2024-03-08T03:22:01.259 DEBUG:teuthology.orchestra.run.smithi146:> grep smithi146.front.sepia.ceph.com /etc/hosts
2024-03-08T03:22:01.315 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146 smithi146.front.sepia.ceph.com smithi146
2024-03-08T03:22:01.315 DEBUG:teuthology.orchestra.run.smithi146:> sudo hostname smithi146
2024-03-08T03:22:01.429 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/smithi146.front.sepia.ceph.com/smithi146/g' /etc/hosts
2024-03-08T03:22:01.459 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/172.21.15.146/172.21.15.146/g' /etc/hosts
2024-03-08T03:22:01.528 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/smithi146.front.sepia.ceph.com/smithi146/g' /etc/hostname
2024-03-08T03:22:01.596 DEBUG:teuthology.orchestra.run.smithi146:> sudo hostname smithi146
2024-03-08T03:22:01.663 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release
2024-03-08T03:22:01.717 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="CentOS Stream"
2024-03-08T03:22:01.717 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="9"
2024-03-08T03:22:01.717 INFO:teuthology.orchestra.run.smithi146.stdout:ID="centos"
2024-03-08T03:22:01.717 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="rhel fedora"
2024-03-08T03:22:01.718 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="9"
2024-03-08T03:22:01.718 INFO:teuthology.orchestra.run.smithi146.stdout:PLATFORM_ID="platform:el9"
2024-03-08T03:22:01.718 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-08T03:22:01.718 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31"
2024-03-08T03:22:01.718 INFO:teuthology.orchestra.run.smithi146.stdout:LOGO="fedora-logo-icon"
2024-03-08T03:22:01.718 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-08T03:22:01.718 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://centos.org/"
2024-03-08T03:22:01.718 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-08T03:22:01.718 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-08T03:22:01.718 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-08T03:22:01.718 INFO:teuthology.provision.fog.smithi146:Deploy complete!
2024-03-08T03:22:01.719 DEBUG:teuthology.parallel:result is None
2024-03-08T03:22:01.886 INFO:teuthology.lock.ops:Checking smithi146.front.sepia.ceph.com
2024-03-08T03:22:01.887 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-08T03:22:01.914 INFO:teuthology.lock.ops:Checking smithi183.front.sepia.ceph.com
2024-03-08T03:22:01.915 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-08T03:22:01.932 INFO:teuthology.lock.ops:Updating [smithi146.front.sepia.ceph.com]: set os type and version on server
2024-03-08T03:22:01.932 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com'
2024-03-08T03:22:01.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-08T03:22:02.018 DEBUG:teuthology.orchestra.run.smithi146:> true
2024-03-08T03:22:02.084 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com'
2024-03-08T03:22:02.084 DEBUG:teuthology.orchestra.run.smithi146:> uname -m
2024-03-08T03:22:02.138 INFO:teuthology.orchestra.run.smithi146.stdout:x86_64
2024-03-08T03:22:02.138 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release
2024-03-08T03:22:02.192 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="CentOS Stream"
2024-03-08T03:22:02.192 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="9"
2024-03-08T03:22:02.192 INFO:teuthology.orchestra.run.smithi146.stdout:ID="centos"
2024-03-08T03:22:02.192 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="rhel fedora"
2024-03-08T03:22:02.192 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="9"
2024-03-08T03:22:02.192 INFO:teuthology.orchestra.run.smithi146.stdout:PLATFORM_ID="platform:el9"
2024-03-08T03:22:02.192 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-08T03:22:02.192 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31"
2024-03-08T03:22:02.193 INFO:teuthology.orchestra.run.smithi146.stdout:LOGO="fedora-logo-icon"
2024-03-08T03:22:02.193 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-08T03:22:02.193 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://centos.org/"
2024-03-08T03:22:02.193 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-08T03:22:02.193 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-08T03:22:02.193 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-08T03:22:02.193 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server
2024-03-08T03:22:02.214 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: set os type and version on server
2024-03-08T03:22:02.214 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com'
2024-03-08T03:22:02.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-08T03:22:02.303 DEBUG:teuthology.orchestra.run.smithi183:> true
2024-03-08T03:22:02.472 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi183.front.sepia.ceph.com'
2024-03-08T03:22:02.472 DEBUG:teuthology.orchestra.run.smithi183:> uname -m
2024-03-08T03:22:02.527 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64
2024-03-08T03:22:02.527 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release
2024-03-08T03:22:02.582 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="CentOS Stream"
2024-03-08T03:22:02.582 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="9"
2024-03-08T03:22:02.582 INFO:teuthology.orchestra.run.smithi183.stdout:ID="centos"
2024-03-08T03:22:02.582 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="rhel fedora"
2024-03-08T03:22:02.582 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="9"
2024-03-08T03:22:02.582 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el9"
2024-03-08T03:22:02.582 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-08T03:22:02.582 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31"
2024-03-08T03:22:02.582 INFO:teuthology.orchestra.run.smithi183.stdout:LOGO="fedora-logo-icon"
2024-03-08T03:22:02.583 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-08T03:22:02.583 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://centos.org/"
2024-03-08T03:22:02.583 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-08T03:22:02.583 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-08T03:22:02.583 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-08T03:22:02.583 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server
2024-03-08T03:22:02.606 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T03:22:02.694 INFO:teuthology.dispatcher.supervisor:Running job 7585322
2024-03-08T03:22:02.694 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_cbodley@teuthology --archive /home/teuthworker/archive/cbodley-2024-03-08_02:21:10-rgw-wip-cbodley-testing-distro-default-smithi/7585322 --name cbodley-2024-03-08_02:21:10-rgw-wip-cbodley-testing-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/two-zonegroup supported-random-distro$/{centos_latest} tasks/test_multi} -- /home/teuthworker/archive/cbodley-2024-03-08_02:21:10-rgw-wip-cbodley-testing-distro-default-smithi/7585322/orig.config.yaml
2024-03-08T03:22:02.698 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/cbodley-2024-03-08_02:21:10-rgw-wip-cbodley-testing-distro-default-smithi/7585322
2024-03-08T03:22:02.698 INFO:teuthology.dispatcher.supervisor:Job PID: 2750858
2024-03-08T03:22:02.699 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-08T03:24:02.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T03:26:02.958 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T03:28:03.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T03:30:03.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T03:32:03.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T03:34:03.642 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T03:36:03.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T03:38:03.986 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T03:40:04.128 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T03:42:04.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T03:44:04.459 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T03:46:04.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T03:48:04.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T03:50:05.009 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T03:52:05.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T03:54:05.302 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T03:56:05.396 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T03:58:05.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T04:00:05.732 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T04:02:05.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T04:04:06.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T04:06:06.246 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T04:08:06.417 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T04:10:06.542 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T04:12:06.705 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T04:14:06.882 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T04:16:07.049 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T04:18:07.206 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T04:20:07.358 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T04:22:07.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T04:24:07.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T04:26:07.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T04:28:07.970 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T04:30:08.117 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T04:32:08.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T04:34:08.426 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T04:36:08.576 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T04:38:08.693 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T04:40:08.856 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T04:42:08.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T04:44:09.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T04:46:09.132 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T04:48:09.244 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T04:50:09.386 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T04:52:09.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T04:54:09.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T04:56:09.840 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T04:58:09.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T05:00:10.137 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T05:02:10.309 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T05:04:10.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T05:06:10.624 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T05:08:10.792 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T05:10:10.914 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T05:12:11.077 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T05:14:11.321 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T05:16:11.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T05:18:11.629 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T05:20:11.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T05:22:11.969 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T05:24:12.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T05:26:12.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T05:28:12.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T05:30:12.774 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T05:32:12.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T05:34:13.142 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T05:36:13.354 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T05:38:13.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T05:40:13.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T05:42:13.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T05:44:14.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T05:46:14.202 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T05:48:14.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T05:50:14.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T05:52:14.620 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T05:54:14.789 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T05:56:14.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T05:58:15.088 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T06:00:15.240 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T06:02:15.386 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T06:04:15.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T06:06:15.765 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T06:08:15.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T06:10:16.110 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T06:12:16.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T06:14:16.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T06:16:16.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T06:18:16.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T06:20:16.778 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T06:22:16.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T06:24:17.068 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T06:26:17.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T06:28:17.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T06:30:17.545 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T06:32:17.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T06:34:17.878 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T06:36:18.049 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T06:38:18.288 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T06:40:18.434 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T06:42:18.604 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T06:44:18.773 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T06:46:18.948 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T06:48:19.121 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T06:50:19.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T06:52:19.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T06:54:19.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T06:56:19.793 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-08T06:56:19.859 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1