2024-03-27T22:57:17.065 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-27T22:57:17.066 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T22:57:17.206 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f55644d6c10>, signals=[15]) 2024-03-27T22:57:17.207 INFO:teuthology.lock.ops:Start node 'smithi086.front.sepia.ceph.com' reimaging 2024-03-27T22:57:17.207 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: reset os type and version on server 2024-03-27T22:57:17.207 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2024-03-27T22:57:17.227 INFO:teuthology.lock.ops:Start node 'smithi159.front.sepia.ceph.com' reimaging 2024-03-27T22:57:17.227 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: reset os type and version on server 2024-03-27T22:57:17.227 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2024-03-27T22:57:17.332 DEBUG:teuthology.provision.fog.smithi086:Requesting image smithi_centos_9.stream (ID 10) 2024-03-27T22:57:17.356 DEBUG:teuthology.provision.fog.smithi159:Requesting image smithi_centos_9.stream (ID 10) 2024-03-27T22:57:17.372 INFO:teuthology.provision.fog.smithi086:Scheduling deploy of centos 9.stream 2024-03-27T22:57:17.404 INFO:teuthology.provision.fog.smithi159:Scheduling deploy of centos 9.stream 2024-03-27T22:57:17.632 INFO:teuthology.orchestra.console.smithi159:Power off 2024-03-27T22:57:17.632 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-27T22:57:17.644 INFO:teuthology.orchestra.console.smithi086:Power off 2024-03-27T22:57:17.645 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-27T22:57:17.653 DEBUG:teuthology.orchestra.console.smithi159:power off output: Chassis Power Control: Down/Off 2024-03-27T22:57:17.653 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T22:57:17.667 DEBUG:teuthology.orchestra.console.smithi086:power off output: Chassis Power Control: Down/Off 2024-03-27T22:57:17.667 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T22:57:17.675 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on 2024-03-27T22:57:17.693 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on 2024-03-27T22:57:21.678 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T22:57:21.695 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T22:57:21.788 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on 2024-03-27T22:57:21.804 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on 2024-03-27T22:57:25.790 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T22:57:25.805 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T22:57:25.902 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on 2024-03-27T22:57:25.917 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on 2024-03-27T22:57:29.906 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T22:57:29.918 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T22:57:30.018 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off 2024-03-27T22:57:30.027 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off 2024-03-27T22:57:30.120 INFO:teuthology.orchestra.console.smithi159:Power off completed 2024-03-27T22:57:30.128 INFO:teuthology.orchestra.console.smithi086:Power off completed 2024-03-27T22:57:30.221 INFO:teuthology.orchestra.console.smithi159:Power on 2024-03-27T22:57:30.221 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-27T22:57:30.229 INFO:teuthology.orchestra.console.smithi086:Power on 2024-03-27T22:57:30.229 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-27T22:57:30.244 DEBUG:teuthology.orchestra.console.smithi159:power on output: Chassis Power Control: Up/On 2024-03-27T22:57:30.244 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T22:57:30.255 DEBUG:teuthology.orchestra.console.smithi086:power on output: Chassis Power Control: Up/On 2024-03-27T22:57:30.255 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T22:57:30.268 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off 2024-03-27T22:57:30.278 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off 2024-03-27T22:57:34.270 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T22:57:34.279 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T22:57:34.381 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on 2024-03-27T22:57:34.390 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on 2024-03-27T22:57:34.482 INFO:teuthology.orchestra.console.smithi159:Power on completed 2024-03-27T22:57:34.491 INFO:teuthology.orchestra.console.smithi086:Power on completed 2024-03-27T22:57:34.583 INFO:teuthology.provision.fog.smithi159:Waiting for deploy to finish 2024-03-27T22:57:34.591 INFO:teuthology.provision.fog.smithi086:Waiting for deploy to finish 2024-03-27T23:00:05.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T23:00:08.478 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-03-27T23:00:14.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T23:00:17.534 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-03-27T23:00:20.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T23:00:23.538 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T23:00:23.550 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2024-03-27T23:00:26.590 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-03-27T23:00:29.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T23:00:32.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T23:00:32.606 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2024-03-27T23:00:35.650 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-03-27T23:00:38.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T23:00:41.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T23:00:41.666 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2024-03-27T23:00:44.738 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-03-27T23:00:47.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T23:00:50.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T23:00:50.754 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2024-03-27T23:00:53.822 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-03-27T23:00:56.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T23:00:59.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T23:00:59.838 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2024-03-27T23:01:02.878 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-03-27T23:01:05.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T23:01:08.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T23:01:08.898 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2024-03-27T23:01:14.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T23:01:17.986 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2024-03-27T23:01:23.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T23:01:27.070 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2024-03-27T23:01:27.198 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-03-27T23:01:33.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T23:01:33.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T23:01:36.254 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-03-27T23:01:42.259 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T23:01:45.351 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-27T23:01:45.352 DEBUG:teuthology.orchestra.run.smithi086:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-27T23:02:05.700 INFO:teuthology.provision.fog.smithi086:Node is ready 2024-03-27T23:02:05.700 DEBUG:teuthology.orchestra.run.smithi086:> hostname 2024-03-27T23:02:05.718 INFO:teuthology.orchestra.run.smithi086.stdout:smithi046 2024-03-27T23:02:05.719 DEBUG:teuthology.orchestra.run.smithi086:> grep smithi046 /etc/hosts 2024-03-27T23:02:05.776 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2024-03-27T23:02:05.776 DEBUG:teuthology.orchestra.run.smithi086:> sudo hostname smithi086 2024-03-27T23:02:05.972 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/smithi046/smithi086/g' /etc/hosts 2024-03-27T23:02:06.012 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/172.21.15.46/172.21.15.86/g' /etc/hosts 2024-03-27T23:02:06.082 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/smithi046/smithi086/g' /etc/hostname 2024-03-27T23:02:06.150 DEBUG:teuthology.orchestra.run.smithi086:> sudo hostname smithi086 2024-03-27T23:02:06.217 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2024-03-27T23:02:06.272 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="CentOS Stream" 2024-03-27T23:02:06.272 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="9" 2024-03-27T23:02:06.272 INFO:teuthology.orchestra.run.smithi086.stdout:ID="centos" 2024-03-27T23:02:06.273 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="rhel fedora" 2024-03-27T23:02:06.273 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="9" 2024-03-27T23:02:06.273 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el9" 2024-03-27T23:02:06.273 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-27T23:02:06.273 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2024-03-27T23:02:06.273 INFO:teuthology.orchestra.run.smithi086.stdout:LOGO="fedora-logo-icon" 2024-03-27T23:02:06.273 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-27T23:02:06.273 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://centos.org/" 2024-03-27T23:02:06.273 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-27T23:02:06.273 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-27T23:02:06.273 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-27T23:02:06.274 INFO:teuthology.provision.fog.smithi086:Deploy complete! 2024-03-27T23:02:06.276 DEBUG:teuthology.parallel:result is None 2024-03-27T23:02:33.103 WARNING:teuthology.provision.fog.smithi159:timed out 2024-03-27T23:02:39.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T23:02:39.490 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-27T23:02:39.491 DEBUG:teuthology.orchestra.run.smithi159:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-27T23:02:39.808 INFO:teuthology.provision.fog.smithi159:Node is ready 2024-03-27T23:02:39.808 DEBUG:teuthology.orchestra.run.smithi159:> hostname 2024-03-27T23:02:39.822 INFO:teuthology.orchestra.run.smithi159.stdout:smithi159.front.sepia.ceph.com 2024-03-27T23:02:39.823 DEBUG:teuthology.orchestra.run.smithi159:> grep smithi159.front.sepia.ceph.com /etc/hosts 2024-03-27T23:02:39.877 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159 smithi159.front.sepia.ceph.com smithi159 2024-03-27T23:02:39.878 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159 2024-03-27T23:02:39.987 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hosts 2024-03-27T23:02:40.015 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/172.21.15.159/172.21.15.159/g' /etc/hosts 2024-03-27T23:02:40.083 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hostname 2024-03-27T23:02:40.153 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159 2024-03-27T23:02:40.224 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2024-03-27T23:02:40.281 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Stream" 2024-03-27T23:02:40.281 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="9" 2024-03-27T23:02:40.282 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos" 2024-03-27T23:02:40.282 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora" 2024-03-27T23:02:40.282 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="9" 2024-03-27T23:02:40.282 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el9" 2024-03-27T23:02:40.282 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-27T23:02:40.282 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31" 2024-03-27T23:02:40.282 INFO:teuthology.orchestra.run.smithi159.stdout:LOGO="fedora-logo-icon" 2024-03-27T23:02:40.282 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-27T23:02:40.282 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/" 2024-03-27T23:02:40.282 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-27T23:02:40.283 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-27T23:02:40.283 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-27T23:02:40.283 INFO:teuthology.provision.fog.smithi159:Deploy complete! 2024-03-27T23:02:40.283 DEBUG:teuthology.parallel:result is None 2024-03-27T23:02:40.450 INFO:teuthology.lock.ops:Checking smithi086.front.sepia.ceph.com 2024-03-27T23:02:40.451 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-27T23:02:40.470 INFO:teuthology.lock.ops:Checking smithi159.front.sepia.ceph.com 2024-03-27T23:02:40.470 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-27T23:02:40.487 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: set os type and version on server 2024-03-27T23:02:40.487 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-03-27T23:02:40.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T23:02:40.573 DEBUG:teuthology.orchestra.run.smithi086:> true 2024-03-27T23:02:40.741 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-03-27T23:02:40.741 DEBUG:teuthology.orchestra.run.smithi086:> uname -m 2024-03-27T23:02:40.796 INFO:teuthology.orchestra.run.smithi086.stdout:x86_64 2024-03-27T23:02:40.796 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2024-03-27T23:02:40.850 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="CentOS Stream" 2024-03-27T23:02:40.851 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="9" 2024-03-27T23:02:40.851 INFO:teuthology.orchestra.run.smithi086.stdout:ID="centos" 2024-03-27T23:02:40.851 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="rhel fedora" 2024-03-27T23:02:40.851 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="9" 2024-03-27T23:02:40.851 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el9" 2024-03-27T23:02:40.851 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-27T23:02:40.851 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2024-03-27T23:02:40.851 INFO:teuthology.orchestra.run.smithi086.stdout:LOGO="fedora-logo-icon" 2024-03-27T23:02:40.851 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-27T23:02:40.851 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://centos.org/" 2024-03-27T23:02:40.851 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-27T23:02:40.851 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-27T23:02:40.852 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-27T23:02:40.852 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2024-03-27T23:02:40.878 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: set os type and version on server 2024-03-27T23:02:40.878 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-03-27T23:02:40.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T23:02:40.969 DEBUG:teuthology.orchestra.run.smithi159:> true 2024-03-27T23:02:41.037 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-03-27T23:02:41.037 DEBUG:teuthology.orchestra.run.smithi159:> uname -m 2024-03-27T23:02:41.095 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64 2024-03-27T23:02:41.096 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2024-03-27T23:02:41.154 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Stream" 2024-03-27T23:02:41.154 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="9" 2024-03-27T23:02:41.154 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos" 2024-03-27T23:02:41.154 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora" 2024-03-27T23:02:41.154 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="9" 2024-03-27T23:02:41.154 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el9" 2024-03-27T23:02:41.154 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-27T23:02:41.154 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31" 2024-03-27T23:02:41.155 INFO:teuthology.orchestra.run.smithi159.stdout:LOGO="fedora-logo-icon" 2024-03-27T23:02:41.155 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-27T23:02:41.155 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/" 2024-03-27T23:02:41.155 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-27T23:02:41.155 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-27T23:02:41.155 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-27T23:02:41.155 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2024-03-27T23:02:41.178 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T23:02:41.266 INFO:teuthology.dispatcher.supervisor:Running job 7627636 2024-03-27T23:02:41.266 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627636 --name yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/two-zonegroup supported-random-distro$/{centos_latest} tasks/test_multi} -- /home/teuthworker/archive/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627636/orig.config.yaml 2024-03-27T23:02:41.270 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627636 2024-03-27T23:02:41.270 INFO:teuthology.dispatcher.supervisor:Job PID: 2452463 2024-03-27T23:02:41.271 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-27T23:04:41.372 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T23:06:41.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T23:08:41.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T23:10:41.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T23:12:42.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T23:14:42.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T23:16:42.389 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T23:18:42.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T23:20:42.730 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T23:22:42.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T23:24:43.074 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T23:26:43.254 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T23:28:43.424 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T23:30:43.595 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T23:32:43.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T23:34:43.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T23:36:44.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T23:38:44.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T23:40:44.437 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T23:42:44.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T23:44:44.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T23:46:44.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T23:48:45.117 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T23:50:45.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T23:52:45.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T23:54:45.652 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T23:56:45.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T23:58:46.002 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T00:00:46.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T00:02:46.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T00:04:46.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T00:06:46.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T00:08:46.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T00:10:47.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T00:12:47.205 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T00:14:47.378 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T00:16:47.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T00:18:47.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T00:20:47.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T00:22:48.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T00:24:48.262 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T00:26:48.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T00:28:48.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T00:30:48.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T00:32:48.960 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T00:34:49.133 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T00:36:49.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T00:38:49.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T00:40:49.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T00:42:49.817 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T00:44:49.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T00:46:50.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T00:48:50.336 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T00:50:50.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T00:52:50.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T00:54:50.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T00:56:50.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T00:58:51.104 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T01:00:51.273 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T01:02:51.384 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T01:04:51.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T01:06:51.726 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T01:08:51.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T01:10:52.091 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T01:12:52.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T01:14:52.429 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T01:16:52.605 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T01:18:52.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T01:20:52.897 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T01:22:53.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T01:24:53.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T01:26:53.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T01:28:53.553 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T01:30:53.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T01:32:53.877 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T01:34:54.045 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T01:36:54.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T01:38:54.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T01:40:54.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T01:42:54.721 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T01:44:54.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T01:46:55.064 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T01:48:55.243 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T01:50:55.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T01:52:55.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T01:54:55.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T01:56:55.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T01:58:56.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T02:00:56.130 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T02:02:56.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T02:04:56.496 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T02:06:56.660 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T02:08:56.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T02:10:56.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T02:12:57.094 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T02:14:57.233 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T02:16:57.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T02:18:57.577 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T02:20:57.742 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T02:22:57.893 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T02:24:58.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T02:26:58.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T02:28:58.556 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T02:30:58.709 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T02:32:58.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T02:34:59.008 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T02:36:59.182 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T02:38:59.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T02:40:59.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T02:42:59.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T02:44:59.897 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T02:47:00.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T02:47:00.127 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1