2024-03-04T15:51:36.849 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-03-04T15:51:36.849 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T15:51:37.014 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7b5314fc10>, signals=[15]) 2024-03-04T15:51:37.015 INFO:teuthology.lock.ops:Start node 'smithi027.front.sepia.ceph.com' reimaging 2024-03-04T15:51:37.015 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: reset os type and version on server 2024-03-04T15:51:37.015 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2024-03-04T15:51:37.046 INFO:teuthology.lock.ops:Start node 'smithi071.front.sepia.ceph.com' reimaging 2024-03-04T15:51:37.046 INFO:teuthology.lock.ops:Updating [smithi071.front.sepia.ceph.com]: reset os type and version on server 2024-03-04T15:51:37.046 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2024-03-04T15:51:37.202 DEBUG:teuthology.provision.fog.smithi027:Requesting image smithi_centos_9.stream (ID 10) 2024-03-04T15:51:37.237 DEBUG:teuthology.provision.fog.smithi071:Requesting image smithi_centos_9.stream (ID 10) 2024-03-04T15:51:37.254 INFO:teuthology.provision.fog.smithi027:Scheduling deploy of centos 9.stream 2024-03-04T15:51:37.288 INFO:teuthology.provision.fog.smithi071:Scheduling deploy of centos 9.stream 2024-03-04T15:51:37.572 INFO:teuthology.orchestra.console.smithi071:Power off 2024-03-04T15:51:37.572 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-04T15:51:37.585 INFO:teuthology.orchestra.console.smithi027:Power off 2024-03-04T15:51:37.586 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-04T15:51:37.633 DEBUG:teuthology.orchestra.console.smithi027:power off output: Chassis Power Control: Down/Off 2024-03-04T15:51:37.634 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T15:51:37.642 DEBUG:teuthology.orchestra.console.smithi071:power off output: Chassis Power Control: Down/Off 2024-03-04T15:51:37.643 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T15:51:37.694 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on 2024-03-04T15:51:37.697 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2024-03-04T15:51:41.699 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T15:51:41.706 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T15:51:41.809 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on 2024-03-04T15:51:41.815 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2024-03-04T15:51:45.813 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T15:51:45.824 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T15:51:45.926 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on 2024-03-04T15:51:45.933 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2024-03-04T15:51:46.033 INFO:teuthology.orchestra.console.smithi027:Power off completed 2024-03-04T15:51:46.134 INFO:teuthology.orchestra.console.smithi027:Power on 2024-03-04T15:51:46.134 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-04T15:51:46.167 DEBUG:teuthology.orchestra.console.smithi027:power on output: Chassis Power Control: Up/On 2024-03-04T15:51:46.168 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T15:51:46.215 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2024-03-04T15:51:49.930 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T15:51:50.040 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is off 2024-03-04T15:51:50.141 INFO:teuthology.orchestra.console.smithi071:Power off completed 2024-03-04T15:51:50.216 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T15:51:50.241 INFO:teuthology.orchestra.console.smithi071:Power on 2024-03-04T15:51:50.242 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-04T15:51:50.288 DEBUG:teuthology.orchestra.console.smithi071:power on output: Chassis Power Control: Up/On 2024-03-04T15:51:50.289 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T15:51:50.326 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2024-03-04T15:51:50.335 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is off 2024-03-04T15:51:54.328 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T15:51:54.336 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T15:51:54.438 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2024-03-04T15:51:54.446 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on 2024-03-04T15:51:54.540 INFO:teuthology.orchestra.console.smithi027:Power on completed 2024-03-04T15:51:54.548 INFO:teuthology.orchestra.console.smithi071:Power on completed 2024-03-04T15:51:54.641 INFO:teuthology.provision.fog.smithi027:Waiting for deploy to finish 2024-03-04T15:51:54.653 INFO:teuthology.provision.fog.smithi071:Waiting for deploy to finish 2024-03-04T15:54:40.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T15:54:44.060 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-03-04T15:54:50.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T15:54:53.148 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-03-04T15:54:56.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T15:54:56.211 ERROR:teuthology.orchestra.connection:Error authenticating with smithi027.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-03-04T15:54:59.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T15:55:02.240 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-03-04T15:55:08.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T15:55:11.324 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-03-04T15:55:17.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T15:55:20.412 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-03-04T15:55:26.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T15:55:29.504 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-03-04T15:55:35.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T15:56:00.241 WARNING:teuthology.provision.fog.smithi027:timed out 2024-03-04T15:56:06.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T15:56:09.340 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-03-04T15:56:15.341 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T15:56:18.428 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-03-04T15:56:24.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T15:56:35.517 WARNING:teuthology.provision.fog.smithi071:timed out 2024-03-04T15:56:41.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T15:56:41.834 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-04T15:56:41.835 DEBUG:teuthology.orchestra.run.smithi071:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-04T15:56:42.154 INFO:teuthology.provision.fog.smithi071:Node is ready 2024-03-04T15:56:42.155 DEBUG:teuthology.orchestra.run.smithi071:> hostname 2024-03-04T15:56:42.169 INFO:teuthology.orchestra.run.smithi071.stdout:smithi071.front.sepia.ceph.com 2024-03-04T15:56:42.169 DEBUG:teuthology.orchestra.run.smithi071:> grep smithi071.front.sepia.ceph.com /etc/hosts 2024-03-04T15:56:42.228 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71 smithi071.front.sepia.ceph.com smithi071 2024-03-04T15:56:42.231 DEBUG:teuthology.orchestra.run.smithi071:> sudo hostname smithi071 2024-03-04T15:56:42.333 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i -e 's/smithi071.front.sepia.ceph.com/smithi071/g' /etc/hosts 2024-03-04T15:56:42.360 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i -e 's/172.21.15.71/172.21.15.71/g' /etc/hosts 2024-03-04T15:56:42.431 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i -e 's/smithi071.front.sepia.ceph.com/smithi071/g' /etc/hostname 2024-03-04T15:56:42.502 DEBUG:teuthology.orchestra.run.smithi071:> sudo hostname smithi071 2024-03-04T15:56:42.571 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2024-03-04T15:56:42.629 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="CentOS Stream" 2024-03-04T15:56:42.630 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="9" 2024-03-04T15:56:42.630 INFO:teuthology.orchestra.run.smithi071.stdout:ID="centos" 2024-03-04T15:56:42.630 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="rhel fedora" 2024-03-04T15:56:42.630 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="9" 2024-03-04T15:56:42.630 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el9" 2024-03-04T15:56:42.630 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-04T15:56:42.630 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2024-03-04T15:56:42.630 INFO:teuthology.orchestra.run.smithi071.stdout:LOGO="fedora-logo-icon" 2024-03-04T15:56:42.630 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-04T15:56:42.630 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://centos.org/" 2024-03-04T15:56:42.630 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-04T15:56:42.630 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-04T15:56:42.630 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-04T15:56:42.631 INFO:teuthology.provision.fog.smithi071:Deploy complete! 2024-03-04T15:56:42.633 DEBUG:teuthology.parallel:result is None 2024-03-04T15:57:24.457 WARNING:teuthology.provision.fog.smithi027:timed out 2024-03-04T15:57:30.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T15:57:30.732 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-04T15:57:30.732 DEBUG:teuthology.orchestra.run.smithi027:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-04T15:57:31.076 INFO:teuthology.provision.fog.smithi027:Node is ready 2024-03-04T15:57:31.076 DEBUG:teuthology.orchestra.run.smithi027:> hostname 2024-03-04T15:57:31.092 INFO:teuthology.orchestra.run.smithi027.stdout:smithi027.front.sepia.ceph.com 2024-03-04T15:57:31.092 DEBUG:teuthology.orchestra.run.smithi027:> grep smithi027.front.sepia.ceph.com /etc/hosts 2024-03-04T15:57:31.148 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27 smithi027.front.sepia.ceph.com smithi027 2024-03-04T15:57:31.148 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname smithi027 2024-03-04T15:57:31.266 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/smithi027.front.sepia.ceph.com/smithi027/g' /etc/hosts 2024-03-04T15:57:31.297 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/172.21.15.27/172.21.15.27/g' /etc/hosts 2024-03-04T15:57:31.369 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/smithi027.front.sepia.ceph.com/smithi027/g' /etc/hostname 2024-03-04T15:57:31.440 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname smithi027 2024-03-04T15:57:31.510 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release 2024-03-04T15:57:31.565 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="CentOS Stream" 2024-03-04T15:57:31.565 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="9" 2024-03-04T15:57:31.565 INFO:teuthology.orchestra.run.smithi027.stdout:ID="centos" 2024-03-04T15:57:31.565 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="rhel fedora" 2024-03-04T15:57:31.565 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="9" 2024-03-04T15:57:31.565 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el9" 2024-03-04T15:57:31.565 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-04T15:57:31.566 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31" 2024-03-04T15:57:31.566 INFO:teuthology.orchestra.run.smithi027.stdout:LOGO="fedora-logo-icon" 2024-03-04T15:57:31.566 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-04T15:57:31.566 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://centos.org/" 2024-03-04T15:57:31.566 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-04T15:57:31.566 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-04T15:57:31.566 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-04T15:57:31.566 INFO:teuthology.provision.fog.smithi027:Deploy complete! 2024-03-04T15:57:31.567 DEBUG:teuthology.parallel:result is None 2024-03-04T15:57:31.900 INFO:teuthology.lock.ops:Checking smithi027.front.sepia.ceph.com 2024-03-04T15:57:31.900 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-04T15:57:31.931 INFO:teuthology.lock.ops:Checking smithi071.front.sepia.ceph.com 2024-03-04T15:57:31.931 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-04T15:57:31.966 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: set os type and version on server 2024-03-04T15:57:31.966 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-03-04T15:57:31.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T15:57:32.139 DEBUG:teuthology.orchestra.run.smithi027:> true 2024-03-04T15:57:32.206 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-03-04T15:57:32.206 DEBUG:teuthology.orchestra.run.smithi027:> uname -m 2024-03-04T15:57:32.261 INFO:teuthology.orchestra.run.smithi027.stdout:x86_64 2024-03-04T15:57:32.262 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release 2024-03-04T15:57:32.316 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="CentOS Stream" 2024-03-04T15:57:32.316 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="9" 2024-03-04T15:57:32.317 INFO:teuthology.orchestra.run.smithi027.stdout:ID="centos" 2024-03-04T15:57:32.317 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="rhel fedora" 2024-03-04T15:57:32.317 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="9" 2024-03-04T15:57:32.317 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el9" 2024-03-04T15:57:32.317 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-04T15:57:32.317 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31" 2024-03-04T15:57:32.317 INFO:teuthology.orchestra.run.smithi027.stdout:LOGO="fedora-logo-icon" 2024-03-04T15:57:32.317 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-04T15:57:32.317 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://centos.org/" 2024-03-04T15:57:32.317 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-04T15:57:32.317 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-04T15:57:32.317 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-04T15:57:32.318 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2024-03-04T15:57:32.348 INFO:teuthology.lock.ops:Updating [smithi071.front.sepia.ceph.com]: set os type and version on server 2024-03-04T15:57:32.348 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-03-04T15:57:32.349 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T15:57:32.453 DEBUG:teuthology.orchestra.run.smithi071:> true 2024-03-04T15:57:32.525 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-03-04T15:57:32.525 DEBUG:teuthology.orchestra.run.smithi071:> uname -m 2024-03-04T15:57:32.582 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64 2024-03-04T15:57:32.582 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2024-03-04T15:57:32.638 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="CentOS Stream" 2024-03-04T15:57:32.638 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="9" 2024-03-04T15:57:32.639 INFO:teuthology.orchestra.run.smithi071.stdout:ID="centos" 2024-03-04T15:57:32.639 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="rhel fedora" 2024-03-04T15:57:32.639 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="9" 2024-03-04T15:57:32.639 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el9" 2024-03-04T15:57:32.639 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-04T15:57:32.639 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2024-03-04T15:57:32.639 INFO:teuthology.orchestra.run.smithi071.stdout:LOGO="fedora-logo-icon" 2024-03-04T15:57:32.639 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-04T15:57:32.640 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://centos.org/" 2024-03-04T15:57:32.640 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-04T15:57:32.640 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-04T15:57:32.640 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-04T15:57:32.640 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2024-03-04T15:57:32.666 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T15:57:32.782 INFO:teuthology.dispatcher.supervisor:Running job 7581264 2024-03-04T15:57:32.782 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_suriarte@teuthology --archive /home/teuthworker/archive/suriarte-2024-03-04_15:42:14-rgw-main-distro-default-smithi/7581264 --name suriarte-2024-03-04_15:42:14-rgw-main-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/three-zones supported-random-distro$/{centos_latest} tasks/test_multi} -- /home/teuthworker/archive/suriarte-2024-03-04_15:42:14-rgw-main-distro-default-smithi/7581264/orig.config.yaml 2024-03-04T15:57:32.786 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/suriarte-2024-03-04_15:42:14-rgw-main-distro-default-smithi/7581264 2024-03-04T15:57:32.786 INFO:teuthology.dispatcher.supervisor:Job PID: 67939 2024-03-04T15:57:32.786 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-04T15:59:32.788 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T16:01:32.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T16:03:32.946 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T16:05:33.022 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T16:07:33.104 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T16:09:33.205 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T16:11:33.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T16:13:33.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T16:15:33.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T16:17:33.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T16:19:33.541 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T16:21:33.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T16:23:33.681 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T16:25:33.752 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T16:27:33.822 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T16:29:33.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T16:31:33.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T16:33:34.041 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T16:35:34.108 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T16:37:34.181 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T16:39:34.250 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T16:41:34.320 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T16:43:34.384 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T16:45:34.449 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T16:47:34.522 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T16:49:34.593 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T16:51:34.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T16:53:34.740 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T16:55:34.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T16:57:34.884 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T16:59:34.953 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T17:01:35.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T17:03:35.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T17:05:35.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T17:07:35.260 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T17:09:35.334 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T17:11:35.398 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T17:13:35.474 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T17:15:35.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T17:17:35.634 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T17:19:35.768 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T17:21:35.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T17:23:35.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T17:25:35.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T17:27:36.045 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T17:29:36.120 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T17:31:36.202 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T17:33:36.302 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T17:35:36.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T17:37:36.457 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T17:39:36.530 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T17:41:36.604 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T17:43:36.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T17:45:36.752 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T17:47:36.828 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T17:49:36.930 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T17:51:37.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T17:53:37.080 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T17:55:37.152 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T17:57:37.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T17:59:37.289 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T18:01:37.353 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T18:03:37.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T18:05:37.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T18:07:37.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T18:09:37.637 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T18:11:37.700 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T18:13:37.774 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T18:15:37.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T18:17:37.928 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T18:19:37.998 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T18:21:38.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T18:23:38.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T18:25:38.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T18:27:38.285 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T18:29:38.354 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T18:31:38.426 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T18:33:38.506 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T18:35:38.589 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T18:37:38.660 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T18:39:38.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T18:41:38.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T18:43:38.884 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T18:45:38.956 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T18:47:39.029 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T18:49:39.091 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T18:51:39.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T18:53:39.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T18:55:39.340 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T18:57:39.412 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T18:59:39.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T19:01:39.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T19:03:39.636 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T19:05:39.700 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T19:07:39.773 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T19:09:39.854 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T19:11:39.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T19:13:39.997 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T19:15:40.061 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T19:17:40.212 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T19:19:40.288 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T19:20:40.285 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1