2024-04-03T06:59:09.539 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-04-03T06:59:09.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T06:59:09.685 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2529abec10>, signals=[15]) 2024-04-03T06:59:09.686 INFO:teuthology.lock.ops:Start node 'smithi099.front.sepia.ceph.com' reimaging 2024-04-03T06:59:09.687 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: reset os type and version on server 2024-04-03T06:59:09.687 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2024-04-03T06:59:09.703 INFO:teuthology.lock.ops:Start node 'smithi135.front.sepia.ceph.com' reimaging 2024-04-03T06:59:09.703 INFO:teuthology.lock.ops:Updating [smithi135.front.sepia.ceph.com]: reset os type and version on server 2024-04-03T06:59:09.703 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2024-04-03T06:59:09.827 DEBUG:teuthology.provision.fog.smithi099:Requesting image smithi_centos_9.stream (ID 10) 2024-04-03T06:59:09.830 DEBUG:teuthology.provision.fog.smithi135:Requesting image smithi_centos_9.stream (ID 10) 2024-04-03T06:59:09.876 INFO:teuthology.provision.fog.smithi135:Scheduling deploy of centos 9.stream 2024-04-03T06:59:09.879 INFO:teuthology.provision.fog.smithi099:Scheduling deploy of centos 9.stream 2024-04-03T06:59:10.120 INFO:teuthology.orchestra.console.smithi135:Power off 2024-04-03T06:59:10.120 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-03T06:59:10.134 INFO:teuthology.orchestra.console.smithi099:Power off 2024-04-03T06:59:10.135 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-03T06:59:10.143 DEBUG:teuthology.orchestra.console.smithi135:power off output: Chassis Power Control: Down/Off 2024-04-03T06:59:10.144 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-03T06:59:10.157 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off 2024-04-03T06:59:10.158 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-03T06:59:10.170 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2024-04-03T06:59:10.180 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2024-04-03T06:59:14.174 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-03T06:59:14.184 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-03T06:59:14.286 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2024-04-03T06:59:14.292 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2024-04-03T06:59:18.292 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-03T06:59:18.300 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-03T06:59:18.402 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2024-04-03T06:59:18.408 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2024-04-03T06:59:22.406 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-03T06:59:22.413 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-03T06:59:22.515 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2024-04-03T06:59:22.521 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2024-04-03T06:59:22.616 INFO:teuthology.orchestra.console.smithi135:Power off completed 2024-04-03T06:59:22.622 INFO:teuthology.orchestra.console.smithi099:Power off completed 2024-04-03T06:59:22.717 INFO:teuthology.orchestra.console.smithi135:Power on 2024-04-03T06:59:22.718 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-03T06:59:22.725 INFO:teuthology.orchestra.console.smithi099:Power on 2024-04-03T06:59:22.725 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-03T06:59:22.740 DEBUG:teuthology.orchestra.console.smithi135:power on output: Chassis Power Control: Up/On 2024-04-03T06:59:22.740 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-03T06:59:22.748 DEBUG:teuthology.orchestra.console.smithi099:power on output: Chassis Power Control: Up/On 2024-04-03T06:59:22.748 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-03T06:59:22.761 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2024-04-03T06:59:22.769 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2024-04-03T06:59:26.766 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-03T06:59:26.773 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-03T06:59:26.876 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2024-04-03T06:59:26.881 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2024-04-03T06:59:26.981 INFO:teuthology.orchestra.console.smithi099:Power on completed 2024-04-03T06:59:27.082 INFO:teuthology.provision.fog.smithi099:Waiting for deploy to finish 2024-04-03T06:59:30.878 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-03T06:59:30.987 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2024-04-03T06:59:31.088 INFO:teuthology.orchestra.console.smithi135:Power on completed 2024-04-03T06:59:31.189 INFO:teuthology.provision.fog.smithi135:Waiting for deploy to finish 2024-04-03T07:02:01.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-03T07:02:12.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-03T07:02:20.446 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2024-04-03T07:02:26.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-03T07:02:29.506 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2024-04-03T07:02:31.454 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-04-03T07:02:35.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-03T07:02:37.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-03T07:02:38.594 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2024-04-03T07:02:40.514 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-04-03T07:02:44.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-03T07:02:46.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-03T07:02:47.678 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2024-04-03T07:02:49.598 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-04-03T07:02:53.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-03T07:02:55.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-03T07:02:56.734 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2024-04-03T07:02:58.654 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-04-03T07:03:02.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-03T07:03:04.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-03T07:04:02.799 WARNING:teuthology.provision.fog.smithi135:timed out 2024-04-03T07:04:04.662 WARNING:teuthology.provision.fog.smithi099:timed out 2024-04-03T07:04:08.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-03T07:04:09.117 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-03T07:04:09.118 DEBUG:teuthology.orchestra.run.smithi135:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-03T07:04:09.456 INFO:teuthology.provision.fog.smithi135:Node is ready 2024-04-03T07:04:09.456 DEBUG:teuthology.orchestra.run.smithi135:> hostname 2024-04-03T07:04:09.470 INFO:teuthology.orchestra.run.smithi135.stdout:smithi135.front.sepia.ceph.com 2024-04-03T07:04:09.471 DEBUG:teuthology.orchestra.run.smithi135:> grep smithi135.front.sepia.ceph.com /etc/hosts 2024-04-03T07:04:09.526 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135 smithi135.front.sepia.ceph.com smithi135 2024-04-03T07:04:09.526 DEBUG:teuthology.orchestra.run.smithi135:> sudo hostname smithi135 2024-04-03T07:04:09.635 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/smithi135.front.sepia.ceph.com/smithi135/g' /etc/hosts 2024-04-03T07:04:09.664 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/172.21.15.135/172.21.15.135/g' /etc/hosts 2024-04-03T07:04:09.731 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/smithi135.front.sepia.ceph.com/smithi135/g' /etc/hostname 2024-04-03T07:04:09.802 DEBUG:teuthology.orchestra.run.smithi135:> sudo hostname smithi135 2024-04-03T07:04:09.872 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2024-04-03T07:04:09.930 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="CentOS Stream" 2024-04-03T07:04:09.930 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="9" 2024-04-03T07:04:09.930 INFO:teuthology.orchestra.run.smithi135.stdout:ID="centos" 2024-04-03T07:04:09.930 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="rhel fedora" 2024-04-03T07:04:09.930 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="9" 2024-04-03T07:04:09.930 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el9" 2024-04-03T07:04:09.931 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-03T07:04:09.931 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2024-04-03T07:04:09.931 INFO:teuthology.orchestra.run.smithi135.stdout:LOGO="fedora-logo-icon" 2024-04-03T07:04:09.931 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-03T07:04:09.931 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://centos.org/" 2024-04-03T07:04:09.931 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-03T07:04:09.931 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-03T07:04:09.931 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-03T07:04:09.932 INFO:teuthology.provision.fog.smithi135:Deploy complete! 2024-04-03T07:04:09.933 DEBUG:teuthology.parallel:result is None 2024-04-03T07:04:10.665 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-03T07:04:11.077 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-03T07:04:11.077 DEBUG:teuthology.orchestra.run.smithi099:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-03T07:04:11.403 INFO:teuthology.provision.fog.smithi099:Node is ready 2024-04-03T07:04:11.404 DEBUG:teuthology.orchestra.run.smithi099:> hostname 2024-04-03T07:04:11.418 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099.front.sepia.ceph.com 2024-04-03T07:04:11.418 DEBUG:teuthology.orchestra.run.smithi099:> grep smithi099.front.sepia.ceph.com /etc/hosts 2024-04-03T07:04:11.475 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99 smithi099.front.sepia.ceph.com smithi099 2024-04-03T07:04:11.476 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2024-04-03T07:04:11.580 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hosts 2024-04-03T07:04:11.607 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/172.21.15.99/172.21.15.99/g' /etc/hosts 2024-04-03T07:04:11.673 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hostname 2024-04-03T07:04:11.739 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2024-04-03T07:04:11.805 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2024-04-03T07:04:11.859 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream" 2024-04-03T07:04:11.859 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="9" 2024-04-03T07:04:11.859 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos" 2024-04-03T07:04:11.860 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora" 2024-04-03T07:04:11.860 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="9" 2024-04-03T07:04:11.860 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el9" 2024-04-03T07:04:11.860 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-03T07:04:11.860 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2024-04-03T07:04:11.860 INFO:teuthology.orchestra.run.smithi099.stdout:LOGO="fedora-logo-icon" 2024-04-03T07:04:11.860 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-03T07:04:11.860 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/" 2024-04-03T07:04:11.860 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-03T07:04:11.860 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-03T07:04:11.860 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-03T07:04:11.860 INFO:teuthology.provision.fog.smithi099:Deploy complete! 2024-04-03T07:04:11.861 DEBUG:teuthology.parallel:result is None 2024-04-03T07:04:12.024 INFO:teuthology.lock.ops:Checking smithi099.front.sepia.ceph.com 2024-04-03T07:04:12.024 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-03T07:04:12.051 INFO:teuthology.lock.ops:Checking smithi135.front.sepia.ceph.com 2024-04-03T07:04:12.051 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-03T07:04:12.069 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: set os type and version on server 2024-04-03T07:04:12.069 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-04-03T07:04:12.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-03T07:04:12.156 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-04-03T07:04:12.219 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-04-03T07:04:12.220 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2024-04-03T07:04:12.273 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2024-04-03T07:04:12.274 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2024-04-03T07:04:12.328 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream" 2024-04-03T07:04:12.328 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="9" 2024-04-03T07:04:12.328 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos" 2024-04-03T07:04:12.328 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora" 2024-04-03T07:04:12.328 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="9" 2024-04-03T07:04:12.328 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el9" 2024-04-03T07:04:12.328 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-03T07:04:12.328 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2024-04-03T07:04:12.328 INFO:teuthology.orchestra.run.smithi099.stdout:LOGO="fedora-logo-icon" 2024-04-03T07:04:12.328 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-03T07:04:12.328 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/" 2024-04-03T07:04:12.329 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-03T07:04:12.329 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-03T07:04:12.329 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-03T07:04:12.329 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2024-04-03T07:04:12.351 INFO:teuthology.lock.ops:Updating [smithi135.front.sepia.ceph.com]: set os type and version on server 2024-04-03T07:04:12.351 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-04-03T07:04:12.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-03T07:04:12.437 DEBUG:teuthology.orchestra.run.smithi135:> true 2024-04-03T07:04:12.506 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-04-03T07:04:12.506 DEBUG:teuthology.orchestra.run.smithi135:> uname -m 2024-04-03T07:04:12.565 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64 2024-04-03T07:04:12.565 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2024-04-03T07:04:12.625 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="CentOS Stream" 2024-04-03T07:04:12.625 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="9" 2024-04-03T07:04:12.625 INFO:teuthology.orchestra.run.smithi135.stdout:ID="centos" 2024-04-03T07:04:12.625 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="rhel fedora" 2024-04-03T07:04:12.625 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="9" 2024-04-03T07:04:12.625 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el9" 2024-04-03T07:04:12.625 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-03T07:04:12.625 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2024-04-03T07:04:12.625 INFO:teuthology.orchestra.run.smithi135.stdout:LOGO="fedora-logo-icon" 2024-04-03T07:04:12.626 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-03T07:04:12.626 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://centos.org/" 2024-04-03T07:04:12.626 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-03T07:04:12.626 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-03T07:04:12.626 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-03T07:04:12.626 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2024-04-03T07:04:12.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T07:04:12.764 INFO:teuthology.dispatcher.supervisor:Running job 7637304 2024-04-03T07:04:12.764 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-02_21:40:03-rgw-squid-distro-default-smithi/7637304 --name teuthology-2024-04-02_21:40:03-rgw-squid-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/three-zones supported-random-distro$/{centos_latest} tasks/test_multi} -- /home/teuthworker/archive/teuthology-2024-04-02_21:40:03-rgw-squid-distro-default-smithi/7637304/orig.config.yaml 2024-04-03T07:04:12.767 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-02_21:40:03-rgw-squid-distro-default-smithi/7637304 2024-04-03T07:04:12.767 INFO:teuthology.dispatcher.supervisor:Job PID: 1896762 2024-04-03T07:04:12.767 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-03T07:06:12.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T07:08:13.037 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T07:10:13.202 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T07:12:13.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T07:14:13.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T07:16:13.754 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T07:18:13.930 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T07:20:14.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T07:22:14.262 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T07:24:14.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T07:26:14.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T07:28:14.764 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T07:30:14.938 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T07:32:15.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T07:34:15.262 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T07:36:15.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T07:38:15.599 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T07:40:15.768 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T07:42:15.944 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T07:44:16.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T07:46:16.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T07:48:16.444 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T07:50:16.616 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T07:52:16.781 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T07:54:16.949 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T07:56:17.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T07:58:17.296 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T08:00:17.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T08:02:17.648 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T08:04:17.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T08:06:17.993 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T08:08:18.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T08:10:18.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T08:12:18.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T08:14:18.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T08:16:18.884 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T08:18:19.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T08:20:19.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T08:22:19.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T08:24:19.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T08:26:19.706 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T08:28:19.862 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T08:30:20.025 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T08:32:20.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T08:34:20.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T08:36:20.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T08:38:20.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T08:40:20.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T08:42:21.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T08:44:21.198 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T08:46:21.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T08:48:21.542 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T08:50:21.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T08:52:21.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T08:54:22.036 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T08:56:22.192 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T08:58:22.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T09:00:22.507 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T09:02:22.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T09:04:22.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T09:06:23.021 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T09:08:23.193 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T09:10:23.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T09:12:23.526 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T09:14:23.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T09:16:23.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T09:18:24.001 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T09:20:24.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T09:22:24.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T09:24:24.504 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T09:26:24.676 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T09:28:24.825 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T09:30:24.951 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T09:32:25.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T09:34:25.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T09:36:25.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T09:38:25.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T09:40:25.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T09:42:25.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T09:44:26.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T09:46:26.430 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T09:48:26.595 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T09:50:26.766 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T09:52:26.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T09:54:27.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T09:56:27.194 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T09:58:27.368 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T10:00:27.549 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T10:02:27.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T10:04:27.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T10:06:28.059 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T10:08:28.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T10:10:28.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T10:12:28.538 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T10:14:28.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T10:16:28.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T10:18:29.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T10:20:29.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T10:22:29.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T10:24:29.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T10:26:29.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T10:28:29.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T10:30:30.082 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T10:32:30.239 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T10:34:30.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T10:36:30.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T10:38:30.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T10:40:30.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T10:42:31.134 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T10:44:31.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T10:46:31.507 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T10:48:32.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T10:50:32.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T10:52:32.926 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T10:54:33.133 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T10:56:33.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T10:58:33.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T11:00:33.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T11:02:33.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T11:04:34.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T11:06:34.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T11:08:34.365 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T11:10:34.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T11:12:34.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T11:14:34.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T11:16:35.032 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T11:18:35.208 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T11:20:35.390 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T11:22:35.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T11:24:35.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T11:26:35.921 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T11:28:36.091 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T11:30:36.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T11:32:36.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T11:34:36.612 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T11:36:36.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T11:38:36.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T11:40:37.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T11:42:37.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T11:44:37.436 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T11:46:37.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T11:48:37.760 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T11:48:37.823 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1