2024-03-11T05:31:43.055 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-11T05:31:43.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T05:31:43.208 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f81f14d2c10>, signals=[15]) 2024-03-11T05:31:43.208 INFO:teuthology.lock.ops:Start node 'smithi132.front.sepia.ceph.com' reimaging 2024-03-11T05:31:43.209 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: reset os type and version on server 2024-03-11T05:31:43.209 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2024-03-11T05:31:43.225 INFO:teuthology.lock.ops:Start node 'smithi187.front.sepia.ceph.com' reimaging 2024-03-11T05:31:43.225 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: reset os type and version on server 2024-03-11T05:31:43.225 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2024-03-11T05:31:43.358 DEBUG:teuthology.provision.fog.smithi132:Requesting image smithi_centos_9.stream (ID 10) 2024-03-11T05:31:43.382 DEBUG:teuthology.provision.fog.smithi187:Requesting image smithi_centos_9.stream (ID 10) 2024-03-11T05:31:43.429 INFO:teuthology.provision.fog.smithi132:Scheduling deploy of centos 9.stream 2024-03-11T05:31:43.436 INFO:teuthology.provision.fog.smithi187:Scheduling deploy of centos 9.stream 2024-03-11T05:31:43.687 INFO:teuthology.orchestra.console.smithi187:Power off 2024-03-11T05:31:43.687 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-11T05:31:43.712 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off 2024-03-11T05:31:43.712 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T05:31:43.727 INFO:teuthology.orchestra.console.smithi132:Power off 2024-03-11T05:31:43.727 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-11T05:31:43.737 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2024-03-11T05:31:43.751 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off 2024-03-11T05:31:43.751 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T05:31:43.774 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2024-03-11T05:31:47.742 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T05:31:47.776 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T05:31:47.852 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2024-03-11T05:31:47.886 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2024-03-11T05:31:51.857 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T05:31:51.887 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T05:31:51.966 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2024-03-11T05:31:51.996 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2024-03-11T05:31:55.970 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T05:31:55.997 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T05:31:56.083 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2024-03-11T05:31:56.106 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2024-03-11T05:31:56.186 INFO:teuthology.orchestra.console.smithi187:Power off completed 2024-03-11T05:31:56.207 INFO:teuthology.orchestra.console.smithi132:Power off completed 2024-03-11T05:31:56.287 INFO:teuthology.orchestra.console.smithi187:Power on 2024-03-11T05:31:56.287 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-11T05:31:56.309 INFO:teuthology.orchestra.console.smithi132:Power on 2024-03-11T05:31:56.309 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-11T05:31:56.317 DEBUG:teuthology.orchestra.console.smithi187:power on output: Chassis Power Control: Up/On 2024-03-11T05:31:56.317 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T05:31:56.331 DEBUG:teuthology.orchestra.console.smithi132:power on output: Chassis Power Control: Up/On 2024-03-11T05:31:56.331 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T05:31:56.341 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2024-03-11T05:31:56.355 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2024-03-11T05:32:00.346 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T05:32:00.356 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T05:32:00.456 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2024-03-11T05:32:00.466 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2024-03-11T05:32:00.558 INFO:teuthology.orchestra.console.smithi187:Power on completed 2024-03-11T05:32:00.568 INFO:teuthology.orchestra.console.smithi132:Power on completed 2024-03-11T05:32:00.659 INFO:teuthology.provision.fog.smithi187:Waiting for deploy to finish 2024-03-11T05:32:00.668 INFO:teuthology.provision.fog.smithi132:Waiting for deploy to finish 2024-03-11T05:34:31.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T05:34:31.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T05:34:34.591 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-03-11T05:34:34.591 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-03-11T05:34:40.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T05:34:40.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T05:34:43.646 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-03-11T05:34:43.678 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-03-11T05:34:49.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T05:34:49.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T05:34:52.734 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-03-11T05:34:52.734 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-03-11T05:34:58.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T05:34:58.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T05:35:01.822 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-03-11T05:35:01.823 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-03-11T05:35:07.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T05:35:07.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T05:35:10.910 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-03-11T05:35:10.911 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-03-11T05:35:16.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T05:35:16.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T05:35:19.966 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-03-11T05:35:19.967 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-03-11T05:35:25.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T05:35:25.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T05:35:29.022 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-03-11T05:35:35.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T05:35:44.418 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-03-11T05:35:50.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T05:35:53.502 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-03-11T05:35:59.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T05:36:02.590 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-03-11T05:36:08.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T05:36:08.809 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-11T05:36:08.809 DEBUG:teuthology.orchestra.run.smithi132:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-11T05:36:24.325 INFO:teuthology.provision.fog.smithi132:Node is ready 2024-03-11T05:36:24.325 DEBUG:teuthology.orchestra.run.smithi132:> hostname 2024-03-11T05:36:24.386 INFO:teuthology.orchestra.run.smithi132.stdout:smithi046 2024-03-11T05:36:24.386 DEBUG:teuthology.orchestra.run.smithi132:> grep smithi046 /etc/hosts 2024-03-11T05:36:24.444 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2024-03-11T05:36:24.444 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132 2024-03-11T05:36:24.593 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi046/smithi132/g' /etc/hosts 2024-03-11T05:36:24.635 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/172.21.15.46/172.21.15.132/g' /etc/hosts 2024-03-11T05:36:24.703 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi046/smithi132/g' /etc/hostname 2024-03-11T05:36:24.772 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132 2024-03-11T05:36:24.838 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2024-03-11T05:36:24.893 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="CentOS Stream" 2024-03-11T05:36:24.893 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="9" 2024-03-11T05:36:24.893 INFO:teuthology.orchestra.run.smithi132.stdout:ID="centos" 2024-03-11T05:36:24.894 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="rhel fedora" 2024-03-11T05:36:24.894 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="9" 2024-03-11T05:36:24.894 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el9" 2024-03-11T05:36:24.894 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-11T05:36:24.894 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2024-03-11T05:36:24.894 INFO:teuthology.orchestra.run.smithi132.stdout:LOGO="fedora-logo-icon" 2024-03-11T05:36:24.894 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-11T05:36:24.894 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://centos.org/" 2024-03-11T05:36:24.894 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-11T05:36:24.894 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-11T05:36:24.894 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-11T05:36:24.895 INFO:teuthology.provision.fog.smithi132:Deploy complete! 2024-03-11T05:36:24.896 DEBUG:teuthology.parallel:result is None 2024-03-11T05:36:35.038 WARNING:teuthology.provision.fog.smithi187:timed out 2024-03-11T05:36:41.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T05:36:41.307 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-11T05:36:41.307 DEBUG:teuthology.orchestra.run.smithi187:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-11T05:36:41.655 INFO:teuthology.provision.fog.smithi187:Node is ready 2024-03-11T05:36:41.655 DEBUG:teuthology.orchestra.run.smithi187:> hostname 2024-03-11T05:36:41.670 INFO:teuthology.orchestra.run.smithi187.stdout:smithi187.front.sepia.ceph.com 2024-03-11T05:36:41.670 DEBUG:teuthology.orchestra.run.smithi187:> grep smithi187.front.sepia.ceph.com /etc/hosts 2024-03-11T05:36:41.725 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.15.187 smithi187.front.sepia.ceph.com smithi187 2024-03-11T05:36:41.726 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187 2024-03-11T05:36:41.830 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187.front.sepia.ceph.com/smithi187/g' /etc/hosts 2024-03-11T05:36:41.859 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/172.21.15.187/172.21.15.187/g' /etc/hosts 2024-03-11T05:36:41.927 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187.front.sepia.ceph.com/smithi187/g' /etc/hostname 2024-03-11T05:36:41.994 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187 2024-03-11T05:36:42.058 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2024-03-11T05:36:42.110 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Stream" 2024-03-11T05:36:42.110 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="9" 2024-03-11T05:36:42.110 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos" 2024-03-11T05:36:42.110 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora" 2024-03-11T05:36:42.110 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="9" 2024-03-11T05:36:42.110 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el9" 2024-03-11T05:36:42.110 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-11T05:36:42.110 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2024-03-11T05:36:42.111 INFO:teuthology.orchestra.run.smithi187.stdout:LOGO="fedora-logo-icon" 2024-03-11T05:36:42.111 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-11T05:36:42.111 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://centos.org/" 2024-03-11T05:36:42.111 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-11T05:36:42.111 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-11T05:36:42.111 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-11T05:36:42.113 INFO:teuthology.provision.fog.smithi187:Deploy complete! 2024-03-11T05:36:42.114 DEBUG:teuthology.parallel:result is None 2024-03-11T05:36:42.313 INFO:teuthology.lock.ops:Checking smithi132.front.sepia.ceph.com 2024-03-11T05:36:42.313 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-11T05:36:42.341 INFO:teuthology.lock.ops:Checking smithi187.front.sepia.ceph.com 2024-03-11T05:36:42.342 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-11T05:36:42.367 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: set os type and version on server 2024-03-11T05:36:42.367 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-03-11T05:36:42.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T05:36:42.454 DEBUG:teuthology.orchestra.run.smithi132:> true 2024-03-11T05:36:42.620 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-03-11T05:36:42.620 DEBUG:teuthology.orchestra.run.smithi132:> uname -m 2024-03-11T05:36:42.675 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64 2024-03-11T05:36:42.676 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2024-03-11T05:36:42.730 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="CentOS Stream" 2024-03-11T05:36:42.731 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="9" 2024-03-11T05:36:42.731 INFO:teuthology.orchestra.run.smithi132.stdout:ID="centos" 2024-03-11T05:36:42.731 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="rhel fedora" 2024-03-11T05:36:42.731 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="9" 2024-03-11T05:36:42.731 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el9" 2024-03-11T05:36:42.732 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-11T05:36:42.732 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2024-03-11T05:36:42.732 INFO:teuthology.orchestra.run.smithi132.stdout:LOGO="fedora-logo-icon" 2024-03-11T05:36:42.732 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-11T05:36:42.732 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://centos.org/" 2024-03-11T05:36:42.732 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-11T05:36:42.732 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-11T05:36:42.732 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-11T05:36:42.733 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2024-03-11T05:36:42.757 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: set os type and version on server 2024-03-11T05:36:42.758 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-03-11T05:36:42.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T05:36:42.854 DEBUG:teuthology.orchestra.run.smithi187:> true 2024-03-11T05:36:42.921 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-03-11T05:36:42.921 DEBUG:teuthology.orchestra.run.smithi187:> uname -m 2024-03-11T05:36:42.975 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64 2024-03-11T05:36:42.976 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2024-03-11T05:36:43.033 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Stream" 2024-03-11T05:36:43.033 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="9" 2024-03-11T05:36:43.033 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos" 2024-03-11T05:36:43.033 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora" 2024-03-11T05:36:43.033 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="9" 2024-03-11T05:36:43.033 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el9" 2024-03-11T05:36:43.033 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-11T05:36:43.033 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2024-03-11T05:36:43.033 INFO:teuthology.orchestra.run.smithi187.stdout:LOGO="fedora-logo-icon" 2024-03-11T05:36:43.033 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-11T05:36:43.033 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://centos.org/" 2024-03-11T05:36:43.033 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-11T05:36:43.034 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-11T05:36:43.034 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-11T05:36:43.034 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2024-03-11T05:36:43.058 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T05:36:43.160 INFO:teuthology.dispatcher.supervisor:Running job 7590762 2024-03-11T05:36:43.160 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-03-11_05:30:10-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7590762 --name vshankar-2024-03-11_05:30:10-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi --description fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/vshankar-2024-03-11_05:30:10-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7590762/orig.config.yaml 2024-03-11T05:36:43.163 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-03-11_05:30:10-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7590762 2024-03-11T05:36:43.163 INFO:teuthology.dispatcher.supervisor:Job PID: 141718 2024-03-11T05:36:43.163 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-11T05:38:43.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T05:40:43.445 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T05:42:43.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T05:44:43.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T05:46:43.951 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T05:48:44.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T05:50:44.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T05:52:44.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T05:54:44.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T05:56:44.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T05:58:44.906 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T06:00:45.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T06:02:45.239 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T06:04:45.408 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T06:06:45.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T06:08:45.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T06:10:45.922 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T06:12:46.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T06:14:46.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T06:16:46.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T06:18:46.574 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T06:20:46.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T06:22:46.892 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T06:24:47.060 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T06:26:47.216 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T06:28:47.371 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T06:30:47.552 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T06:32:47.757 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T06:34:47.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T06:36:48.098 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T06:38:48.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T06:40:48.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T06:42:48.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T06:44:48.757 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T06:46:48.916 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T06:48:49.056 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T06:50:49.214 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T06:52:49.368 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T06:54:49.532 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T06:56:49.708 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T06:58:49.846 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T07:00:50.016 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T07:02:50.194 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T07:04:50.382 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T07:06:50.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T07:08:50.650 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T07:10:50.810 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T07:12:50.984 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T07:14:51.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T07:16:51.313 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T07:18:51.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T07:20:51.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T07:22:51.788 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T07:24:51.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T07:26:52.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T07:28:52.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T07:30:52.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T07:32:52.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T07:34:52.589 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T07:36:52.758 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T07:38:52.884 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T07:40:53.020 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T07:42:53.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T07:44:53.300 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T07:46:53.478 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T07:48:53.584 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T07:50:53.756 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T07:52:53.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T07:54:54.052 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T07:56:54.202 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T07:58:54.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T08:00:54.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T08:02:54.718 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T08:04:54.884 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T08:06:55.044 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T08:08:55.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T08:10:55.333 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T08:12:55.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T08:14:55.654 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T08:16:55.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T08:18:55.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T08:20:56.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T08:20:56.181 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1