2024-02-19T18:29:43.838 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-19T18:29:43.838 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:29:43.984 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7d3735dc10>, signals=[15]) 2024-02-19T18:29:43.985 INFO:teuthology.lock.ops:Start node 'smithi016.front.sepia.ceph.com' reimaging 2024-02-19T18:29:43.985 INFO:teuthology.lock.ops:Updating [smithi016.front.sepia.ceph.com]: reset os type and version on server 2024-02-19T18:29:43.985 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2024-02-19T18:29:44.008 INFO:teuthology.lock.ops:Start node 'smithi136.front.sepia.ceph.com' reimaging 2024-02-19T18:29:44.009 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: reset os type and version on server 2024-02-19T18:29:44.009 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2024-02-19T18:29:44.118 DEBUG:teuthology.provision.fog.smithi016:Requesting image smithi_centos_9.stream (ID 10) 2024-02-19T18:29:44.142 DEBUG:teuthology.provision.fog.smithi136:Requesting image smithi_centos_9.stream (ID 10) 2024-02-19T18:29:44.161 INFO:teuthology.provision.fog.smithi016:Scheduling deploy of centos 9.stream 2024-02-19T18:29:44.187 INFO:teuthology.provision.fog.smithi136:Scheduling deploy of centos 9.stream 2024-02-19T18:29:44.451 INFO:teuthology.orchestra.console.smithi136:Power off 2024-02-19T18:29:44.452 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-19T18:29:44.466 INFO:teuthology.orchestra.console.smithi016:Power off 2024-02-19T18:29:44.466 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-19T18:29:44.473 DEBUG:teuthology.orchestra.console.smithi136:power off output: Chassis Power Control: Down/Off 2024-02-19T18:29:44.474 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:29:44.486 DEBUG:teuthology.orchestra.console.smithi016:power off output: Chassis Power Control: Down/Off 2024-02-19T18:29:44.486 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:29:44.497 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2024-02-19T18:29:44.534 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is on 2024-02-19T18:29:48.502 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:29:48.535 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:29:48.612 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2024-02-19T18:29:48.644 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is on 2024-02-19T18:29:52.616 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:29:52.645 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:29:52.725 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2024-02-19T18:29:52.754 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is off 2024-02-19T18:29:52.826 INFO:teuthology.orchestra.console.smithi136:Power off completed 2024-02-19T18:29:52.855 INFO:teuthology.orchestra.console.smithi016:Power off completed 2024-02-19T18:29:52.927 INFO:teuthology.orchestra.console.smithi136:Power on 2024-02-19T18:29:52.928 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-19T18:29:52.950 DEBUG:teuthology.orchestra.console.smithi136:power on output: Chassis Power Control: Up/On 2024-02-19T18:29:52.950 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:29:52.957 INFO:teuthology.orchestra.console.smithi016:Power on 2024-02-19T18:29:52.957 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-19T18:29:52.970 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2024-02-19T18:29:52.977 DEBUG:teuthology.orchestra.console.smithi016:power on output: Chassis Power Control: Up/On 2024-02-19T18:29:52.977 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:29:52.996 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is off 2024-02-19T18:29:56.972 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:29:56.998 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:29:57.082 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2024-02-19T18:29:57.107 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is off 2024-02-19T18:30:01.084 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:30:01.108 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:30:01.193 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2024-02-19T18:30:01.217 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is on 2024-02-19T18:30:01.294 INFO:teuthology.orchestra.console.smithi136:Power on completed 2024-02-19T18:30:01.318 INFO:teuthology.orchestra.console.smithi016:Power on completed 2024-02-19T18:30:01.395 INFO:teuthology.provision.fog.smithi136:Waiting for deploy to finish 2024-02-19T18:30:01.418 INFO:teuthology.provision.fog.smithi016:Waiting for deploy to finish 2024-02-19T18:32:33.353 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:32:36.412 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16 2024-02-19T18:32:42.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:32:45.500 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16 2024-02-19T18:32:51.502 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:32:54.556 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16 2024-02-19T18:33:00.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:33:03.612 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16 2024-02-19T18:33:09.618 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:33:12.668 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16 2024-02-19T18:33:18.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:34:18.676 WARNING:teuthology.provision.fog.smithi016:timed out 2024-02-19T18:34:24.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:34:24.925 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-19T18:34:24.925 DEBUG:teuthology.orchestra.run.smithi016:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-19T18:34:25.273 INFO:teuthology.provision.fog.smithi016:Node is ready 2024-02-19T18:34:25.273 DEBUG:teuthology.orchestra.run.smithi016:> hostname 2024-02-19T18:34:25.288 INFO:teuthology.orchestra.run.smithi016.stdout:smithi016.front.sepia.ceph.com 2024-02-19T18:34:25.288 DEBUG:teuthology.orchestra.run.smithi016:> grep smithi016.front.sepia.ceph.com /etc/hosts 2024-02-19T18:34:25.343 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16 smithi016.front.sepia.ceph.com smithi016 2024-02-19T18:34:25.344 DEBUG:teuthology.orchestra.run.smithi016:> sudo hostname smithi016 2024-02-19T18:34:25.452 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i -e 's/smithi016.front.sepia.ceph.com/smithi016/g' /etc/hosts 2024-02-19T18:34:25.484 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i -e 's/172.21.15.16/172.21.15.16/g' /etc/hosts 2024-02-19T18:34:25.556 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i -e 's/smithi016.front.sepia.ceph.com/smithi016/g' /etc/hostname 2024-02-19T18:34:25.627 DEBUG:teuthology.orchestra.run.smithi016:> sudo hostname smithi016 2024-02-19T18:34:25.699 DEBUG:teuthology.orchestra.run.smithi016:> cat /etc/os-release 2024-02-19T18:34:25.754 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="CentOS Stream" 2024-02-19T18:34:25.754 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="9" 2024-02-19T18:34:25.754 INFO:teuthology.orchestra.run.smithi016.stdout:ID="centos" 2024-02-19T18:34:25.754 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE="rhel fedora" 2024-02-19T18:34:25.754 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="9" 2024-02-19T18:34:25.754 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM_ID="platform:el9" 2024-02-19T18:34:25.754 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T18:34:25.754 INFO:teuthology.orchestra.run.smithi016.stdout:ANSI_COLOR="0;31" 2024-02-19T18:34:25.754 INFO:teuthology.orchestra.run.smithi016.stdout:LOGO="fedora-logo-icon" 2024-02-19T18:34:25.754 INFO:teuthology.orchestra.run.smithi016.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T18:34:25.755 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://centos.org/" 2024-02-19T18:34:25.755 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T18:34:25.755 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T18:34:25.755 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T18:34:25.755 INFO:teuthology.provision.fog.smithi016:Deploy complete! 2024-02-19T18:34:25.757 DEBUG:teuthology.parallel:result is None 2024-02-19T18:35:47.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:35:50.172 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-02-19T18:35:56.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:35:59.228 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-02-19T18:36:05.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:36:08.317 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-02-19T18:36:14.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:36:17.372 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-02-19T18:36:23.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:36:26.460 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-02-19T18:36:32.465 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:36:35.516 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-02-19T18:36:41.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:36:44.572 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-02-19T18:36:50.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:37:09.052 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-02-19T18:37:15.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:37:18.140 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-02-19T18:37:24.146 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:37:27.196 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-02-19T18:37:33.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:37:33.400 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-19T18:37:33.400 DEBUG:teuthology.orchestra.run.smithi136:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-19T18:37:53.721 INFO:teuthology.provision.fog.smithi136:Node is ready 2024-02-19T18:37:53.722 DEBUG:teuthology.orchestra.run.smithi136:> hostname 2024-02-19T18:37:53.740 INFO:teuthology.orchestra.run.smithi136.stdout:smithi136.front.sepia.ceph.com 2024-02-19T18:37:53.740 DEBUG:teuthology.orchestra.run.smithi136:> grep smithi136.front.sepia.ceph.com /etc/hosts 2024-02-19T18:37:53.797 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.15.136 smithi136.front.sepia.ceph.com smithi136 2024-02-19T18:37:53.797 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136 2024-02-19T18:37:53.934 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi136.front.sepia.ceph.com/smithi136/g' /etc/hosts 2024-02-19T18:37:53.967 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/172.21.15.136/172.21.15.136/g' /etc/hosts 2024-02-19T18:37:54.037 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi136.front.sepia.ceph.com/smithi136/g' /etc/hostname 2024-02-19T18:37:54.106 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136 2024-02-19T18:37:54.174 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2024-02-19T18:37:54.229 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="CentOS Stream" 2024-02-19T18:37:54.229 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="9" 2024-02-19T18:37:54.229 INFO:teuthology.orchestra.run.smithi136.stdout:ID="centos" 2024-02-19T18:37:54.229 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="rhel fedora" 2024-02-19T18:37:54.229 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="9" 2024-02-19T18:37:54.229 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el9" 2024-02-19T18:37:54.229 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T18:37:54.229 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31" 2024-02-19T18:37:54.229 INFO:teuthology.orchestra.run.smithi136.stdout:LOGO="fedora-logo-icon" 2024-02-19T18:37:54.229 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T18:37:54.230 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://centos.org/" 2024-02-19T18:37:54.230 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T18:37:54.230 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T18:37:54.230 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T18:37:54.230 INFO:teuthology.provision.fog.smithi136:Deploy complete! 2024-02-19T18:37:54.231 DEBUG:teuthology.parallel:result is None 2024-02-19T18:37:54.400 INFO:teuthology.lock.ops:Checking smithi016.front.sepia.ceph.com 2024-02-19T18:37:54.401 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-19T18:37:54.422 INFO:teuthology.lock.ops:Checking smithi136.front.sepia.ceph.com 2024-02-19T18:37:54.422 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-19T18:37:54.440 INFO:teuthology.lock.ops:Updating [smithi016.front.sepia.ceph.com]: set os type and version on server 2024-02-19T18:37:54.441 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-02-19T18:37:54.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:37:54.544 DEBUG:teuthology.orchestra.run.smithi016:> true 2024-02-19T18:37:54.722 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-02-19T18:37:54.722 DEBUG:teuthology.orchestra.run.smithi016:> uname -m 2024-02-19T18:37:54.777 INFO:teuthology.orchestra.run.smithi016.stdout:x86_64 2024-02-19T18:37:54.777 DEBUG:teuthology.orchestra.run.smithi016:> cat /etc/os-release 2024-02-19T18:37:54.832 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="CentOS Stream" 2024-02-19T18:37:54.832 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="9" 2024-02-19T18:37:54.832 INFO:teuthology.orchestra.run.smithi016.stdout:ID="centos" 2024-02-19T18:37:54.832 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE="rhel fedora" 2024-02-19T18:37:54.832 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="9" 2024-02-19T18:37:54.832 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM_ID="platform:el9" 2024-02-19T18:37:54.832 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T18:37:54.833 INFO:teuthology.orchestra.run.smithi016.stdout:ANSI_COLOR="0;31" 2024-02-19T18:37:54.833 INFO:teuthology.orchestra.run.smithi016.stdout:LOGO="fedora-logo-icon" 2024-02-19T18:37:54.833 INFO:teuthology.orchestra.run.smithi016.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T18:37:54.833 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://centos.org/" 2024-02-19T18:37:54.833 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T18:37:54.833 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T18:37:54.833 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T18:37:54.833 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2024-02-19T18:37:54.856 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: set os type and version on server 2024-02-19T18:37:54.856 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-02-19T18:37:54.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:37:54.949 DEBUG:teuthology.orchestra.run.smithi136:> true 2024-02-19T18:37:55.019 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-02-19T18:37:55.019 DEBUG:teuthology.orchestra.run.smithi136:> uname -m 2024-02-19T18:37:55.076 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64 2024-02-19T18:37:55.076 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2024-02-19T18:37:55.131 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="CentOS Stream" 2024-02-19T18:37:55.131 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="9" 2024-02-19T18:37:55.131 INFO:teuthology.orchestra.run.smithi136.stdout:ID="centos" 2024-02-19T18:37:55.131 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="rhel fedora" 2024-02-19T18:37:55.131 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="9" 2024-02-19T18:37:55.131 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el9" 2024-02-19T18:37:55.132 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T18:37:55.132 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31" 2024-02-19T18:37:55.132 INFO:teuthology.orchestra.run.smithi136.stdout:LOGO="fedora-logo-icon" 2024-02-19T18:37:55.132 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T18:37:55.132 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://centos.org/" 2024-02-19T18:37:55.132 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T18:37:55.132 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T18:37:55.132 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T18:37:55.132 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2024-02-19T18:37:55.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:37:55.241 INFO:teuthology.dispatcher.supervisor:Running job 7566604 2024-02-19T18:37:55.241 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7566604 --name pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi --description fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 0a 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7566604/orig.config.yaml 2024-02-19T18:37:55.244 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7566604 2024-02-19T18:37:55.244 INFO:teuthology.dispatcher.supervisor:Job PID: 3452755 2024-02-19T18:37:55.244 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-19T18:39:55.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:41:55.513 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:43:55.677 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:45:55.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:47:56.109 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:49:56.284 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:51:56.437 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:53:56.605 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:55:56.729 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:57:56.900 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:59:57.064 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:01:57.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:03:57.332 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:05:57.493 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:07:57.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:09:57.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:11:57.977 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:13:58.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:15:58.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:17:58.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:19:58.669 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:21:58.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:23:59.014 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:25:59.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:27:59.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:29:59.432 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:31:59.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:33:59.773 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:35:59.934 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:38:00.064 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:40:00.254 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:42:00.418 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:44:00.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:46:00.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:48:00.860 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:50:01.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:52:01.440 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:54:01.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:56:01.773 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:58:01.932 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:00:02.059 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:02:02.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:04:02.346 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:06:02.524 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:08:02.678 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:10:02.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:12:02.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:14:03.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:16:03.341 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:18:03.509 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:20:03.677 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:20:03.736 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-02-19T20:20:03.931 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi016 but it was locked by another job: /home/teuthworker/archive/rfriedma-2024-02-19_19:13:03-rados:thrash-wip-rf-hobject-distro-default-smithi/7566683 2024-02-19T20:20:03.932 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi136 but it was locked by another job: /home/teuthworker/archive/rfriedma-2024-02-19_19:13:03-rados:thrash-wip-rf-hobject-distro-default-smithi/7566683