2024-02-24T10:12:49.835 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-24T10:12:49.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-24T10:12:50.425 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe8e3203c10>, signals=[15]) 2024-02-24T10:12:50.426 INFO:teuthology.lock.ops:Start node 'smithi022.front.sepia.ceph.com' reimaging 2024-02-24T10:12:50.426 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: reset os type and version on server 2024-02-24T10:12:50.426 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2024-02-24T10:12:50.440 INFO:teuthology.lock.ops:Start node 'smithi117.front.sepia.ceph.com' reimaging 2024-02-24T10:12:50.440 INFO:teuthology.lock.ops:Updating [smithi117.front.sepia.ceph.com]: reset os type and version on server 2024-02-24T10:12:50.440 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2024-02-24T10:12:50.727 DEBUG:teuthology.provision.fog.smithi022:Requesting image smithi_centos_9.stream (ID 10) 2024-02-24T10:12:50.746 DEBUG:teuthology.provision.fog.smithi117:Requesting image smithi_centos_9.stream (ID 10) 2024-02-24T10:12:50.887 INFO:teuthology.provision.fog.smithi022:Scheduling deploy of centos 9.stream 2024-02-24T10:12:50.907 INFO:teuthology.provision.fog.smithi117:Scheduling deploy of centos 9.stream 2024-02-24T10:12:51.670 INFO:teuthology.orchestra.console.smithi022:Power off 2024-02-24T10:12:51.670 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-24T10:12:51.701 DEBUG:teuthology.orchestra.console.smithi022:power off output: Chassis Power Control: Down/Off 2024-02-24T10:12:51.701 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-24T10:12:51.726 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2024-02-24T10:12:51.790 INFO:teuthology.orchestra.console.smithi117:Power off 2024-02-24T10:12:51.790 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-24T10:12:51.810 DEBUG:teuthology.orchestra.console.smithi117:power off output: Chassis Power Control: Down/Off 2024-02-24T10:12:51.810 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-24T10:12:51.827 INFO:teuthology.orchestra.console.smithi022:Power off completed 2024-02-24T10:12:51.835 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is off 2024-02-24T10:12:51.928 INFO:teuthology.orchestra.console.smithi022:Power on 2024-02-24T10:12:51.928 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-24T10:12:51.936 INFO:teuthology.orchestra.console.smithi117:Power off completed 2024-02-24T10:12:51.953 DEBUG:teuthology.orchestra.console.smithi022:power on output: Chassis Power Control: Up/On 2024-02-24T10:12:51.953 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-24T10:12:51.974 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2024-02-24T10:12:52.038 INFO:teuthology.orchestra.console.smithi117:Power on 2024-02-24T10:12:52.038 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-24T10:12:52.057 DEBUG:teuthology.orchestra.console.smithi117:power on output: Chassis Power Control: Up/On 2024-02-24T10:12:52.058 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-24T10:12:52.078 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is off 2024-02-24T10:12:55.976 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-24T10:12:56.079 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-24T10:12:56.087 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2024-02-24T10:12:56.187 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is off 2024-02-24T10:13:00.092 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-24T10:13:00.189 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-24T10:13:00.200 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2024-02-24T10:13:00.297 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is on 2024-02-24T10:13:00.301 INFO:teuthology.orchestra.console.smithi022:Power on completed 2024-02-24T10:13:00.398 INFO:teuthology.orchestra.console.smithi117:Power on completed 2024-02-24T10:13:00.402 INFO:teuthology.provision.fog.smithi022:Waiting for deploy to finish 2024-02-24T10:13:00.499 INFO:teuthology.provision.fog.smithi117:Waiting for deploy to finish 2024-02-24T10:15:24.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-24T10:15:27.228 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2024-02-24T10:15:33.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-24T10:15:36.316 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2024-02-24T10:15:41.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-24T10:15:42.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-24T10:15:44.508 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-02-24T10:15:45.372 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2024-02-24T10:15:50.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-24T10:15:51.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-24T10:15:53.596 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-02-24T10:15:54.432 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2024-02-24T10:15:59.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-24T10:16:00.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-24T10:16:02.652 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-02-24T10:16:03.516 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2024-02-24T10:16:08.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-24T10:16:09.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-24T10:16:11.708 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-02-24T10:16:12.572 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2024-02-24T10:16:17.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-24T10:16:18.575 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-24T10:16:20.797 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-02-24T10:16:26.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-24T10:16:29.884 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-02-24T10:16:35.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-24T10:16:38.972 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-02-24T10:16:44.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-24T10:17:03.548 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-02-24T10:17:09.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-24T10:17:12.636 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-02-24T10:17:18.583 WARNING:teuthology.provision.fog.smithi022:timed out 2024-02-24T10:17:18.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-24T10:17:21.692 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-02-24T10:17:24.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-24T10:17:24.909 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-24T10:17:24.910 DEBUG:teuthology.orchestra.run.smithi022:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-24T10:17:25.241 INFO:teuthology.provision.fog.smithi022:Node is ready 2024-02-24T10:17:25.241 DEBUG:teuthology.orchestra.run.smithi022:> hostname 2024-02-24T10:17:25.257 INFO:teuthology.orchestra.run.smithi022.stdout:smithi022.front.sepia.ceph.com 2024-02-24T10:17:25.257 DEBUG:teuthology.orchestra.run.smithi022:> grep smithi022.front.sepia.ceph.com /etc/hosts 2024-02-24T10:17:25.313 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2024-02-24T10:17:25.313 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname smithi022 2024-02-24T10:17:25.442 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/smithi022.front.sepia.ceph.com/smithi022/g' /etc/hosts 2024-02-24T10:17:25.474 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/172.21.15.22/172.21.15.22/g' /etc/hosts 2024-02-24T10:17:25.545 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/smithi022.front.sepia.ceph.com/smithi022/g' /etc/hostname 2024-02-24T10:17:25.617 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname smithi022 2024-02-24T10:17:25.687 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2024-02-24T10:17:25.742 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="CentOS Stream" 2024-02-24T10:17:25.742 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="9" 2024-02-24T10:17:25.742 INFO:teuthology.orchestra.run.smithi022.stdout:ID="centos" 2024-02-24T10:17:25.742 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="rhel fedora" 2024-02-24T10:17:25.742 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="9" 2024-02-24T10:17:25.742 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el9" 2024-02-24T10:17:25.742 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-24T10:17:25.742 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31" 2024-02-24T10:17:25.742 INFO:teuthology.orchestra.run.smithi022.stdout:LOGO="fedora-logo-icon" 2024-02-24T10:17:25.742 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-24T10:17:25.742 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://centos.org/" 2024-02-24T10:17:25.743 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-24T10:17:25.743 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-24T10:17:25.743 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-24T10:17:25.743 INFO:teuthology.provision.fog.smithi022:Deploy complete! 2024-02-24T10:17:25.744 DEBUG:teuthology.parallel:result is None 2024-02-24T10:17:27.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-24T10:17:27.968 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-24T10:17:27.968 DEBUG:teuthology.orchestra.run.smithi117:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-24T10:17:43.338 INFO:teuthology.provision.fog.smithi117:Node is ready 2024-02-24T10:17:43.338 DEBUG:teuthology.orchestra.run.smithi117:> hostname 2024-02-24T10:17:43.396 INFO:teuthology.orchestra.run.smithi117.stdout:smithi117.front.sepia.ceph.com 2024-02-24T10:17:43.397 DEBUG:teuthology.orchestra.run.smithi117:> grep smithi117.front.sepia.ceph.com /etc/hosts 2024-02-24T10:17:43.454 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117 smithi117.front.sepia.ceph.com smithi117 2024-02-24T10:17:43.454 DEBUG:teuthology.orchestra.run.smithi117:> sudo hostname smithi117 2024-02-24T10:17:43.569 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i -e 's/smithi117.front.sepia.ceph.com/smithi117/g' /etc/hosts 2024-02-24T10:17:43.599 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i -e 's/172.21.15.117/172.21.15.117/g' /etc/hosts 2024-02-24T10:17:43.668 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i -e 's/smithi117.front.sepia.ceph.com/smithi117/g' /etc/hostname 2024-02-24T10:17:43.737 DEBUG:teuthology.orchestra.run.smithi117:> sudo hostname smithi117 2024-02-24T10:17:43.805 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release 2024-02-24T10:17:43.859 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="CentOS Stream" 2024-02-24T10:17:43.859 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="9" 2024-02-24T10:17:43.859 INFO:teuthology.orchestra.run.smithi117.stdout:ID="centos" 2024-02-24T10:17:43.859 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="rhel fedora" 2024-02-24T10:17:43.859 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="9" 2024-02-24T10:17:43.859 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el9" 2024-02-24T10:17:43.859 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-24T10:17:43.859 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31" 2024-02-24T10:17:43.859 INFO:teuthology.orchestra.run.smithi117.stdout:LOGO="fedora-logo-icon" 2024-02-24T10:17:43.860 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-24T10:17:43.860 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://centos.org/" 2024-02-24T10:17:43.860 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-24T10:17:43.860 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-24T10:17:43.860 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-24T10:17:43.860 INFO:teuthology.provision.fog.smithi117:Deploy complete! 2024-02-24T10:17:43.861 DEBUG:teuthology.parallel:result is None 2024-02-24T10:17:44.163 INFO:teuthology.lock.ops:Checking smithi022.front.sepia.ceph.com 2024-02-24T10:17:44.163 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-24T10:17:44.193 INFO:teuthology.lock.ops:Checking smithi117.front.sepia.ceph.com 2024-02-24T10:17:44.193 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-24T10:17:44.211 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: set os type and version on server 2024-02-24T10:17:44.211 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-02-24T10:17:44.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-24T10:17:44.313 DEBUG:teuthology.orchestra.run.smithi022:> true 2024-02-24T10:17:44.494 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-02-24T10:17:44.494 DEBUG:teuthology.orchestra.run.smithi022:> uname -m 2024-02-24T10:17:44.549 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64 2024-02-24T10:17:44.550 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2024-02-24T10:17:44.604 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="CentOS Stream" 2024-02-24T10:17:44.604 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="9" 2024-02-24T10:17:44.604 INFO:teuthology.orchestra.run.smithi022.stdout:ID="centos" 2024-02-24T10:17:44.605 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="rhel fedora" 2024-02-24T10:17:44.605 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="9" 2024-02-24T10:17:44.605 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el9" 2024-02-24T10:17:44.605 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-24T10:17:44.605 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31" 2024-02-24T10:17:44.605 INFO:teuthology.orchestra.run.smithi022.stdout:LOGO="fedora-logo-icon" 2024-02-24T10:17:44.605 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-24T10:17:44.605 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://centos.org/" 2024-02-24T10:17:44.605 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-24T10:17:44.605 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-24T10:17:44.605 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-24T10:17:44.606 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2024-02-24T10:17:44.627 INFO:teuthology.lock.ops:Updating [smithi117.front.sepia.ceph.com]: set os type and version on server 2024-02-24T10:17:44.627 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-02-24T10:17:44.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-24T10:17:44.716 DEBUG:teuthology.orchestra.run.smithi117:> true 2024-02-24T10:17:44.788 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-02-24T10:17:44.788 DEBUG:teuthology.orchestra.run.smithi117:> uname -m 2024-02-24T10:17:44.844 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64 2024-02-24T10:17:44.845 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release 2024-02-24T10:17:44.900 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="CentOS Stream" 2024-02-24T10:17:44.900 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="9" 2024-02-24T10:17:44.900 INFO:teuthology.orchestra.run.smithi117.stdout:ID="centos" 2024-02-24T10:17:44.901 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="rhel fedora" 2024-02-24T10:17:44.901 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="9" 2024-02-24T10:17:44.901 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el9" 2024-02-24T10:17:44.901 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-24T10:17:44.901 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31" 2024-02-24T10:17:44.901 INFO:teuthology.orchestra.run.smithi117.stdout:LOGO="fedora-logo-icon" 2024-02-24T10:17:44.901 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-24T10:17:44.901 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://centos.org/" 2024-02-24T10:17:44.901 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-24T10:17:44.901 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-24T10:17:44.901 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-24T10:17:44.902 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2024-02-24T10:17:44.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-24T10:17:45.021 INFO:teuthology.dispatcher.supervisor:Running job 7572946 2024-02-24T10:17:45.021 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-02-24_10:11:26-fs-wip-vshankar-testing-20240216.060239-testing-default-smithi/7572946 --name vshankar-2024-02-24_10:11:26-fs-wip-vshankar-testing-20240216.060239-testing-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/vshankar-2024-02-24_10:11:26-fs-wip-vshankar-testing-20240216.060239-testing-default-smithi/7572946/orig.config.yaml 2024-02-24T10:17:45.027 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-02-24_10:11:26-fs-wip-vshankar-testing-20240216.060239-testing-default-smithi/7572946 2024-02-24T10:17:45.027 INFO:teuthology.dispatcher.supervisor:Job PID: 1471949 2024-02-24T10:17:45.027 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-24T10:19:45.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-24T10:21:45.294 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-24T10:23:45.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-24T10:25:45.636 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-24T10:27:45.808 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-24T10:29:45.980 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-24T10:31:46.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-24T10:33:46.328 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-24T10:35:46.509 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-24T10:37:46.681 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-24T10:39:46.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-24T10:41:46.988 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-24T10:43:47.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-24T10:45:47.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-24T10:47:47.458 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-24T10:49:47.661 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-24T10:51:47.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-24T10:53:48.000 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-24T10:55:48.096 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-24T10:57:48.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-24T10:59:48.416 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-24T11:01:48.576 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-24T11:03:48.742 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-24T11:05:48.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-24T11:07:49.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-24T11:09:49.252 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-24T11:09:49.320 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-02-24T11:09:49.506 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi022 but it was locked by another job: /home/teuthworker/archive/vshankar-2024-02-24_10:11:26-fs-wip-vshankar-testing-20240216.060239-testing-default-smithi/7572996 2024-02-24T11:09:49.506 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi117 but it was locked by another job: /home/teuthworker/archive/vshankar-2024-02-24_10:11:26-fs-wip-vshankar-testing-20240216.060239-testing-default-smithi/7572996