2024-02-20T07:26:21.766 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-20T07:26:21.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:26:21.910 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4873e3fc10>, signals=[15]) 2024-02-20T07:26:21.910 INFO:teuthology.lock.ops:Start node 'smithi064.front.sepia.ceph.com' reimaging 2024-02-20T07:26:21.910 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: reset os type and version on server 2024-02-20T07:26:21.910 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2024-02-20T07:26:21.932 INFO:teuthology.lock.ops:Start node 'smithi071.front.sepia.ceph.com' reimaging 2024-02-20T07:26:21.932 INFO:teuthology.lock.ops:Updating [smithi071.front.sepia.ceph.com]: reset os type and version on server 2024-02-20T07:26:21.933 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2024-02-20T07:26:22.058 DEBUG:teuthology.provision.fog.smithi064:Requesting image smithi_centos_9.stream (ID 10) 2024-02-20T07:26:22.068 DEBUG:teuthology.provision.fog.smithi071:Requesting image smithi_centos_9.stream (ID 10) 2024-02-20T07:26:22.122 INFO:teuthology.provision.fog.smithi064:Scheduling deploy of centos 9.stream 2024-02-20T07:26:22.127 INFO:teuthology.provision.fog.smithi071:Scheduling deploy of centos 9.stream 2024-02-20T07:26:22.376 INFO:teuthology.orchestra.console.smithi064:Power off 2024-02-20T07:26:22.376 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-20T07:26:22.393 INFO:teuthology.orchestra.console.smithi071:Power off 2024-02-20T07:26:22.393 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-20T07:26:22.403 DEBUG:teuthology.orchestra.console.smithi064:power off output: Chassis Power Control: Down/Off 2024-02-20T07:26:22.404 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:26:22.418 DEBUG:teuthology.orchestra.console.smithi071:power off output: Chassis Power Control: Down/Off 2024-02-20T07:26:22.418 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:26:22.430 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2024-02-20T07:26:22.440 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on 2024-02-20T07:26:26.434 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:26:26.442 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:26:26.544 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2024-02-20T07:26:26.551 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on 2024-02-20T07:26:30.550 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:26:30.558 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:26:30.661 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2024-02-20T07:26:30.669 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is off 2024-02-20T07:26:30.771 INFO:teuthology.orchestra.console.smithi071:Power off completed 2024-02-20T07:26:30.871 INFO:teuthology.orchestra.console.smithi071:Power on 2024-02-20T07:26:30.872 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-20T07:26:30.895 DEBUG:teuthology.orchestra.console.smithi071:power on output: Chassis Power Control: Up/On 2024-02-20T07:26:30.895 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:26:30.916 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is off 2024-02-20T07:26:34.666 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:26:34.775 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2024-02-20T07:26:34.875 INFO:teuthology.orchestra.console.smithi064:Power off completed 2024-02-20T07:26:34.917 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:26:34.977 INFO:teuthology.orchestra.console.smithi064:Power on 2024-02-20T07:26:34.977 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-20T07:26:34.998 DEBUG:teuthology.orchestra.console.smithi064:power on output: Chassis Power Control: Up/On 2024-02-20T07:26:34.998 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:26:35.021 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2024-02-20T07:26:35.026 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is off 2024-02-20T07:26:39.024 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:26:39.032 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:26:39.134 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2024-02-20T07:26:39.140 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on 2024-02-20T07:26:39.236 INFO:teuthology.orchestra.console.smithi064:Power on completed 2024-02-20T07:26:39.241 INFO:teuthology.orchestra.console.smithi071:Power on completed 2024-02-20T07:26:39.337 INFO:teuthology.provision.fog.smithi064:Waiting for deploy to finish 2024-02-20T07:26:39.342 INFO:teuthology.provision.fog.smithi071:Waiting for deploy to finish 2024-02-20T07:29:10.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:29:13.308 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-02-20T07:29:19.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:29:22.364 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-02-20T07:29:25.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:29:28.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:29:28.380 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2024-02-20T07:29:31.420 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-02-20T07:29:34.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:29:37.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:29:37.436 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2024-02-20T07:29:40.480 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-02-20T07:29:43.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:29:46.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:29:46.492 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2024-02-20T07:29:49.564 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-02-20T07:29:52.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:29:55.552 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2024-02-20T07:29:55.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:29:58.620 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-02-20T07:30:01.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:30:04.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:30:04.636 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2024-02-20T07:30:10.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:30:13.692 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2024-02-20T07:30:19.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:30:23.168 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-02-20T07:30:29.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:30:32.252 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-02-20T07:30:38.012 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2024-02-20T07:30:38.253 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:30:41.308 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-02-20T07:30:44.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:30:47.068 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2024-02-20T07:30:47.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:30:47.639 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-20T07:30:47.639 DEBUG:teuthology.orchestra.run.smithi071:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-20T07:30:53.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:30:56.124 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2024-02-20T07:31:02.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:31:02.389 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-20T07:31:02.389 DEBUG:teuthology.orchestra.run.smithi064:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-20T07:31:03.105 INFO:teuthology.provision.fog.smithi071:Node is ready 2024-02-20T07:31:03.105 DEBUG:teuthology.orchestra.run.smithi071:> hostname 2024-02-20T07:31:03.122 INFO:teuthology.orchestra.run.smithi071.stdout:smithi046 2024-02-20T07:31:03.123 DEBUG:teuthology.orchestra.run.smithi071:> grep smithi046 /etc/hosts 2024-02-20T07:31:03.180 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2024-02-20T07:31:03.180 DEBUG:teuthology.orchestra.run.smithi071:> sudo hostname smithi071 2024-02-20T07:31:03.304 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i -e 's/smithi046/smithi071/g' /etc/hosts 2024-02-20T07:31:03.334 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i -e 's/172.21.15.46/172.21.15.71/g' /etc/hosts 2024-02-20T07:31:03.403 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i -e 's/smithi046/smithi071/g' /etc/hostname 2024-02-20T07:31:03.471 DEBUG:teuthology.orchestra.run.smithi071:> sudo hostname smithi071 2024-02-20T07:31:03.538 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2024-02-20T07:31:03.593 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="CentOS Stream" 2024-02-20T07:31:03.593 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="9" 2024-02-20T07:31:03.593 INFO:teuthology.orchestra.run.smithi071.stdout:ID="centos" 2024-02-20T07:31:03.593 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="rhel fedora" 2024-02-20T07:31:03.593 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="9" 2024-02-20T07:31:03.593 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el9" 2024-02-20T07:31:03.593 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-20T07:31:03.593 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2024-02-20T07:31:03.593 INFO:teuthology.orchestra.run.smithi071.stdout:LOGO="fedora-logo-icon" 2024-02-20T07:31:03.593 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-20T07:31:03.593 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://centos.org/" 2024-02-20T07:31:03.593 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-20T07:31:03.594 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-20T07:31:03.594 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-20T07:31:03.594 INFO:teuthology.provision.fog.smithi071:Deploy complete! 2024-02-20T07:31:03.596 DEBUG:teuthology.parallel:result is None 2024-02-20T07:31:17.729 INFO:teuthology.provision.fog.smithi064:Node is ready 2024-02-20T07:31:17.729 DEBUG:teuthology.orchestra.run.smithi064:> hostname 2024-02-20T07:31:17.788 INFO:teuthology.orchestra.run.smithi064.stdout:smithi046 2024-02-20T07:31:17.789 DEBUG:teuthology.orchestra.run.smithi064:> grep smithi046 /etc/hosts 2024-02-20T07:31:17.847 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2024-02-20T07:31:17.847 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064 2024-02-20T07:31:17.987 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi046/smithi064/g' /etc/hosts 2024-02-20T07:31:18.026 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/172.21.15.46/172.21.15.64/g' /etc/hosts 2024-02-20T07:31:18.098 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi046/smithi064/g' /etc/hostname 2024-02-20T07:31:18.170 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064 2024-02-20T07:31:18.240 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release 2024-02-20T07:31:18.295 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="CentOS Stream" 2024-02-20T07:31:18.295 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="9" 2024-02-20T07:31:18.295 INFO:teuthology.orchestra.run.smithi064.stdout:ID="centos" 2024-02-20T07:31:18.295 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="rhel fedora" 2024-02-20T07:31:18.295 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="9" 2024-02-20T07:31:18.295 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el9" 2024-02-20T07:31:18.295 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-20T07:31:18.296 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31" 2024-02-20T07:31:18.296 INFO:teuthology.orchestra.run.smithi064.stdout:LOGO="fedora-logo-icon" 2024-02-20T07:31:18.296 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-20T07:31:18.296 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://centos.org/" 2024-02-20T07:31:18.296 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-20T07:31:18.296 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-20T07:31:18.296 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-20T07:31:18.296 INFO:teuthology.provision.fog.smithi064:Deploy complete! 2024-02-20T07:31:18.297 DEBUG:teuthology.parallel:result is None 2024-02-20T07:31:18.502 INFO:teuthology.lock.ops:Checking smithi064.front.sepia.ceph.com 2024-02-20T07:31:18.503 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-20T07:31:18.527 INFO:teuthology.lock.ops:Checking smithi071.front.sepia.ceph.com 2024-02-20T07:31:18.527 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-20T07:31:18.545 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: set os type and version on server 2024-02-20T07:31:18.545 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2024-02-20T07:31:18.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:31:18.646 DEBUG:teuthology.orchestra.run.smithi064:> true 2024-02-20T07:31:18.714 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi064.front.sepia.ceph.com' 2024-02-20T07:31:18.715 DEBUG:teuthology.orchestra.run.smithi064:> uname -m 2024-02-20T07:31:18.769 INFO:teuthology.orchestra.run.smithi064.stdout:x86_64 2024-02-20T07:31:18.769 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release 2024-02-20T07:31:18.824 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="CentOS Stream" 2024-02-20T07:31:18.824 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="9" 2024-02-20T07:31:18.824 INFO:teuthology.orchestra.run.smithi064.stdout:ID="centos" 2024-02-20T07:31:18.824 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="rhel fedora" 2024-02-20T07:31:18.824 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="9" 2024-02-20T07:31:18.824 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el9" 2024-02-20T07:31:18.824 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-20T07:31:18.824 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31" 2024-02-20T07:31:18.824 INFO:teuthology.orchestra.run.smithi064.stdout:LOGO="fedora-logo-icon" 2024-02-20T07:31:18.825 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-20T07:31:18.825 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://centos.org/" 2024-02-20T07:31:18.825 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-20T07:31:18.825 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-20T07:31:18.825 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-20T07:31:18.825 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2024-02-20T07:31:18.844 INFO:teuthology.lock.ops:Updating [smithi071.front.sepia.ceph.com]: set os type and version on server 2024-02-20T07:31:18.844 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-02-20T07:31:18.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:31:18.936 DEBUG:teuthology.orchestra.run.smithi071:> true 2024-02-20T07:31:19.106 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-02-20T07:31:19.106 DEBUG:teuthology.orchestra.run.smithi071:> uname -m 2024-02-20T07:31:19.161 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64 2024-02-20T07:31:19.161 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2024-02-20T07:31:19.215 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="CentOS Stream" 2024-02-20T07:31:19.215 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="9" 2024-02-20T07:31:19.215 INFO:teuthology.orchestra.run.smithi071.stdout:ID="centos" 2024-02-20T07:31:19.216 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="rhel fedora" 2024-02-20T07:31:19.216 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="9" 2024-02-20T07:31:19.216 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el9" 2024-02-20T07:31:19.216 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-20T07:31:19.216 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2024-02-20T07:31:19.216 INFO:teuthology.orchestra.run.smithi071.stdout:LOGO="fedora-logo-icon" 2024-02-20T07:31:19.216 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-20T07:31:19.216 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://centos.org/" 2024-02-20T07:31:19.216 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-20T07:31:19.216 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-20T07:31:19.216 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-20T07:31:19.217 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2024-02-20T07:31:19.245 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:31:19.350 INFO:teuthology.dispatcher.supervisor:Running job 7568527 2024-02-20T07:31:19.350 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi/7568527 --name pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi --description fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 0a 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi/7568527/orig.config.yaml 2024-02-20T07:31:19.354 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi/7568527 2024-02-20T07:31:19.354 INFO:teuthology.dispatcher.supervisor:Job PID: 2906764 2024-02-20T07:31:19.355 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-20T07:33:19.453 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:35:19.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:37:19.796 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:39:19.972 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:41:20.149 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:43:20.320 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:45:20.490 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:47:20.649 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:49:20.828 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:51:21.001 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:53:21.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:55:21.342 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:57:21.506 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:59:21.681 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:01:21.857 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:03:22.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:05:22.198 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:07:22.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:09:22.533 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:11:22.730 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:13:22.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:15:23.045 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:17:23.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:19:23.368 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:21:23.545 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:23:23.696 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:25:23.864 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:27:24.034 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:29:24.209 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:31:24.374 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:33:24.541 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:35:24.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:37:24.804 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:39:24.962 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:41:25.126 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:43:25.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:45:25.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:47:25.630 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:49:25.805 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:51:25.977 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:53:26.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:55:26.306 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:55:26.382 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1