2024-02-20T08:18:46.770 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-20T08:18:46.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:18:46.917 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f40e76c6c10>, signals=[15]) 2024-02-20T08:18:46.918 INFO:teuthology.lock.ops:Start node 'smithi082.front.sepia.ceph.com' reimaging 2024-02-20T08:18:46.918 INFO:teuthology.lock.ops:Updating [smithi082.front.sepia.ceph.com]: reset os type and version on server 2024-02-20T08:18:46.918 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2024-02-20T08:18:46.946 INFO:teuthology.lock.ops:Start node 'smithi097.front.sepia.ceph.com' reimaging 2024-02-20T08:18:46.947 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: reset os type and version on server 2024-02-20T08:18:46.947 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server 2024-02-20T08:18:47.079 DEBUG:teuthology.provision.fog.smithi082:Requesting image smithi_centos_9.stream (ID 10) 2024-02-20T08:18:47.082 DEBUG:teuthology.provision.fog.smithi097:Requesting image smithi_centos_9.stream (ID 10) 2024-02-20T08:18:47.126 INFO:teuthology.provision.fog.smithi082:Scheduling deploy of centos 9.stream 2024-02-20T08:18:47.129 INFO:teuthology.provision.fog.smithi097:Scheduling deploy of centos 9.stream 2024-02-20T08:18:47.348 INFO:teuthology.orchestra.console.smithi082:Power off 2024-02-20T08:18:47.349 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-20T08:18:47.371 DEBUG:teuthology.orchestra.console.smithi082:power off output: Chassis Power Control: Down/Off 2024-02-20T08:18:47.372 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T08:18:47.385 INFO:teuthology.orchestra.console.smithi097:Power off 2024-02-20T08:18:47.385 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-20T08:18:47.392 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2024-02-20T08:18:47.405 DEBUG:teuthology.orchestra.console.smithi097:power off output: Chassis Power Control: Down/Off 2024-02-20T08:18:47.405 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T08:18:47.435 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on 2024-02-20T08:18:51.396 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T08:18:51.437 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T08:18:51.508 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2024-02-20T08:18:51.547 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on 2024-02-20T08:18:55.513 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T08:18:55.548 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T08:18:55.625 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is off 2024-02-20T08:18:55.659 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on 2024-02-20T08:18:55.727 INFO:teuthology.orchestra.console.smithi082:Power off completed 2024-02-20T08:18:55.828 INFO:teuthology.orchestra.console.smithi082:Power on 2024-02-20T08:18:55.828 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-20T08:18:55.851 DEBUG:teuthology.orchestra.console.smithi082:power on output: Chassis Power Control: Up/On 2024-02-20T08:18:55.851 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T08:18:55.875 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is off 2024-02-20T08:18:59.663 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T08:18:59.772 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off 2024-02-20T08:18:59.873 INFO:teuthology.orchestra.console.smithi097:Power off completed 2024-02-20T08:18:59.876 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T08:18:59.974 INFO:teuthology.orchestra.console.smithi097:Power on 2024-02-20T08:18:59.974 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-20T08:18:59.985 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is off 2024-02-20T08:18:59.998 DEBUG:teuthology.orchestra.console.smithi097:power on output: Chassis Power Control: Up/On 2024-02-20T08:18:59.998 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T08:19:00.020 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off 2024-02-20T08:19:03.988 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T08:19:04.022 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T08:19:04.098 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2024-02-20T08:19:04.131 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on 2024-02-20T08:19:04.199 INFO:teuthology.orchestra.console.smithi082:Power on completed 2024-02-20T08:19:04.232 INFO:teuthology.orchestra.console.smithi097:Power on completed 2024-02-20T08:19:04.300 INFO:teuthology.provision.fog.smithi082:Waiting for deploy to finish 2024-02-20T08:19:04.333 INFO:teuthology.provision.fog.smithi097:Waiting for deploy to finish 2024-02-20T08:21:35.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T08:21:35.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T08:21:38.141 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2024-02-20T08:21:38.141 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-02-20T08:21:44.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T08:21:44.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T08:21:47.228 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2024-02-20T08:21:47.228 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-02-20T08:21:53.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T08:21:53.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T08:21:56.288 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2024-02-20T08:21:56.288 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-02-20T08:22:02.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T08:22:02.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T08:22:05.340 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2024-02-20T08:22:05.376 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-02-20T08:22:11.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T08:22:11.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T08:22:14.396 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2024-02-20T08:22:14.428 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-02-20T08:22:20.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T08:22:20.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T08:22:23.484 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-02-20T08:22:23.484 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2024-02-20T08:22:29.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T08:22:29.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T08:22:32.572 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2024-02-20T08:22:38.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T08:23:29.527 WARNING:teuthology.provision.fog.smithi082:timed out 2024-02-20T08:23:35.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T08:23:35.788 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-20T08:23:35.789 DEBUG:teuthology.orchestra.run.smithi082:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-20T08:23:36.109 INFO:teuthology.provision.fog.smithi082:Node is ready 2024-02-20T08:23:36.109 DEBUG:teuthology.orchestra.run.smithi082:> hostname 2024-02-20T08:23:36.123 INFO:teuthology.orchestra.run.smithi082.stdout:smithi082.front.sepia.ceph.com 2024-02-20T08:23:36.124 DEBUG:teuthology.orchestra.run.smithi082:> grep smithi082.front.sepia.ceph.com /etc/hosts 2024-02-20T08:23:36.180 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82 smithi082.front.sepia.ceph.com smithi082 2024-02-20T08:23:36.180 DEBUG:teuthology.orchestra.run.smithi082:> sudo hostname smithi082 2024-02-20T08:23:36.285 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i -e 's/smithi082.front.sepia.ceph.com/smithi082/g' /etc/hosts 2024-02-20T08:23:36.313 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i -e 's/172.21.15.82/172.21.15.82/g' /etc/hosts 2024-02-20T08:23:36.381 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i -e 's/smithi082.front.sepia.ceph.com/smithi082/g' /etc/hostname 2024-02-20T08:23:36.448 DEBUG:teuthology.orchestra.run.smithi082:> sudo hostname smithi082 2024-02-20T08:23:36.514 DEBUG:teuthology.orchestra.run.smithi082:> cat /etc/os-release 2024-02-20T08:23:36.568 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="CentOS Stream" 2024-02-20T08:23:36.569 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="9" 2024-02-20T08:23:36.569 INFO:teuthology.orchestra.run.smithi082.stdout:ID="centos" 2024-02-20T08:23:36.569 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE="rhel fedora" 2024-02-20T08:23:36.569 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="9" 2024-02-20T08:23:36.569 INFO:teuthology.orchestra.run.smithi082.stdout:PLATFORM_ID="platform:el9" 2024-02-20T08:23:36.569 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-20T08:23:36.569 INFO:teuthology.orchestra.run.smithi082.stdout:ANSI_COLOR="0;31" 2024-02-20T08:23:36.570 INFO:teuthology.orchestra.run.smithi082.stdout:LOGO="fedora-logo-icon" 2024-02-20T08:23:36.570 INFO:teuthology.orchestra.run.smithi082.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-20T08:23:36.570 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://centos.org/" 2024-02-20T08:23:36.570 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-20T08:23:36.570 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-20T08:23:36.570 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-20T08:23:36.570 INFO:teuthology.provision.fog.smithi082:Deploy complete! 2024-02-20T08:23:36.587 DEBUG:teuthology.parallel:result is None 2024-02-20T08:23:38.580 WARNING:teuthology.provision.fog.smithi097:timed out 2024-02-20T08:23:44.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T08:23:44.825 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-20T08:23:44.826 DEBUG:teuthology.orchestra.run.smithi097:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-20T08:23:45.149 INFO:teuthology.provision.fog.smithi097:Node is ready 2024-02-20T08:23:45.149 DEBUG:teuthology.orchestra.run.smithi097:> hostname 2024-02-20T08:23:45.164 INFO:teuthology.orchestra.run.smithi097.stdout:smithi097.front.sepia.ceph.com 2024-02-20T08:23:45.164 DEBUG:teuthology.orchestra.run.smithi097:> grep smithi097.front.sepia.ceph.com /etc/hosts 2024-02-20T08:23:45.220 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.15.97 smithi097.front.sepia.ceph.com smithi097 2024-02-20T08:23:45.220 DEBUG:teuthology.orchestra.run.smithi097:> sudo hostname smithi097 2024-02-20T08:23:45.329 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/smithi097.front.sepia.ceph.com/smithi097/g' /etc/hosts 2024-02-20T08:23:45.357 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/172.21.15.97/172.21.15.97/g' /etc/hosts 2024-02-20T08:23:45.425 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/smithi097.front.sepia.ceph.com/smithi097/g' /etc/hostname 2024-02-20T08:23:45.492 DEBUG:teuthology.orchestra.run.smithi097:> sudo hostname smithi097 2024-02-20T08:23:45.558 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release 2024-02-20T08:23:45.612 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="CentOS Stream" 2024-02-20T08:23:45.612 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="9" 2024-02-20T08:23:45.612 INFO:teuthology.orchestra.run.smithi097.stdout:ID="centos" 2024-02-20T08:23:45.612 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE="rhel fedora" 2024-02-20T08:23:45.612 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="9" 2024-02-20T08:23:45.613 INFO:teuthology.orchestra.run.smithi097.stdout:PLATFORM_ID="platform:el9" 2024-02-20T08:23:45.613 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-20T08:23:45.613 INFO:teuthology.orchestra.run.smithi097.stdout:ANSI_COLOR="0;31" 2024-02-20T08:23:45.613 INFO:teuthology.orchestra.run.smithi097.stdout:LOGO="fedora-logo-icon" 2024-02-20T08:23:45.613 INFO:teuthology.orchestra.run.smithi097.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-20T08:23:45.613 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://centos.org/" 2024-02-20T08:23:45.613 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-20T08:23:45.613 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-20T08:23:45.613 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-20T08:23:45.613 INFO:teuthology.provision.fog.smithi097:Deploy complete! 2024-02-20T08:23:45.614 DEBUG:teuthology.parallel:result is None 2024-02-20T08:23:45.811 INFO:teuthology.lock.ops:Checking smithi082.front.sepia.ceph.com 2024-02-20T08:23:45.811 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-20T08:23:45.838 INFO:teuthology.lock.ops:Checking smithi097.front.sepia.ceph.com 2024-02-20T08:23:45.838 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-20T08:23:45.855 INFO:teuthology.lock.ops:Updating [smithi082.front.sepia.ceph.com]: set os type and version on server 2024-02-20T08:23:45.856 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-02-20T08:23:45.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T08:23:45.941 DEBUG:teuthology.orchestra.run.smithi082:> true 2024-02-20T08:23:46.012 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-02-20T08:23:46.012 DEBUG:teuthology.orchestra.run.smithi082:> uname -m 2024-02-20T08:23:46.066 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64 2024-02-20T08:23:46.066 DEBUG:teuthology.orchestra.run.smithi082:> cat /etc/os-release 2024-02-20T08:23:46.121 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="CentOS Stream" 2024-02-20T08:23:46.121 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="9" 2024-02-20T08:23:46.121 INFO:teuthology.orchestra.run.smithi082.stdout:ID="centos" 2024-02-20T08:23:46.121 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE="rhel fedora" 2024-02-20T08:23:46.121 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="9" 2024-02-20T08:23:46.121 INFO:teuthology.orchestra.run.smithi082.stdout:PLATFORM_ID="platform:el9" 2024-02-20T08:23:46.121 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-20T08:23:46.121 INFO:teuthology.orchestra.run.smithi082.stdout:ANSI_COLOR="0;31" 2024-02-20T08:23:46.121 INFO:teuthology.orchestra.run.smithi082.stdout:LOGO="fedora-logo-icon" 2024-02-20T08:23:46.121 INFO:teuthology.orchestra.run.smithi082.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-20T08:23:46.121 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://centos.org/" 2024-02-20T08:23:46.121 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-20T08:23:46.121 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-20T08:23:46.121 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-20T08:23:46.122 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2024-02-20T08:23:46.146 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: set os type and version on server 2024-02-20T08:23:46.146 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-02-20T08:23:46.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T08:23:46.229 DEBUG:teuthology.orchestra.run.smithi097:> true 2024-02-20T08:23:46.293 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-02-20T08:23:46.294 DEBUG:teuthology.orchestra.run.smithi097:> uname -m 2024-02-20T08:23:46.348 INFO:teuthology.orchestra.run.smithi097.stdout:x86_64 2024-02-20T08:23:46.348 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release 2024-02-20T08:23:46.401 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="CentOS Stream" 2024-02-20T08:23:46.402 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="9" 2024-02-20T08:23:46.402 INFO:teuthology.orchestra.run.smithi097.stdout:ID="centos" 2024-02-20T08:23:46.402 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE="rhel fedora" 2024-02-20T08:23:46.402 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="9" 2024-02-20T08:23:46.402 INFO:teuthology.orchestra.run.smithi097.stdout:PLATFORM_ID="platform:el9" 2024-02-20T08:23:46.402 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-20T08:23:46.402 INFO:teuthology.orchestra.run.smithi097.stdout:ANSI_COLOR="0;31" 2024-02-20T08:23:46.402 INFO:teuthology.orchestra.run.smithi097.stdout:LOGO="fedora-logo-icon" 2024-02-20T08:23:46.402 INFO:teuthology.orchestra.run.smithi097.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-20T08:23:46.402 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://centos.org/" 2024-02-20T08:23:46.402 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-20T08:23:46.402 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-20T08:23:46.402 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-20T08:23:46.403 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server 2024-02-20T08:23:46.422 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:23:46.514 INFO:teuthology.dispatcher.supervisor:Running job 7568584 2024-02-20T08:23:46.515 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi/7568584 --name pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi --description fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{reef} 0a 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi/7568584/orig.config.yaml 2024-02-20T08:23:46.518 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi/7568584 2024-02-20T08:23:46.518 INFO:teuthology.dispatcher.supervisor:Job PID: 3153875 2024-02-20T08:23:46.518 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-20T08:25:46.605 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:27:46.789 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:29:46.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:31:47.130 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:33:47.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:35:47.466 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:37:47.614 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:39:47.777 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:41:47.942 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:43:48.122 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:45:48.292 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:47:48.441 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:49:48.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:51:48.784 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:53:48.969 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:55:49.136 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:57:49.321 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:59:49.501 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:01:49.678 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:03:49.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:05:50.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:07:50.194 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:09:50.373 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:11:50.553 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:13:50.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:15:50.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:17:51.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:19:51.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:21:51.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:23:51.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:25:51.693 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:27:51.869 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:29:52.037 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:31:52.217 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:33:52.385 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:35:52.556 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:37:52.729 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:39:52.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:41:53.196 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:43:53.373 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:45:53.550 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:47:53.693 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:49:53.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:51:54.033 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:53:54.208 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:55:54.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:57:54.550 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:59:54.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T10:01:54.885 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T10:03:55.077 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T10:05:55.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T10:07:55.436 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T10:09:55.601 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T10:11:55.772 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T10:13:55.945 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T10:15:56.118 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T10:17:56.284 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T10:19:56.460 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T10:21:56.638 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T10:23:56.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T10:25:57.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T10:27:57.198 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T10:29:57.381 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T10:31:57.553 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T10:33:57.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T10:35:57.905 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T10:37:58.088 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T10:39:58.260 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T10:41:58.437 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T10:43:58.600 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T10:45:58.770 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T10:47:58.944 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T10:49:59.114 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T10:51:59.280 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T10:53:59.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T10:55:59.748 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T10:58:00.198 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T11:00:00.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T11:02:00.595 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T11:04:00.757 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T11:06:00.965 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T11:08:01.189 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T11:10:01.370 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T11:10:01.463 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1