2024-02-20T07:29:55.458 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55
2024-02-20T07:29:55.458 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T07:29:55.608 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f1542619f10>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f15434bac10>, signals=[15])
2024-02-20T07:29:55.609 INFO:teuthology.lock.ops:Start node 'smithi052.front.sepia.ceph.com' reimaging
2024-02-20T07:29:55.609 INFO:teuthology.lock.ops:Updating [smithi052.front.sepia.ceph.com]: reset os type and version on server
2024-02-20T07:29:55.609 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server
2024-02-20T07:29:55.645 INFO:teuthology.lock.ops:Start node 'smithi170.front.sepia.ceph.com' reimaging
2024-02-20T07:29:55.645 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: reset os type and version on server
2024-02-20T07:29:55.645 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server
2024-02-20T07:29:55.787 DEBUG:teuthology.provision.fog.smithi052:Requesting image smithi_centos_9.stream (ID 10)
2024-02-20T07:29:55.792 DEBUG:teuthology.provision.fog.smithi170:Requesting image smithi_centos_9.stream (ID 10)
2024-02-20T07:29:55.827 INFO:teuthology.provision.fog.smithi052:Scheduling deploy of centos 9.stream
2024-02-20T07:29:55.831 INFO:teuthology.provision.fog.smithi170:Scheduling deploy of centos 9.stream
2024-02-20T07:29:56.099 INFO:teuthology.orchestra.console.smithi170:Power off
2024-02-20T07:29:56.099 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-20T07:29:56.113 INFO:teuthology.orchestra.console.smithi052:Power off
2024-02-20T07:29:56.113 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-20T07:29:56.126 DEBUG:teuthology.orchestra.console.smithi170:power off output: Chassis Power Control: Down/Off
2024-02-20T07:29:56.126 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T07:29:56.138 DEBUG:teuthology.orchestra.console.smithi052:power off output: Chassis Power Control: Down/Off
2024-02-20T07:29:56.138 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T07:29:56.149 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on
2024-02-20T07:29:56.162 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on
2024-02-20T07:30:00.152 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T07:30:00.163 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T07:30:00.261 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on
2024-02-20T07:30:00.271 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on
2024-02-20T07:30:04.264 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T07:30:04.272 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T07:30:04.373 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off
2024-02-20T07:30:04.381 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off
2024-02-20T07:30:04.474 INFO:teuthology.orchestra.console.smithi170:Power off completed
2024-02-20T07:30:04.482 INFO:teuthology.orchestra.console.smithi052:Power off completed
2024-02-20T07:30:04.575 INFO:teuthology.orchestra.console.smithi170:Power on
2024-02-20T07:30:04.575 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-20T07:30:04.583 INFO:teuthology.orchestra.console.smithi052:Power on
2024-02-20T07:30:04.583 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-20T07:30:04.598 DEBUG:teuthology.orchestra.console.smithi170:power on output: Chassis Power Control: Up/On
2024-02-20T07:30:04.598 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T07:30:04.607 DEBUG:teuthology.orchestra.console.smithi052:power on output: Chassis Power Control: Up/On
2024-02-20T07:30:04.607 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T07:30:04.619 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off
2024-02-20T07:30:04.628 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off
2024-02-20T07:30:08.621 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T07:30:08.629 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T07:30:08.731 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off
2024-02-20T07:30:08.737 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off
2024-02-20T07:30:12.736 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T07:30:12.745 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T07:30:12.848 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on
2024-02-20T07:30:12.855 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on
2024-02-20T07:30:12.949 INFO:teuthology.orchestra.console.smithi170:Power on completed
2024-02-20T07:30:12.956 INFO:teuthology.orchestra.console.smithi052:Power on completed
2024-02-20T07:30:13.050 INFO:teuthology.provision.fog.smithi170:Waiting for deploy to finish
2024-02-20T07:30:13.057 INFO:teuthology.provision.fog.smithi052:Waiting for deploy to finish
2024-02-20T07:32:44.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T07:32:44.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T07:32:47.132 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170
2024-02-20T07:32:47.136 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52
2024-02-20T07:32:53.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T07:32:53.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T07:32:56.188 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170
2024-02-20T07:32:56.188 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52
2024-02-20T07:33:02.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T07:33:02.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T07:33:05.244 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52
2024-02-20T07:33:05.244 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170
2024-02-20T07:33:11.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T07:33:11.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T07:33:14.300 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52
2024-02-20T07:33:14.332 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170
2024-02-20T07:33:20.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T07:33:20.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T07:33:23.356 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52
2024-02-20T07:33:23.388 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170
2024-02-20T07:33:29.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T07:33:29.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T07:33:32.448 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170
2024-02-20T07:33:38.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T07:34:29.413 WARNING:teuthology.provision.fog.smithi052:timed out
2024-02-20T07:34:35.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T07:34:35.720 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-20T07:34:35.721 DEBUG:teuthology.orchestra.run.smithi052:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-20T07:34:36.034 INFO:teuthology.provision.fog.smithi052:Node is ready
2024-02-20T07:34:36.035 DEBUG:teuthology.orchestra.run.smithi052:> hostname
2024-02-20T07:34:36.049 INFO:teuthology.orchestra.run.smithi052.stdout:smithi052.front.sepia.ceph.com
2024-02-20T07:34:36.050 DEBUG:teuthology.orchestra.run.smithi052:> grep smithi052.front.sepia.ceph.com /etc/hosts
2024-02-20T07:34:36.109 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52 smithi052.front.sepia.ceph.com smithi052
2024-02-20T07:34:36.110 DEBUG:teuthology.orchestra.run.smithi052:> sudo hostname smithi052
2024-02-20T07:34:36.217 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/smithi052.front.sepia.ceph.com/smithi052/g' /etc/hosts
2024-02-20T07:34:36.248 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/172.21.15.52/172.21.15.52/g' /etc/hosts
2024-02-20T07:34:36.319 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/smithi052.front.sepia.ceph.com/smithi052/g' /etc/hostname
2024-02-20T07:34:36.391 DEBUG:teuthology.orchestra.run.smithi052:> sudo hostname smithi052
2024-02-20T07:34:36.462 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release
2024-02-20T07:34:36.516 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="CentOS Stream"
2024-02-20T07:34:36.517 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="9"
2024-02-20T07:34:36.517 INFO:teuthology.orchestra.run.smithi052.stdout:ID="centos"
2024-02-20T07:34:36.517 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="rhel fedora"
2024-02-20T07:34:36.517 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="9"
2024-02-20T07:34:36.517 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el9"
2024-02-20T07:34:36.517 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-20T07:34:36.517 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31"
2024-02-20T07:34:36.517 INFO:teuthology.orchestra.run.smithi052.stdout:LOGO="fedora-logo-icon"
2024-02-20T07:34:36.517 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-20T07:34:36.517 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://centos.org/"
2024-02-20T07:34:36.517 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-20T07:34:36.517 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-20T07:34:36.518 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-20T07:34:36.518 INFO:teuthology.provision.fog.smithi052:Deploy complete!
2024-02-20T07:34:36.520 DEBUG:teuthology.parallel:result is None
2024-02-20T07:34:38.458 WARNING:teuthology.provision.fog.smithi170:timed out
2024-02-20T07:34:44.465 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T07:34:44.731 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-20T07:34:44.731 DEBUG:teuthology.orchestra.run.smithi170:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-20T07:34:45.036 INFO:teuthology.provision.fog.smithi170:Node is ready
2024-02-20T07:34:45.036 DEBUG:teuthology.orchestra.run.smithi170:> hostname
2024-02-20T07:34:45.051 INFO:teuthology.orchestra.run.smithi170.stdout:smithi170.front.sepia.ceph.com
2024-02-20T07:34:45.051 DEBUG:teuthology.orchestra.run.smithi170:> grep smithi170.front.sepia.ceph.com /etc/hosts
2024-02-20T07:34:45.107 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170 smithi170.front.sepia.ceph.com smithi170
2024-02-20T07:34:45.107 DEBUG:teuthology.orchestra.run.smithi170:> sudo hostname smithi170
2024-02-20T07:34:45.211 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/smithi170.front.sepia.ceph.com/smithi170/g' /etc/hosts
2024-02-20T07:34:45.238 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/172.21.15.170/172.21.15.170/g' /etc/hosts
2024-02-20T07:34:45.306 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/smithi170.front.sepia.ceph.com/smithi170/g' /etc/hostname
2024-02-20T07:34:45.374 DEBUG:teuthology.orchestra.run.smithi170:> sudo hostname smithi170
2024-02-20T07:34:45.439 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release
2024-02-20T07:34:45.494 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="CentOS Stream"
2024-02-20T07:34:45.494 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="9"
2024-02-20T07:34:45.494 INFO:teuthology.orchestra.run.smithi170.stdout:ID="centos"
2024-02-20T07:34:45.494 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="rhel fedora"
2024-02-20T07:34:45.494 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="9"
2024-02-20T07:34:45.494 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el9"
2024-02-20T07:34:45.494 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-20T07:34:45.494 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31"
2024-02-20T07:34:45.494 INFO:teuthology.orchestra.run.smithi170.stdout:LOGO="fedora-logo-icon"
2024-02-20T07:34:45.494 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-20T07:34:45.494 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://centos.org/"
2024-02-20T07:34:45.495 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-20T07:34:45.495 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-20T07:34:45.495 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-20T07:34:45.495 INFO:teuthology.provision.fog.smithi170:Deploy complete!
2024-02-20T07:34:45.496 DEBUG:teuthology.parallel:result is None
2024-02-20T07:34:45.664 INFO:teuthology.lock.ops:Checking smithi052.front.sepia.ceph.com
2024-02-20T07:34:45.665 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-20T07:34:45.690 INFO:teuthology.lock.ops:Checking smithi170.front.sepia.ceph.com
2024-02-20T07:34:45.690 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-20T07:34:45.708 INFO:teuthology.lock.ops:Updating [smithi052.front.sepia.ceph.com]: set os type and version on server
2024-02-20T07:34:45.708 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com'
2024-02-20T07:34:45.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T07:34:45.815 DEBUG:teuthology.orchestra.run.smithi052:> true
2024-02-20T07:34:45.884 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com'
2024-02-20T07:34:45.885 DEBUG:teuthology.orchestra.run.smithi052:> uname -m
2024-02-20T07:34:45.944 INFO:teuthology.orchestra.run.smithi052.stdout:x86_64
2024-02-20T07:34:45.944 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release
2024-02-20T07:34:45.996 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="CentOS Stream"
2024-02-20T07:34:45.997 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="9"
2024-02-20T07:34:45.997 INFO:teuthology.orchestra.run.smithi052.stdout:ID="centos"
2024-02-20T07:34:45.997 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="rhel fedora"
2024-02-20T07:34:45.997 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="9"
2024-02-20T07:34:45.997 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el9"
2024-02-20T07:34:45.997 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-20T07:34:45.997 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31"
2024-02-20T07:34:45.997 INFO:teuthology.orchestra.run.smithi052.stdout:LOGO="fedora-logo-icon"
2024-02-20T07:34:45.997 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-20T07:34:45.997 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://centos.org/"
2024-02-20T07:34:45.997 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-20T07:34:45.997 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-20T07:34:45.997 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-20T07:34:45.998 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server
2024-02-20T07:34:46.015 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: set os type and version on server
2024-02-20T07:34:46.015 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com'
2024-02-20T07:34:46.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T07:34:46.103 DEBUG:teuthology.orchestra.run.smithi170:> true
2024-02-20T07:34:46.170 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi170.front.sepia.ceph.com'
2024-02-20T07:34:46.170 DEBUG:teuthology.orchestra.run.smithi170:> uname -m
2024-02-20T07:34:46.223 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64
2024-02-20T07:34:46.224 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release
2024-02-20T07:34:46.277 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="CentOS Stream"
2024-02-20T07:34:46.278 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="9"
2024-02-20T07:34:46.278 INFO:teuthology.orchestra.run.smithi170.stdout:ID="centos"
2024-02-20T07:34:46.278 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="rhel fedora"
2024-02-20T07:34:46.278 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="9"
2024-02-20T07:34:46.278 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el9"
2024-02-20T07:34:46.278 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-20T07:34:46.278 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31"
2024-02-20T07:34:46.278 INFO:teuthology.orchestra.run.smithi170.stdout:LOGO="fedora-logo-icon"
2024-02-20T07:34:46.278 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-20T07:34:46.278 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://centos.org/"
2024-02-20T07:34:46.278 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-20T07:34:46.279 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-20T07:34:46.279 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-20T07:34:46.279 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server
2024-02-20T07:34:46.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T07:34:46.392 INFO:teuthology.dispatcher.supervisor:Running job 7568535
2024-02-20T07:34:46.392 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi/7568535 --name pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi --description fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{reef} 0a 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi/7568535/orig.config.yaml
2024-02-20T07:34:46.396 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi/7568535
2024-02-20T07:34:46.396 INFO:teuthology.dispatcher.supervisor:Job PID: 2926039
2024-02-20T07:34:46.396 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-02-20T07:36:46.470 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T07:38:46.640 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T07:40:46.800 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T07:42:46.960 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T07:44:47.125 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T07:46:47.298 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T07:48:47.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T07:50:47.645 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T07:52:47.812 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T07:54:47.973 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T07:56:48.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T07:58:48.312 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:00:48.485 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:02:48.661 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:04:48.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:06:48.994 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:08:49.160 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:10:49.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:12:49.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:14:49.649 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:16:49.808 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:18:49.976 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:20:51.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:22:51.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:24:51.649 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:26:51.813 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:28:51.990 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:30:52.162 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:32:52.344 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:34:52.509 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:36:52.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:38:52.881 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:40:53.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:42:53.216 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:44:53.386 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:46:53.556 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:48:53.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:50:53.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:52:54.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:54:54.232 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:56:54.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:58:54.593 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T09:00:54.764 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T09:02:54.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T09:04:55.096 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T09:06:55.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T09:08:55.416 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T09:10:55.584 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T09:12:55.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T09:14:55.820 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T09:16:55.977 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T09:18:56.145 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T09:20:56.318 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T09:22:56.480 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T09:24:56.660 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T09:26:56.825 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T09:28:56.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T09:30:57.173 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T09:32:57.346 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T09:34:57.516 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T09:36:57.688 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T09:38:57.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T09:40:58.036 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T09:42:58.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T09:44:58.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T09:46:58.528 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T09:48:58.700 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T09:50:58.882 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T09:52:59.065 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T09:54:59.205 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T09:56:59.376 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T09:58:59.554 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T10:00:59.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T10:02:59.894 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T10:05:00.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T10:07:00.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T10:09:00.401 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T10:11:00.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T10:13:00.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T10:15:00.918 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T10:17:01.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T10:19:01.260 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T10:21:01.460 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T10:23:01.641 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T10:25:01.813 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T10:25:01.888 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1