2024-02-20T07:32:17.744 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55
2024-02-20T07:32:17.745 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T07:32:17.880 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f51bb68bf40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f51bc52cc10>, signals=[15])
2024-02-20T07:32:17.881 INFO:teuthology.lock.ops:Start node 'smithi163.front.sepia.ceph.com' reimaging
2024-02-20T07:32:17.881 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: reset os type and version on server
2024-02-20T07:32:17.881 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server
2024-02-20T07:32:17.903 INFO:teuthology.lock.ops:Start node 'smithi193.front.sepia.ceph.com' reimaging
2024-02-20T07:32:17.904 INFO:teuthology.lock.ops:Updating [smithi193.front.sepia.ceph.com]: reset os type and version on server
2024-02-20T07:32:17.904 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server
2024-02-20T07:32:18.024 DEBUG:teuthology.provision.fog.smithi163:Requesting image smithi_centos_9.stream (ID 10)
2024-02-20T07:32:18.043 DEBUG:teuthology.provision.fog.smithi193:Requesting image smithi_centos_9.stream (ID 10)
2024-02-20T07:32:18.062 INFO:teuthology.provision.fog.smithi163:Scheduling deploy of centos 9.stream
2024-02-20T07:32:18.086 INFO:teuthology.provision.fog.smithi193:Scheduling deploy of centos 9.stream
2024-02-20T07:32:18.314 INFO:teuthology.orchestra.console.smithi163:Power off
2024-02-20T07:32:18.315 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-20T07:32:18.336 DEBUG:teuthology.orchestra.console.smithi163:power off output: Chassis Power Control: Down/Off
2024-02-20T07:32:18.336 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T07:32:18.354 INFO:teuthology.orchestra.console.smithi193:Power off
2024-02-20T07:32:18.355 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-20T07:32:18.363 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on
2024-02-20T07:32:18.376 DEBUG:teuthology.orchestra.console.smithi193:power off output: Chassis Power Control: Down/Off
2024-02-20T07:32:18.376 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T07:32:18.400 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is on
2024-02-20T07:32:22.368 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T07:32:22.401 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T07:32:22.478 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on
2024-02-20T07:32:22.511 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is on
2024-02-20T07:32:26.480 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T07:32:26.512 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T07:32:26.589 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off
2024-02-20T07:32:26.622 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is off
2024-02-20T07:32:26.691 INFO:teuthology.orchestra.console.smithi163:Power off completed
2024-02-20T07:32:26.723 INFO:teuthology.orchestra.console.smithi193:Power off completed
2024-02-20T07:32:26.792 INFO:teuthology.orchestra.console.smithi163:Power on
2024-02-20T07:32:26.792 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-20T07:32:26.812 DEBUG:teuthology.orchestra.console.smithi163:power on output: Chassis Power Control: Up/On
2024-02-20T07:32:26.813 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T07:32:26.824 INFO:teuthology.orchestra.console.smithi193:Power on
2024-02-20T07:32:26.824 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-20T07:32:26.837 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off
2024-02-20T07:32:26.844 DEBUG:teuthology.orchestra.console.smithi193:power on output: Chassis Power Control: Up/On
2024-02-20T07:32:26.844 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T07:32:26.864 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is off
2024-02-20T07:32:30.842 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T07:32:30.865 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T07:32:30.952 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off
2024-02-20T07:32:30.974 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is off
2024-02-20T07:32:34.956 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T07:32:34.975 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T07:32:35.128 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on
2024-02-20T07:32:35.153 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is on
2024-02-20T07:32:35.229 INFO:teuthology.orchestra.console.smithi163:Power on completed
2024-02-20T07:32:35.254 INFO:teuthology.orchestra.console.smithi193:Power on completed
2024-02-20T07:32:35.330 INFO:teuthology.provision.fog.smithi163:Waiting for deploy to finish
2024-02-20T07:32:35.355 INFO:teuthology.provision.fog.smithi193:Waiting for deploy to finish
2024-02-20T07:35:06.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T07:35:09.372 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193
2024-02-20T07:35:15.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T07:35:18.460 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193
2024-02-20T07:35:24.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T07:35:27.516 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193
2024-02-20T07:35:33.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T07:35:36.445 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T07:35:36.572 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193
2024-02-20T07:35:39.516 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-20T07:35:42.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T07:35:45.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T07:35:45.632 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193
2024-02-20T07:35:48.572 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-20T07:35:51.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T07:35:54.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T07:35:54.716 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193
2024-02-20T07:35:57.628 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-20T07:36:00.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T07:36:03.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T07:36:06.688 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-20T07:36:12.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T07:36:15.772 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-20T07:36:19.264 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193
2024-02-20T07:36:21.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T07:36:24.832 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-20T07:36:25.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T07:36:28.352 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193
2024-02-20T07:36:30.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T07:36:33.920 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-20T07:36:34.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T07:36:37.404 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193
2024-02-20T07:36:39.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T07:36:43.008 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-20T07:36:43.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T07:36:44.052 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-20T07:36:44.053 DEBUG:teuthology.orchestra.run.smithi193:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-20T07:36:49.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T07:36:52.064 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-20T07:36:58.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T07:37:04.407 INFO:teuthology.provision.fog.smithi193:Node is ready
2024-02-20T07:37:04.408 DEBUG:teuthology.orchestra.run.smithi193:> hostname
2024-02-20T07:37:04.468 INFO:teuthology.orchestra.run.smithi193.stdout:smithi193.front.sepia.ceph.com
2024-02-20T07:37:04.469 DEBUG:teuthology.orchestra.run.smithi193:> grep smithi193.front.sepia.ceph.com /etc/hosts
2024-02-20T07:37:04.526 INFO:teuthology.orchestra.run.smithi193.stdout:172.21.15.193 smithi193.front.sepia.ceph.com smithi193
2024-02-20T07:37:04.527 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname smithi193
2024-02-20T07:37:04.649 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/smithi193.front.sepia.ceph.com/smithi193/g' /etc/hosts
2024-02-20T07:37:04.680 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/172.21.15.193/172.21.15.193/g' /etc/hosts
2024-02-20T07:37:04.750 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/smithi193.front.sepia.ceph.com/smithi193/g' /etc/hostname
2024-02-20T07:37:04.820 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname smithi193
2024-02-20T07:37:04.890 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release
2024-02-20T07:37:04.945 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="CentOS Stream"
2024-02-20T07:37:04.945 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="9"
2024-02-20T07:37:04.945 INFO:teuthology.orchestra.run.smithi193.stdout:ID="centos"
2024-02-20T07:37:04.946 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE="rhel fedora"
2024-02-20T07:37:04.946 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="9"
2024-02-20T07:37:04.946 INFO:teuthology.orchestra.run.smithi193.stdout:PLATFORM_ID="platform:el9"
2024-02-20T07:37:04.946 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-20T07:37:04.946 INFO:teuthology.orchestra.run.smithi193.stdout:ANSI_COLOR="0;31"
2024-02-20T07:37:04.946 INFO:teuthology.orchestra.run.smithi193.stdout:LOGO="fedora-logo-icon"
2024-02-20T07:37:04.946 INFO:teuthology.orchestra.run.smithi193.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-20T07:37:04.946 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://centos.org/"
2024-02-20T07:37:04.946 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-20T07:37:04.946 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-20T07:37:04.946 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-20T07:37:04.947 INFO:teuthology.provision.fog.smithi193:Deploy complete!
2024-02-20T07:37:04.948 DEBUG:teuthology.parallel:result is None
2024-02-20T07:37:16.604 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-20T07:37:22.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T07:37:25.692 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-20T07:37:31.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T07:37:34.227 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-20T07:37:34.227 DEBUG:teuthology.orchestra.run.smithi163:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-20T07:37:54.594 INFO:teuthology.provision.fog.smithi163:Node is ready
2024-02-20T07:37:54.853 DEBUG:teuthology.orchestra.run.smithi163:> hostname
2024-02-20T07:37:54.872 INFO:teuthology.orchestra.run.smithi163.stdout:smithi163.front.sepia.ceph.com
2024-02-20T07:37:54.873 DEBUG:teuthology.orchestra.run.smithi163:> grep smithi163.front.sepia.ceph.com /etc/hosts
2024-02-20T07:37:54.930 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163 smithi163.front.sepia.ceph.com smithi163
2024-02-20T07:37:54.931 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname smithi163
2024-02-20T07:37:55.051 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi163.front.sepia.ceph.com/smithi163/g' /etc/hosts
2024-02-20T07:37:55.080 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/172.21.15.163/172.21.15.163/g' /etc/hosts
2024-02-20T07:37:55.147 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi163.front.sepia.ceph.com/smithi163/g' /etc/hostname
2024-02-20T07:37:55.215 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname smithi163
2024-02-20T07:37:55.282 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release
2024-02-20T07:37:55.337 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="CentOS Stream"
2024-02-20T07:37:55.337 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="9"
2024-02-20T07:37:55.337 INFO:teuthology.orchestra.run.smithi163.stdout:ID="centos"
2024-02-20T07:37:55.337 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="rhel fedora"
2024-02-20T07:37:55.337 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="9"
2024-02-20T07:37:55.338 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el9"
2024-02-20T07:37:55.338 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-20T07:37:55.338 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31"
2024-02-20T07:37:55.338 INFO:teuthology.orchestra.run.smithi163.stdout:LOGO="fedora-logo-icon"
2024-02-20T07:37:55.338 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-20T07:37:55.338 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://centos.org/"
2024-02-20T07:37:55.338 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-20T07:37:55.338 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-20T07:37:55.338 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-20T07:37:55.338 INFO:teuthology.provision.fog.smithi163:Deploy complete!
2024-02-20T07:37:55.339 DEBUG:teuthology.parallel:result is None
2024-02-20T07:37:55.508 INFO:teuthology.lock.ops:Checking smithi163.front.sepia.ceph.com
2024-02-20T07:37:55.508 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-20T07:37:55.549 INFO:teuthology.lock.ops:Checking smithi193.front.sepia.ceph.com
2024-02-20T07:37:55.550 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-20T07:37:55.575 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: set os type and version on server
2024-02-20T07:37:55.575 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com'
2024-02-20T07:37:55.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T07:37:55.666 DEBUG:teuthology.orchestra.run.smithi163:> true
2024-02-20T07:37:55.739 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi163.front.sepia.ceph.com'
2024-02-20T07:37:55.739 DEBUG:teuthology.orchestra.run.smithi163:> uname -m
2024-02-20T07:37:55.793 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64
2024-02-20T07:37:55.793 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release
2024-02-20T07:37:55.848 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="CentOS Stream"
2024-02-20T07:37:55.849 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="9"
2024-02-20T07:37:55.849 INFO:teuthology.orchestra.run.smithi163.stdout:ID="centos"
2024-02-20T07:37:55.849 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="rhel fedora"
2024-02-20T07:37:55.849 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="9"
2024-02-20T07:37:55.849 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el9"
2024-02-20T07:37:55.849 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-20T07:37:55.850 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31"
2024-02-20T07:37:55.850 INFO:teuthology.orchestra.run.smithi163.stdout:LOGO="fedora-logo-icon"
2024-02-20T07:37:55.850 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-20T07:37:55.850 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://centos.org/"
2024-02-20T07:37:55.850 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-20T07:37:55.850 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-20T07:37:55.850 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-20T07:37:55.851 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server
2024-02-20T07:37:55.945 INFO:teuthology.lock.ops:Updating [smithi193.front.sepia.ceph.com]: set os type and version on server
2024-02-20T07:37:55.945 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com'
2024-02-20T07:37:55.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T07:37:56.035 DEBUG:teuthology.orchestra.run.smithi193:> true
2024-02-20T07:37:56.202 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi193.front.sepia.ceph.com'
2024-02-20T07:37:56.202 DEBUG:teuthology.orchestra.run.smithi193:> uname -m
2024-02-20T07:37:56.257 INFO:teuthology.orchestra.run.smithi193.stdout:x86_64
2024-02-20T07:37:56.257 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release
2024-02-20T07:37:56.312 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="CentOS Stream"
2024-02-20T07:37:56.312 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="9"
2024-02-20T07:37:56.312 INFO:teuthology.orchestra.run.smithi193.stdout:ID="centos"
2024-02-20T07:37:56.312 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE="rhel fedora"
2024-02-20T07:37:56.312 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="9"
2024-02-20T07:37:56.312 INFO:teuthology.orchestra.run.smithi193.stdout:PLATFORM_ID="platform:el9"
2024-02-20T07:37:56.312 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-20T07:37:56.312 INFO:teuthology.orchestra.run.smithi193.stdout:ANSI_COLOR="0;31"
2024-02-20T07:37:56.312 INFO:teuthology.orchestra.run.smithi193.stdout:LOGO="fedora-logo-icon"
2024-02-20T07:37:56.312 INFO:teuthology.orchestra.run.smithi193.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-20T07:37:56.312 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://centos.org/"
2024-02-20T07:37:56.313 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-20T07:37:56.313 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-20T07:37:56.313 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-20T07:37:56.313 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server
2024-02-20T07:37:56.341 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T07:37:56.435 INFO:teuthology.dispatcher.supervisor:Running job 7568540
2024-02-20T07:37:56.435 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi/7568540 --name pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi --description fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 0a 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi/7568540/orig.config.yaml
2024-02-20T07:37:56.438 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi/7568540
2024-02-20T07:37:56.438 INFO:teuthology.dispatcher.supervisor:Job PID: 2943482
2024-02-20T07:37:56.438 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-02-20T07:39:56.536 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T07:41:56.709 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T07:43:56.885 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T07:45:57.061 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T07:47:57.229 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T07:49:57.414 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T07:51:57.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T07:53:57.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T07:55:57.910 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T07:57:58.077 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T07:59:58.254 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:01:58.428 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:03:58.604 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:05:58.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:07:58.954 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:09:59.125 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:11:59.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:13:59.448 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:15:59.601 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:17:59.765 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:19:59.952 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:22:00.118 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:24:00.277 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:26:00.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:28:00.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:30:00.813 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:32:00.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:34:01.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:36:01.336 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:38:01.500 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:40:01.676 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:42:01.841 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:44:01.990 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:46:02.176 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:48:02.293 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:50:02.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:52:02.637 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:54:02.810 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:56:02.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T08:58:03.150 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T09:00:03.324 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T09:02:03.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T09:04:03.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T09:06:03.841 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T09:08:04.013 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T09:10:04.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T09:12:04.344 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T09:14:04.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T09:16:04.746 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T09:18:04.910 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T09:20:05.093 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T09:20:05.177 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1