2024-02-28T19:14:55.748 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55
2024-02-28T19:14:55.748 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T19:14:55.905 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f26cf718f10>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f26d0779c10>, signals=[15])
2024-02-28T19:14:55.906 INFO:teuthology.lock.ops:Start node 'smithi155.front.sepia.ceph.com' reimaging
2024-02-28T19:14:55.906 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: reset os type and version on server
2024-02-28T19:14:55.906 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server
2024-02-28T19:14:55.930 INFO:teuthology.lock.ops:Start node 'smithi163.front.sepia.ceph.com' reimaging
2024-02-28T19:14:55.930 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: reset os type and version on server
2024-02-28T19:14:55.930 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server
2024-02-28T19:14:56.060 DEBUG:teuthology.provision.fog.smithi155:Requesting image smithi_centos_8.stream (ID 3)
2024-02-28T19:14:56.063 DEBUG:teuthology.provision.fog.smithi163:Requesting image smithi_centos_8.stream (ID 3)
2024-02-28T19:14:56.112 INFO:teuthology.provision.fog.smithi155:Scheduling deploy of centos 8.stream
2024-02-28T19:14:56.116 INFO:teuthology.provision.fog.smithi163:Scheduling deploy of centos 8.stream
2024-02-28T19:14:56.387 INFO:teuthology.orchestra.console.smithi155:Power off
2024-02-28T19:14:56.387 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-28T19:14:56.401 INFO:teuthology.orchestra.console.smithi163:Power off
2024-02-28T19:14:56.402 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-28T19:14:56.412 DEBUG:teuthology.orchestra.console.smithi155:power off output: Chassis Power Control: Down/Off
2024-02-28T19:14:56.412 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T19:14:56.425 DEBUG:teuthology.orchestra.console.smithi163:power off output: Chassis Power Control: Down/Off
2024-02-28T19:14:56.426 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T19:14:56.434 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on
2024-02-28T19:14:56.447 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on
2024-02-28T19:15:00.439 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T19:15:00.448 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T19:15:00.548 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on
2024-02-28T19:15:00.557 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on
2024-02-28T19:15:04.552 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T19:15:04.559 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T19:15:04.661 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off
2024-02-28T19:15:04.667 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on
2024-02-28T19:15:04.762 INFO:teuthology.orchestra.console.smithi155:Power off completed
2024-02-28T19:15:04.863 INFO:teuthology.orchestra.console.smithi155:Power on
2024-02-28T19:15:04.863 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-28T19:15:04.884 DEBUG:teuthology.orchestra.console.smithi155:power on output: Chassis Power Control: Up/On
2024-02-28T19:15:04.884 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T19:15:04.909 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off
2024-02-28T19:15:08.672 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T19:15:08.784 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off
2024-02-28T19:15:08.885 INFO:teuthology.orchestra.console.smithi163:Power off completed
2024-02-28T19:15:08.910 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T19:15:08.987 INFO:teuthology.orchestra.console.smithi163:Power on
2024-02-28T19:15:08.987 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-28T19:15:09.009 DEBUG:teuthology.orchestra.console.smithi163:power on output: Chassis Power Control: Up/On
2024-02-28T19:15:09.009 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T19:15:09.019 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off
2024-02-28T19:15:09.032 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off
2024-02-28T19:15:13.023 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T19:15:13.033 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T19:15:13.133 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on
2024-02-28T19:15:13.142 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off
2024-02-28T19:15:13.234 INFO:teuthology.orchestra.console.smithi155:Power on completed
2024-02-28T19:15:13.335 INFO:teuthology.provision.fog.smithi155:Waiting for deploy to finish
2024-02-28T19:15:17.145 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T19:15:17.254 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on
2024-02-28T19:15:17.355 INFO:teuthology.orchestra.console.smithi163:Power on completed
2024-02-28T19:15:17.456 INFO:teuthology.provision.fog.smithi163:Waiting for deploy to finish
2024-02-28T19:17:59.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T19:18:02.492 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155
2024-02-28T19:18:08.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T19:18:11.580 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155
2024-02-28T19:18:17.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T19:18:18.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T19:18:20.636 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155
2024-02-28T19:18:21.596 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-28T19:18:26.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T19:18:27.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T19:18:29.692 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155
2024-02-28T19:18:30.655 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-28T19:18:35.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T19:18:36.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T19:18:38.748 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155
2024-02-28T19:18:39.708 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-28T19:18:44.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T19:18:45.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T19:18:47.804 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155
2024-02-28T19:18:48.764 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-28T19:18:53.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T19:18:54.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T19:18:56.895 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155
2024-02-28T19:18:57.820 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-28T19:19:02.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T19:19:03.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T19:19:05.980 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155
2024-02-28T19:19:06.876 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-28T19:19:11.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T19:19:12.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T19:19:15.932 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-28T19:19:18.076 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155
2024-02-28T19:19:21.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T19:19:24.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T19:19:24.988 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-28T19:19:27.164 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155
2024-02-28T19:19:30.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T19:19:33.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T19:19:34.044 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-28T19:19:36.220 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155
2024-02-28T19:19:40.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T19:19:42.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T19:19:42.893 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-28T19:19:42.894 DEBUG:teuthology.orchestra.run.smithi155:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-28T19:19:43.100 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-28T19:19:49.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T19:20:08.571 INFO:teuthology.provision.fog.smithi155:Node is ready
2024-02-28T19:20:08.572 DEBUG:teuthology.orchestra.run.smithi155:> hostname
2024-02-28T19:20:08.596 INFO:teuthology.orchestra.run.smithi155.stdout:smithi155.front.sepia.ceph.com
2024-02-28T19:20:08.597 DEBUG:teuthology.orchestra.run.smithi155:> grep smithi155.front.sepia.ceph.com /etc/hosts
2024-02-28T19:20:08.658 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155 smithi155.front.sepia.ceph.com smithi155
2024-02-28T19:20:08.658 DEBUG:teuthology.orchestra.run.smithi155:> sudo hostname smithi155
2024-02-28T19:20:08.771 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/smithi155.front.sepia.ceph.com/smithi155/g' /etc/hosts
2024-02-28T19:20:08.802 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/172.21.15.155/172.21.15.155/g' /etc/hosts
2024-02-28T19:20:08.871 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/smithi155.front.sepia.ceph.com/smithi155/g' /etc/hostname
2024-02-28T19:20:08.941 DEBUG:teuthology.orchestra.run.smithi155:> sudo hostname smithi155
2024-02-28T19:20:09.008 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release
2024-02-28T19:20:09.065 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="CentOS Stream"
2024-02-28T19:20:09.066 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="8"
2024-02-28T19:20:09.066 INFO:teuthology.orchestra.run.smithi155.stdout:ID="centos"
2024-02-28T19:20:09.066 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="rhel fedora"
2024-02-28T19:20:09.066 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="8"
2024-02-28T19:20:09.066 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el8"
2024-02-28T19:20:09.066 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="CentOS Stream 8"
2024-02-28T19:20:09.066 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31"
2024-02-28T19:20:09.066 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-02-28T19:20:09.066 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://centos.org/"
2024-02-28T19:20:09.066 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-28T19:20:09.066 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-28T19:20:09.066 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-28T19:20:09.067 INFO:teuthology.provision.fog.smithi155:Deploy complete!
2024-02-28T19:20:09.069 DEBUG:teuthology.parallel:result is None
2024-02-28T19:20:49.145 WARNING:teuthology.provision.fog.smithi163:timed out
2024-02-28T19:20:55.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T19:20:55.408 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-28T19:20:55.409 DEBUG:teuthology.orchestra.run.smithi163:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-28T19:20:55.653 INFO:teuthology.provision.fog.smithi163:Node is ready
2024-02-28T19:20:55.653 DEBUG:teuthology.orchestra.run.smithi163:> hostname
2024-02-28T19:20:55.672 INFO:teuthology.orchestra.run.smithi163.stdout:smithi163.front.sepia.ceph.com
2024-02-28T19:20:55.672 DEBUG:teuthology.orchestra.run.smithi163:> grep smithi163.front.sepia.ceph.com /etc/hosts
2024-02-28T19:20:55.731 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163 smithi163.front.sepia.ceph.com smithi163
2024-02-28T19:20:55.732 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname smithi163
2024-02-28T19:20:55.831 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi163.front.sepia.ceph.com/smithi163/g' /etc/hosts
2024-02-28T19:20:55.860 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/172.21.15.163/172.21.15.163/g' /etc/hosts
2024-02-28T19:20:55.929 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi163.front.sepia.ceph.com/smithi163/g' /etc/hostname
2024-02-28T19:20:55.997 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname smithi163
2024-02-28T19:20:56.064 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release
2024-02-28T19:20:56.122 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="CentOS Stream"
2024-02-28T19:20:56.122 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="8"
2024-02-28T19:20:56.122 INFO:teuthology.orchestra.run.smithi163.stdout:ID="centos"
2024-02-28T19:20:56.122 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="rhel fedora"
2024-02-28T19:20:56.122 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="8"
2024-02-28T19:20:56.122 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el8"
2024-02-28T19:20:56.122 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="CentOS Stream 8"
2024-02-28T19:20:56.122 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31"
2024-02-28T19:20:56.122 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-02-28T19:20:56.122 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://centos.org/"
2024-02-28T19:20:56.123 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-28T19:20:56.123 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-28T19:20:56.123 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-28T19:20:56.123 INFO:teuthology.provision.fog.smithi163:Deploy complete!
2024-02-28T19:20:56.124 DEBUG:teuthology.parallel:result is None
2024-02-28T19:20:56.277 INFO:teuthology.lock.ops:Checking smithi155.front.sepia.ceph.com
2024-02-28T19:20:56.278 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-28T19:20:56.300 INFO:teuthology.lock.ops:Checking smithi163.front.sepia.ceph.com
2024-02-28T19:20:56.300 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-28T19:20:56.326 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: set os type and version on server
2024-02-28T19:20:56.326 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com'
2024-02-28T19:20:56.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T19:20:56.402 DEBUG:teuthology.orchestra.run.smithi155:> true
2024-02-28T19:20:56.539 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com'
2024-02-28T19:20:56.539 DEBUG:teuthology.orchestra.run.smithi155:> uname -m
2024-02-28T19:20:56.598 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64
2024-02-28T19:20:56.599 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release
2024-02-28T19:20:56.657 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="CentOS Stream"
2024-02-28T19:20:56.657 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="8"
2024-02-28T19:20:56.657 INFO:teuthology.orchestra.run.smithi155.stdout:ID="centos"
2024-02-28T19:20:56.657 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="rhel fedora"
2024-02-28T19:20:56.657 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="8"
2024-02-28T19:20:56.657 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el8"
2024-02-28T19:20:56.657 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="CentOS Stream 8"
2024-02-28T19:20:56.657 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31"
2024-02-28T19:20:56.657 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-02-28T19:20:56.657 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://centos.org/"
2024-02-28T19:20:56.657 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-28T19:20:56.658 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-28T19:20:56.658 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-28T19:20:56.658 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server
2024-02-28T19:20:56.683 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: set os type and version on server
2024-02-28T19:20:56.683 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com'
2024-02-28T19:20:56.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T19:20:56.756 DEBUG:teuthology.orchestra.run.smithi163:> true
2024-02-28T19:20:56.822 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi163.front.sepia.ceph.com'
2024-02-28T19:20:56.822 DEBUG:teuthology.orchestra.run.smithi163:> uname -m
2024-02-28T19:20:56.882 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64
2024-02-28T19:20:56.882 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release
2024-02-28T19:20:56.940 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="CentOS Stream"
2024-02-28T19:20:56.940 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="8"
2024-02-28T19:20:56.941 INFO:teuthology.orchestra.run.smithi163.stdout:ID="centos"
2024-02-28T19:20:56.941 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="rhel fedora"
2024-02-28T19:20:56.941 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="8"
2024-02-28T19:20:56.941 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el8"
2024-02-28T19:20:56.941 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="CentOS Stream 8"
2024-02-28T19:20:56.941 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31"
2024-02-28T19:20:56.941 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-02-28T19:20:56.941 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://centos.org/"
2024-02-28T19:20:56.941 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-28T19:20:56.941 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-28T19:20:56.941 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-28T19:20:56.942 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server
2024-02-28T19:20:56.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T19:20:57.066 INFO:teuthology.dispatcher.supervisor:Running job 7576250
2024-02-28T19:20:57.066 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-02-28_18:57:10-fs:upgrade:mds_upgrade_sequence-reef-distro-default-smithi/7576250 --name pdonnell-2024-02-28_18:57:10-fs:upgrade:mds_upgrade_sequence-reef-distro-default-smithi --description fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/pdonnell-2024-02-28_18:57:10-fs:upgrade:mds_upgrade_sequence-reef-distro-default-smithi/7576250/orig.config.yaml
2024-02-28T19:20:57.070 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-02-28_18:57:10-fs:upgrade:mds_upgrade_sequence-reef-distro-default-smithi/7576250
2024-02-28T19:20:57.071 INFO:teuthology.dispatcher.supervisor:Job PID: 3795512
2024-02-28T19:20:57.071 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-02-28T19:22:57.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T19:24:57.333 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T19:26:57.505 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T19:28:57.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T19:30:57.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T19:32:58.065 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T19:34:58.373 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T19:36:58.545 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T19:38:58.706 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T19:40:58.873 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T19:42:59.033 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T19:44:59.201 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T19:46:59.369 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T19:46:59.442 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1