2024-03-11T16:50:35.185 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-11T16:50:35.186 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T16:50:35.332 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f8525b13f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f8526b87c10>, signals=[15])
2024-03-11T16:50:35.332 INFO:teuthology.lock.ops:Start node 'smithi102.front.sepia.ceph.com' reimaging
2024-03-11T16:50:35.332 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: reset os type and version on server
2024-03-11T16:50:35.332 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server
2024-03-11T16:50:35.350 INFO:teuthology.lock.ops:Start node 'smithi156.front.sepia.ceph.com' reimaging
2024-03-11T16:50:35.351 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: reset os type and version on server
2024-03-11T16:50:35.351 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server
2024-03-11T16:50:35.477 DEBUG:teuthology.provision.fog.smithi102:Requesting image smithi_centos_9.stream (ID 10)
2024-03-11T16:50:35.486 DEBUG:teuthology.provision.fog.smithi156:Requesting image smithi_centos_9.stream (ID 10)
2024-03-11T16:50:35.523 INFO:teuthology.provision.fog.smithi102:Scheduling deploy of centos 9.stream
2024-03-11T16:50:35.532 INFO:teuthology.provision.fog.smithi156:Scheduling deploy of centos 9.stream
2024-03-11T16:50:35.773 INFO:teuthology.orchestra.console.smithi102:Power off
2024-03-11T16:50:35.773 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-11T16:50:35.785 INFO:teuthology.orchestra.console.smithi156:Power off
2024-03-11T16:50:35.786 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-11T16:50:35.798 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off
2024-03-11T16:50:35.798 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T16:50:35.807 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off
2024-03-11T16:50:35.808 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T16:50:35.821 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on
2024-03-11T16:50:35.829 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on
2024-03-11T16:50:39.825 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T16:50:39.832 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T16:50:39.934 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on
2024-03-11T16:50:39.941 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on
2024-03-11T16:50:43.938 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T16:50:43.946 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T16:50:44.049 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on
2024-03-11T16:50:44.055 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off
2024-03-11T16:50:44.155 INFO:teuthology.orchestra.console.smithi156:Power off completed
2024-03-11T16:50:44.256 INFO:teuthology.orchestra.console.smithi156:Power on
2024-03-11T16:50:44.256 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-11T16:50:44.277 DEBUG:teuthology.orchestra.console.smithi156:power on output: Chassis Power Control: Up/On
2024-03-11T16:50:44.277 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T16:50:44.299 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off
2024-03-11T16:50:48.054 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T16:50:48.163 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off
2024-03-11T16:50:48.264 INFO:teuthology.orchestra.console.smithi102:Power off completed
2024-03-11T16:50:48.300 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T16:50:48.365 INFO:teuthology.orchestra.console.smithi102:Power on
2024-03-11T16:50:48.366 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-11T16:50:48.387 DEBUG:teuthology.orchestra.console.smithi102:power on output: Chassis Power Control: Up/On
2024-03-11T16:50:48.387 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T16:50:48.408 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off
2024-03-11T16:50:48.409 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off
2024-03-11T16:50:52.410 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T16:50:52.419 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T16:50:52.521 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on
2024-03-11T16:50:52.549 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on
2024-03-11T16:50:52.622 INFO:teuthology.orchestra.console.smithi102:Power on completed
2024-03-11T16:50:52.650 INFO:teuthology.orchestra.console.smithi156:Power on completed
2024-03-11T16:50:52.723 INFO:teuthology.provision.fog.smithi102:Waiting for deploy to finish
2024-03-11T16:50:52.751 INFO:teuthology.provision.fog.smithi156:Waiting for deploy to finish
2024-03-11T16:53:38.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T16:53:38.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T16:53:41.983 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-03-11T16:53:41.983 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2024-03-11T16:53:47.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T16:53:47.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T16:53:51.038 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-03-11T16:53:51.039 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2024-03-11T16:53:57.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T16:53:57.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T16:54:00.094 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-03-11T16:54:00.130 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2024-03-11T16:54:06.101 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T16:54:06.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T16:54:09.182 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-03-11T16:54:09.183 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2024-03-11T16:54:15.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T16:54:15.189 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T16:54:18.242 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-03-11T16:54:18.274 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2024-03-11T16:54:24.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T16:54:24.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T16:54:27.326 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2024-03-11T16:54:33.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T16:54:51.683 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2024-03-11T16:54:57.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T16:55:00.766 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2024-03-11T16:55:06.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T16:55:10.109 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-11T16:55:10.110 DEBUG:teuthology.orchestra.run.smithi156:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-11T16:55:24.249 WARNING:teuthology.provision.fog.smithi102:timed out
2024-03-11T16:55:30.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T16:55:30.582 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-11T16:55:30.582 DEBUG:teuthology.orchestra.run.smithi102:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-11T16:55:30.912 INFO:teuthology.provision.fog.smithi102:Node is ready
2024-03-11T16:55:30.913 DEBUG:teuthology.orchestra.run.smithi102:> hostname
2024-03-11T16:55:30.928 INFO:teuthology.orchestra.run.smithi102.stdout:smithi102.front.sepia.ceph.com
2024-03-11T16:55:30.928 DEBUG:teuthology.orchestra.run.smithi102:> grep smithi102.front.sepia.ceph.com /etc/hosts
2024-03-11T16:55:30.984 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.102 smithi102.front.sepia.ceph.com smithi102
2024-03-11T16:55:30.985 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102
2024-03-11T16:55:31.117 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hosts
2024-03-11T16:55:31.145 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/172.21.15.102/172.21.15.102/g' /etc/hosts
2024-03-11T16:55:31.213 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hostname
2024-03-11T16:55:31.281 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102
2024-03-11T16:55:31.348 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release
2024-03-11T16:55:31.403 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="CentOS Stream"
2024-03-11T16:55:31.403 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="9"
2024-03-11T16:55:31.403 INFO:teuthology.orchestra.run.smithi102.stdout:ID="centos"
2024-03-11T16:55:31.403 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="rhel fedora"
2024-03-11T16:55:31.403 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="9"
2024-03-11T16:55:31.403 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el9"
2024-03-11T16:55:31.404 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-11T16:55:31.404 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31"
2024-03-11T16:55:31.404 INFO:teuthology.orchestra.run.smithi102.stdout:LOGO="fedora-logo-icon"
2024-03-11T16:55:31.404 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-11T16:55:31.404 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://centos.org/"
2024-03-11T16:55:31.404 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-11T16:55:31.404 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-11T16:55:31.404 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-11T16:55:31.405 INFO:teuthology.provision.fog.smithi102:Deploy complete!
2024-03-11T16:55:31.406 DEBUG:teuthology.parallel:result is None
2024-03-11T16:55:35.792 INFO:teuthology.provision.fog.smithi156:Node is ready
2024-03-11T16:55:35.792 DEBUG:teuthology.orchestra.run.smithi156:> hostname
2024-03-11T16:55:35.810 INFO:teuthology.orchestra.run.smithi156.stdout:smithi156.front.sepia.ceph.com
2024-03-11T16:55:35.810 DEBUG:teuthology.orchestra.run.smithi156:> grep smithi156.front.sepia.ceph.com /etc/hosts
2024-03-11T16:55:35.867 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156 smithi156.front.sepia.ceph.com smithi156
2024-03-11T16:55:35.867 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156
2024-03-11T16:55:35.998 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hosts
2024-03-11T16:55:36.028 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/172.21.15.156/172.21.15.156/g' /etc/hosts
2024-03-11T16:55:36.098 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hostname
2024-03-11T16:55:36.167 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156
2024-03-11T16:55:36.234 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release
2024-03-11T16:55:36.290 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Stream"
2024-03-11T16:55:36.290 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="9"
2024-03-11T16:55:36.290 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos"
2024-03-11T16:55:36.291 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora"
2024-03-11T16:55:36.291 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="9"
2024-03-11T16:55:36.291 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el9"
2024-03-11T16:55:36.291 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-11T16:55:36.291 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31"
2024-03-11T16:55:36.291 INFO:teuthology.orchestra.run.smithi156.stdout:LOGO="fedora-logo-icon"
2024-03-11T16:55:36.291 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-11T16:55:36.291 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://centos.org/"
2024-03-11T16:55:36.291 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-11T16:55:36.291 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-11T16:55:36.291 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-11T16:55:36.292 INFO:teuthology.provision.fog.smithi156:Deploy complete!
2024-03-11T16:55:36.292 DEBUG:teuthology.parallel:result is None
2024-03-11T16:55:36.490 INFO:teuthology.lock.ops:Checking smithi102.front.sepia.ceph.com
2024-03-11T16:55:36.491 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-11T16:55:36.520 INFO:teuthology.lock.ops:Checking smithi156.front.sepia.ceph.com
2024-03-11T16:55:36.520 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-11T16:55:36.546 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: set os type and version on server
2024-03-11T16:55:36.546 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com'
2024-03-11T16:55:36.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T16:55:36.646 DEBUG:teuthology.orchestra.run.smithi102:> true
2024-03-11T16:55:36.714 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com'
2024-03-11T16:55:36.714 DEBUG:teuthology.orchestra.run.smithi102:> uname -m
2024-03-11T16:55:36.770 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64
2024-03-11T16:55:36.770 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release
2024-03-11T16:55:36.826 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="CentOS Stream"
2024-03-11T16:55:36.826 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="9"
2024-03-11T16:55:36.826 INFO:teuthology.orchestra.run.smithi102.stdout:ID="centos"
2024-03-11T16:55:36.826 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="rhel fedora"
2024-03-11T16:55:36.826 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="9"
2024-03-11T16:55:36.826 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el9"
2024-03-11T16:55:36.826 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-11T16:55:36.826 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31"
2024-03-11T16:55:36.826 INFO:teuthology.orchestra.run.smithi102.stdout:LOGO="fedora-logo-icon"
2024-03-11T16:55:36.826 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-11T16:55:36.827 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://centos.org/"
2024-03-11T16:55:36.827 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-11T16:55:36.827 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-11T16:55:36.827 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-11T16:55:36.827 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server
2024-03-11T16:55:36.853 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: set os type and version on server
2024-03-11T16:55:36.853 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com'
2024-03-11T16:55:36.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T16:55:36.939 DEBUG:teuthology.orchestra.run.smithi156:> true
2024-03-11T16:55:37.009 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com'
2024-03-11T16:55:37.010 DEBUG:teuthology.orchestra.run.smithi156:> uname -m
2024-03-11T16:55:37.066 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64
2024-03-11T16:55:37.066 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release
2024-03-11T16:55:37.122 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Stream"
2024-03-11T16:55:37.122 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="9"
2024-03-11T16:55:37.122 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos"
2024-03-11T16:55:37.122 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora"
2024-03-11T16:55:37.122 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="9"
2024-03-11T16:55:37.123 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el9"
2024-03-11T16:55:37.123 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-11T16:55:37.123 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31"
2024-03-11T16:55:37.123 INFO:teuthology.orchestra.run.smithi156.stdout:LOGO="fedora-logo-icon"
2024-03-11T16:55:37.123 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-11T16:55:37.123 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://centos.org/"
2024-03-11T16:55:37.123 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-11T16:55:37.123 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-11T16:55:37.123 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-11T16:55:37.124 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server
2024-03-11T16:55:37.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T16:55:37.258 INFO:teuthology.dispatcher.supervisor:Running job 7591163
2024-03-11T16:55:37.258 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-03-11_12:33:20-fs-main-distro-default-smithi/7591163 --name teuthology-2024-03-11_12:33:20-fs-main-distro-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/teuthology-2024-03-11_12:33:20-fs-main-distro-default-smithi/7591163/orig.config.yaml
2024-03-11T16:55:37.262 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-03-11_12:33:20-fs-main-distro-default-smithi/7591163
2024-03-11T16:55:37.262 INFO:teuthology.dispatcher.supervisor:Job PID: 2410298
2024-03-11T16:55:37.263 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-11T16:57:37.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T16:59:37.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T17:01:37.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T17:03:37.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T17:05:38.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T17:07:38.585 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T17:09:38.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T17:11:38.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T17:13:39.088 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T17:15:39.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T17:17:39.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T17:19:39.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T17:21:39.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T17:23:39.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T17:25:40.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T17:27:40.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T17:29:40.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T17:31:40.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T17:33:40.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T17:35:41.036 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T17:37:41.212 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T17:39:41.384 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T17:41:41.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T17:43:41.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T17:45:41.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T17:47:43.507 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T17:49:43.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T17:51:43.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T17:53:44.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T17:55:44.210 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T17:57:44.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T17:59:44.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T18:01:44.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T18:03:44.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T18:05:45.056 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T18:07:45.238 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T18:09:45.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T18:11:45.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T18:13:45.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T18:15:45.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T18:17:46.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T18:19:46.226 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T18:21:46.400 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T18:23:46.569 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T18:25:46.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T18:27:46.904 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T18:29:47.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T18:31:47.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T18:33:47.354 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T18:35:47.514 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T18:37:47.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T18:39:47.850 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T18:41:48.005 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T18:43:48.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T18:45:48.349 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T18:47:48.510 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T18:49:48.672 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T18:51:48.830 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T18:53:49.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T18:55:49.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T18:57:49.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T18:59:49.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T19:01:49.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T19:03:49.876 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T19:05:50.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T19:07:50.217 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T19:09:50.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T19:11:50.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T19:13:50.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T19:15:50.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T19:17:51.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T19:19:51.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T19:21:51.389 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T19:23:51.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T19:25:51.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T19:27:51.893 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T19:29:52.050 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T19:31:52.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T19:33:52.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T19:35:52.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T19:37:52.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T19:39:52.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T19:41:53.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T19:43:53.244 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T19:45:53.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T19:47:53.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T19:49:53.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T19:51:53.933 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T19:53:54.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T19:55:54.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T19:57:54.444 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T19:59:54.612 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T20:01:54.784 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T20:03:54.960 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T20:05:55.130 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T20:07:55.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T20:09:55.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T20:11:55.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T20:13:55.794 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T20:15:55.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T20:17:56.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T20:19:56.296 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T20:21:56.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T20:23:56.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T20:25:56.817 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T20:27:56.956 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T20:29:57.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T20:31:57.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T20:33:57.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T20:35:57.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T20:37:57.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T20:39:57.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T20:41:58.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T20:43:58.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T20:43:58.350 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1