2024-04-16T01:58:50.608 INFO:root:teuthology version: 0.0.1.dev267+g6c63784
2024-04-16T01:58:50.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T01:58:50.750 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fb034a22f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fb035a59c10>, signals=[15])
2024-04-16T01:58:50.750 INFO:teuthology.lock.ops:Start node 'smithi063.front.sepia.ceph.com' reimaging
2024-04-16T01:58:50.751 INFO:teuthology.lock.ops:Updating [smithi063.front.sepia.ceph.com]: reset os type and version on server
2024-04-16T01:58:50.751 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server
2024-04-16T01:58:50.774 INFO:teuthology.lock.ops:Start node 'smithi079.front.sepia.ceph.com' reimaging
2024-04-16T01:58:50.774 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: reset os type and version on server
2024-04-16T01:58:50.774 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server
2024-04-16T01:58:50.892 DEBUG:teuthology.provision.fog.smithi063:Requesting image smithi_centos_9.stream (ID 10)
2024-04-16T01:58:50.912 DEBUG:teuthology.provision.fog.smithi079:Requesting image smithi_centos_9.stream (ID 10)
2024-04-16T01:58:50.936 INFO:teuthology.provision.fog.smithi063:Scheduling deploy of centos 9.stream
2024-04-16T01:58:50.956 INFO:teuthology.provision.fog.smithi079:Scheduling deploy of centos 9.stream
2024-04-16T01:58:51.159 INFO:teuthology.orchestra.console.smithi063:Power off
2024-04-16T01:58:51.160 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-16T01:58:51.182 DEBUG:teuthology.orchestra.console.smithi063:power off output: Chassis Power Control: Down/Off
2024-04-16T01:58:51.183 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T01:58:51.202 INFO:teuthology.orchestra.console.smithi079:Power off
2024-04-16T01:58:51.202 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-16T01:58:51.210 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is on
2024-04-16T01:58:51.224 DEBUG:teuthology.orchestra.console.smithi079:power off output: Chassis Power Control: Down/Off
2024-04-16T01:58:51.224 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T01:58:51.247 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on
2024-04-16T01:58:55.214 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T01:58:55.248 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T01:58:55.324 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is on
2024-04-16T01:58:55.358 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on
2024-04-16T01:58:59.327 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T01:58:59.358 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T01:58:59.438 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is off
2024-04-16T01:58:59.467 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off
2024-04-16T01:58:59.539 INFO:teuthology.orchestra.console.smithi063:Power off completed
2024-04-16T01:58:59.568 INFO:teuthology.orchestra.console.smithi079:Power off completed
2024-04-16T01:58:59.640 INFO:teuthology.orchestra.console.smithi063:Power on
2024-04-16T01:58:59.641 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-16T01:58:59.662 DEBUG:teuthology.orchestra.console.smithi063:power on output: Chassis Power Control: Up/On
2024-04-16T01:58:59.662 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T01:58:59.670 INFO:teuthology.orchestra.console.smithi079:Power on
2024-04-16T01:58:59.670 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-16T01:58:59.684 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is off
2024-04-16T01:58:59.692 DEBUG:teuthology.orchestra.console.smithi079:power on output: Chassis Power Control: Up/On
2024-04-16T01:58:59.692 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T01:58:59.712 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off
2024-04-16T01:59:03.689 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T01:59:03.714 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T01:59:03.799 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is off
2024-04-16T01:59:03.822 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off
2024-04-16T01:59:07.802 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T01:59:07.823 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T01:59:07.912 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is on
2024-04-16T01:59:07.932 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on
2024-04-16T01:59:08.014 INFO:teuthology.orchestra.console.smithi063:Power on completed
2024-04-16T01:59:08.033 INFO:teuthology.orchestra.console.smithi079:Power on completed
2024-04-16T01:59:08.115 INFO:teuthology.provision.fog.smithi063:Waiting for deploy to finish
2024-04-16T01:59:08.135 INFO:teuthology.provision.fog.smithi079:Waiting for deploy to finish
2024-04-16T02:01:39.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T02:01:39.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T02:01:42.174 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2024-04-16T02:01:42.175 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63
2024-04-16T02:01:48.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T02:01:48.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T02:01:51.234 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2024-04-16T02:01:51.266 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63
2024-04-16T02:01:57.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T02:01:57.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T02:02:00.318 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63
2024-04-16T02:02:00.322 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2024-04-16T02:02:06.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T02:02:06.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T02:02:09.374 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63
2024-04-16T02:02:09.406 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2024-04-16T02:02:15.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T02:02:15.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T02:02:18.466 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2024-04-16T02:02:18.467 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63
2024-04-16T02:02:24.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T02:02:24.473 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T02:02:27.550 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63
2024-04-16T02:02:27.551 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2024-04-16T02:02:33.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T02:02:33.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T02:02:36.606 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63
2024-04-16T02:02:36.607 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2024-04-16T02:02:42.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T02:02:42.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T02:03:42.675 WARNING:teuthology.provision.fog.smithi063:timed out
2024-04-16T02:03:42.676 WARNING:teuthology.provision.fog.smithi079:timed out
2024-04-16T02:03:48.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T02:03:48.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T02:03:49.010 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-16T02:03:49.010 DEBUG:teuthology.orchestra.run.smithi063:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-16T02:03:49.028 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-16T02:03:49.028 DEBUG:teuthology.orchestra.run.smithi079:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-16T02:03:49.305 INFO:teuthology.provision.fog.smithi063:Node is ready
2024-04-16T02:03:49.305 DEBUG:teuthology.orchestra.run.smithi063:> hostname
2024-04-16T02:03:49.320 INFO:teuthology.orchestra.run.smithi063.stdout:smithi063.front.sepia.ceph.com
2024-04-16T02:03:49.321 DEBUG:teuthology.orchestra.run.smithi063:> grep smithi063.front.sepia.ceph.com /etc/hosts
2024-04-16T02:03:49.337 INFO:teuthology.provision.fog.smithi079:Node is ready
2024-04-16T02:03:49.337 DEBUG:teuthology.orchestra.run.smithi079:> hostname
2024-04-16T02:03:49.351 INFO:teuthology.orchestra.run.smithi079.stdout:smithi079.front.sepia.ceph.com
2024-04-16T02:03:49.352 DEBUG:teuthology.orchestra.run.smithi079:> grep smithi079.front.sepia.ceph.com /etc/hosts
2024-04-16T02:03:49.377 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63 smithi063.front.sepia.ceph.com smithi063
2024-04-16T02:03:49.377 DEBUG:teuthology.orchestra.run.smithi063:> sudo hostname smithi063
2024-04-16T02:03:49.405 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79 smithi079.front.sepia.ceph.com smithi079
2024-04-16T02:03:49.406 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079
2024-04-16T02:03:49.491 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i -e 's/smithi063.front.sepia.ceph.com/smithi063/g' /etc/hosts
2024-04-16T02:03:49.498 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079.front.sepia.ceph.com/smithi079/g' /etc/hosts
2024-04-16T02:03:49.524 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i -e 's/172.21.15.63/172.21.15.63/g' /etc/hosts
2024-04-16T02:03:49.526 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/172.21.15.79/172.21.15.79/g' /etc/hosts
2024-04-16T02:03:49.593 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079.front.sepia.ceph.com/smithi079/g' /etc/hostname
2024-04-16T02:03:49.596 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i -e 's/smithi063.front.sepia.ceph.com/smithi063/g' /etc/hostname
2024-04-16T02:03:49.660 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079
2024-04-16T02:03:49.667 DEBUG:teuthology.orchestra.run.smithi063:> sudo hostname smithi063
2024-04-16T02:03:49.726 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release
2024-04-16T02:03:49.737 DEBUG:teuthology.orchestra.run.smithi063:> cat /etc/os-release
2024-04-16T02:03:49.781 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="CentOS Stream"
2024-04-16T02:03:49.781 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="9"
2024-04-16T02:03:49.781 INFO:teuthology.orchestra.run.smithi079.stdout:ID="centos"
2024-04-16T02:03:49.782 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="rhel fedora"
2024-04-16T02:03:49.782 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="9"
2024-04-16T02:03:49.782 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el9"
2024-04-16T02:03:49.782 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-16T02:03:49.782 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31"
2024-04-16T02:03:49.783 INFO:teuthology.orchestra.run.smithi079.stdout:LOGO="fedora-logo-icon"
2024-04-16T02:03:49.783 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-16T02:03:49.783 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://centos.org/"
2024-04-16T02:03:49.783 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-16T02:03:49.784 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-16T02:03:49.784 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-16T02:03:49.785 INFO:teuthology.provision.fog.smithi079:Deploy complete!
2024-04-16T02:03:49.786 DEBUG:teuthology.parallel:result is None
2024-04-16T02:03:49.791 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="CentOS Stream"
2024-04-16T02:03:49.792 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="9"
2024-04-16T02:03:49.792 INFO:teuthology.orchestra.run.smithi063.stdout:ID="centos"
2024-04-16T02:03:49.792 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE="rhel fedora"
2024-04-16T02:03:49.792 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="9"
2024-04-16T02:03:49.792 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM_ID="platform:el9"
2024-04-16T02:03:49.792 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-16T02:03:49.792 INFO:teuthology.orchestra.run.smithi063.stdout:ANSI_COLOR="0;31"
2024-04-16T02:03:49.792 INFO:teuthology.orchestra.run.smithi063.stdout:LOGO="fedora-logo-icon"
2024-04-16T02:03:49.792 INFO:teuthology.orchestra.run.smithi063.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-16T02:03:49.792 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://centos.org/"
2024-04-16T02:03:49.792 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-16T02:03:49.792 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-16T02:03:49.792 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-16T02:03:49.793 INFO:teuthology.provision.fog.smithi063:Deploy complete!
2024-04-16T02:03:49.793 DEBUG:teuthology.parallel:result is None
2024-04-16T02:03:49.962 INFO:teuthology.lock.ops:Checking smithi063.front.sepia.ceph.com
2024-04-16T02:03:49.962 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-16T02:03:49.983 INFO:teuthology.lock.ops:Checking smithi079.front.sepia.ceph.com
2024-04-16T02:03:49.983 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-16T02:03:50.000 INFO:teuthology.lock.ops:Updating [smithi063.front.sepia.ceph.com]: set os type and version on server
2024-04-16T02:03:50.000 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com'
2024-04-16T02:03:50.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T02:03:50.102 DEBUG:teuthology.orchestra.run.smithi063:> true
2024-04-16T02:03:50.168 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com'
2024-04-16T02:03:50.168 DEBUG:teuthology.orchestra.run.smithi063:> uname -m
2024-04-16T02:03:50.223 INFO:teuthology.orchestra.run.smithi063.stdout:x86_64
2024-04-16T02:03:50.224 DEBUG:teuthology.orchestra.run.smithi063:> cat /etc/os-release
2024-04-16T02:03:50.279 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="CentOS Stream"
2024-04-16T02:03:50.279 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="9"
2024-04-16T02:03:50.279 INFO:teuthology.orchestra.run.smithi063.stdout:ID="centos"
2024-04-16T02:03:50.279 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE="rhel fedora"
2024-04-16T02:03:50.279 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="9"
2024-04-16T02:03:50.279 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM_ID="platform:el9"
2024-04-16T02:03:50.279 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-16T02:03:50.279 INFO:teuthology.orchestra.run.smithi063.stdout:ANSI_COLOR="0;31"
2024-04-16T02:03:50.280 INFO:teuthology.orchestra.run.smithi063.stdout:LOGO="fedora-logo-icon"
2024-04-16T02:03:50.280 INFO:teuthology.orchestra.run.smithi063.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-16T02:03:50.280 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://centos.org/"
2024-04-16T02:03:50.280 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-16T02:03:50.280 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-16T02:03:50.280 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-16T02:03:50.280 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server
2024-04-16T02:03:50.308 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: set os type and version on server
2024-04-16T02:03:50.308 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com'
2024-04-16T02:03:50.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T02:03:50.398 DEBUG:teuthology.orchestra.run.smithi079:> true
2024-04-16T02:03:50.468 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com'
2024-04-16T02:03:50.469 DEBUG:teuthology.orchestra.run.smithi079:> uname -m
2024-04-16T02:03:50.524 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64
2024-04-16T02:03:50.524 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release
2024-04-16T02:03:50.579 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="CentOS Stream"
2024-04-16T02:03:50.579 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="9"
2024-04-16T02:03:50.579 INFO:teuthology.orchestra.run.smithi079.stdout:ID="centos"
2024-04-16T02:03:50.579 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="rhel fedora"
2024-04-16T02:03:50.579 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="9"
2024-04-16T02:03:50.579 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el9"
2024-04-16T02:03:50.579 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-16T02:03:50.579 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31"
2024-04-16T02:03:50.579 INFO:teuthology.orchestra.run.smithi079.stdout:LOGO="fedora-logo-icon"
2024-04-16T02:03:50.579 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-16T02:03:50.579 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://centos.org/"
2024-04-16T02:03:50.580 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-16T02:03:50.580 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-16T02:03:50.580 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-16T02:03:50.580 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server
2024-04-16T02:03:50.599 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T02:03:50.691 INFO:teuthology.dispatcher.supervisor:Running job 7657400
2024-04-16T02:03:50.691 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-15_20:08:15-orch-main-distro-default-smithi/7657400 --name teuthology-2024-04-15_20:08:15-orch-main-distro-default-smithi --description orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/teuthology-2024-04-15_20:08:15-orch-main-distro-default-smithi/7657400/orig.config.yaml
2024-04-16T02:03:50.693 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-15_20:08:15-orch-main-distro-default-smithi/7657400
2024-04-16T02:03:50.694 INFO:teuthology.dispatcher.supervisor:Job PID: 2560919
2024-04-16T02:03:50.694 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-04-16T02:05:50.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T02:07:50.968 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T02:09:51.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T02:11:51.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T02:13:51.438 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T02:15:51.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T02:17:51.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T02:19:51.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T02:21:52.142 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T02:23:52.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T02:25:52.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T02:27:52.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T02:29:52.844 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T02:31:52.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T02:33:53.150 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T02:35:53.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T02:37:53.480 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T02:39:53.645 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T02:41:53.820 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T02:43:53.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T02:45:54.141 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T02:47:54.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T02:49:54.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T02:51:54.632 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T02:53:54.801 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T02:55:54.965 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T02:57:55.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T02:59:55.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T03:01:55.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T03:03:55.636 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T03:05:55.790 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T03:07:55.934 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T03:09:56.110 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T03:11:56.238 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T03:13:56.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T03:15:56.541 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T03:17:56.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T03:19:56.848 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T03:21:57.024 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T03:23:57.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T03:25:57.340 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T03:27:57.462 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T03:29:57.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T03:31:57.761 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T03:33:57.924 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T03:35:58.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T03:37:58.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T03:39:58.358 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T03:41:58.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T03:43:58.693 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T03:45:58.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T03:47:59.013 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T03:49:59.137 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T03:51:59.296 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T03:53:59.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T03:55:59.596 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T03:57:59.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T03:59:59.877 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T04:02:00.045 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T04:04:00.189 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T04:06:00.371 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T04:08:00.450 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T04:10:00.606 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T04:12:00.781 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T04:14:00.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T04:16:01.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T04:18:01.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T04:20:01.342 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T04:22:01.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T04:24:01.634 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T04:26:01.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T04:28:01.976 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T04:30:02.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T04:32:02.322 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T04:34:02.498 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T04:36:02.658 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T04:38:02.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T04:40:02.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T04:42:03.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T04:44:03.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T04:46:03.464 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T04:48:03.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T04:50:03.901 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T04:52:04.077 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T04:54:04.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T04:56:04.378 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T04:58:04.615 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T05:00:04.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T05:02:04.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T05:04:05.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T05:06:05.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T05:08:05.422 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T05:10:05.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T05:12:05.726 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T05:14:05.906 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T05:16:06.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T05:18:06.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T05:20:06.460 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T05:22:06.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T05:24:06.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T05:26:06.962 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T05:28:07.145 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T05:30:07.320 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T05:32:07.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T05:34:07.664 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T05:36:07.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T05:38:08.056 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T05:40:08.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T05:42:08.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T05:44:08.540 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T05:46:08.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T05:48:08.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T05:48:08.956 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1