2024-03-19T07:28:58.962 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-19T07:28:58.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:28:59.107 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fa75bdecf70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fa75cd4ec10>, signals=[15])
2024-03-19T07:28:59.109 INFO:teuthology.lock.ops:Start node 'smithi037.front.sepia.ceph.com' reimaging
2024-03-19T07:28:59.109 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: reset os type and version on server
2024-03-19T07:28:59.109 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server
2024-03-19T07:28:59.131 INFO:teuthology.lock.ops:Start node 'smithi063.front.sepia.ceph.com' reimaging
2024-03-19T07:28:59.131 INFO:teuthology.lock.ops:Updating [smithi063.front.sepia.ceph.com]: reset os type and version on server
2024-03-19T07:28:59.131 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server
2024-03-19T07:28:59.271 DEBUG:teuthology.provision.fog.smithi037:Requesting image smithi_centos_9.stream (ID 10)
2024-03-19T07:28:59.280 DEBUG:teuthology.provision.fog.smithi063:Requesting image smithi_centos_9.stream (ID 10)
2024-03-19T07:28:59.311 INFO:teuthology.provision.fog.smithi037:Scheduling deploy of centos 9.stream
2024-03-19T07:28:59.322 INFO:teuthology.provision.fog.smithi063:Scheduling deploy of centos 9.stream
2024-03-19T07:28:59.558 INFO:teuthology.orchestra.console.smithi063:Power off
2024-03-19T07:28:59.558 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-19T07:28:59.580 DEBUG:teuthology.orchestra.console.smithi063:power off output: Chassis Power Control: Down/Off
2024-03-19T07:28:59.580 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T07:28:59.600 INFO:teuthology.orchestra.console.smithi037:Power off
2024-03-19T07:28:59.601 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-19T07:28:59.612 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is on
2024-03-19T07:28:59.626 DEBUG:teuthology.orchestra.console.smithi037:power off output: Chassis Power Control: Down/Off
2024-03-19T07:28:59.627 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T07:28:59.670 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on
2024-03-19T07:29:03.614 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T07:29:03.671 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T07:29:03.723 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is on
2024-03-19T07:29:03.780 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on
2024-03-19T07:29:07.726 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T07:29:07.781 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T07:29:07.836 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is off
2024-03-19T07:29:07.890 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on
2024-03-19T07:29:07.938 INFO:teuthology.orchestra.console.smithi063:Power off completed
2024-03-19T07:29:08.038 INFO:teuthology.orchestra.console.smithi063:Power on
2024-03-19T07:29:08.039 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-19T07:29:08.060 DEBUG:teuthology.orchestra.console.smithi063:power on output: Chassis Power Control: Up/On
2024-03-19T07:29:08.061 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T07:29:08.082 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is off
2024-03-19T07:29:11.894 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T07:29:12.003 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off
2024-03-19T07:29:12.083 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T07:29:12.104 INFO:teuthology.orchestra.console.smithi037:Power off completed
2024-03-19T07:29:12.193 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is off
2024-03-19T07:29:12.205 INFO:teuthology.orchestra.console.smithi037:Power on
2024-03-19T07:29:12.205 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-19T07:29:12.229 DEBUG:teuthology.orchestra.console.smithi037:power on output: Chassis Power Control: Up/On
2024-03-19T07:29:12.229 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T07:29:12.252 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off
2024-03-19T07:29:16.198 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T07:29:16.253 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T07:29:16.308 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is on
2024-03-19T07:29:16.367 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off
2024-03-19T07:29:16.409 INFO:teuthology.orchestra.console.smithi063:Power on completed
2024-03-19T07:29:16.509 INFO:teuthology.provision.fog.smithi063:Waiting for deploy to finish
2024-03-19T07:29:20.370 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T07:29:20.479 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on
2024-03-19T07:29:20.579 INFO:teuthology.orchestra.console.smithi037:Power on completed
2024-03-19T07:29:20.680 INFO:teuthology.provision.fog.smithi037:Waiting for deploy to finish
2024-03-19T07:31:36.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:31:39.358 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37
2024-03-19T07:31:45.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:31:47.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:31:48.414 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37
2024-03-19T07:31:50.270 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63
2024-03-19T07:31:54.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:31:56.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:31:57.470 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37
2024-03-19T07:31:59.326 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63
2024-03-19T07:32:03.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:32:05.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:32:06.526 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37
2024-03-19T07:32:08.382 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63
2024-03-19T07:32:12.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:32:14.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:32:15.582 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37
2024-03-19T07:32:17.438 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63
2024-03-19T07:32:21.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:32:23.442 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:32:26.494 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63
2024-03-19T07:32:32.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:32:35.582 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63
2024-03-19T07:32:41.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:32:44.638 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63
2024-03-19T07:32:50.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:33:21.618 WARNING:teuthology.provision.fog.smithi037:timed out
2024-03-19T07:33:27.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:33:27.889 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-19T07:33:27.890 DEBUG:teuthology.orchestra.run.smithi037:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-19T07:33:28.227 INFO:teuthology.provision.fog.smithi037:Node is ready
2024-03-19T07:33:28.227 DEBUG:teuthology.orchestra.run.smithi037:> hostname
2024-03-19T07:33:28.242 INFO:teuthology.orchestra.run.smithi037.stdout:smithi037.front.sepia.ceph.com
2024-03-19T07:33:28.243 DEBUG:teuthology.orchestra.run.smithi037:> grep smithi037.front.sepia.ceph.com /etc/hosts
2024-03-19T07:33:28.299 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37 smithi037.front.sepia.ceph.com smithi037
2024-03-19T07:33:28.299 DEBUG:teuthology.orchestra.run.smithi037:> sudo hostname smithi037
2024-03-19T07:33:28.416 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/smithi037.front.sepia.ceph.com/smithi037/g' /etc/hosts
2024-03-19T07:33:28.448 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/172.21.15.37/172.21.15.37/g' /etc/hosts
2024-03-19T07:33:28.520 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/smithi037.front.sepia.ceph.com/smithi037/g' /etc/hostname
2024-03-19T07:33:28.591 DEBUG:teuthology.orchestra.run.smithi037:> sudo hostname smithi037
2024-03-19T07:33:28.664 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release
2024-03-19T07:33:28.720 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Stream"
2024-03-19T07:33:28.720 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="9"
2024-03-19T07:33:28.720 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos"
2024-03-19T07:33:28.720 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora"
2024-03-19T07:33:28.720 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="9"
2024-03-19T07:33:28.720 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el9"
2024-03-19T07:33:28.720 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-19T07:33:28.721 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31"
2024-03-19T07:33:28.721 INFO:teuthology.orchestra.run.smithi037.stdout:LOGO="fedora-logo-icon"
2024-03-19T07:33:28.721 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-19T07:33:28.721 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://centos.org/"
2024-03-19T07:33:28.721 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-19T07:33:28.721 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-19T07:33:28.721 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-19T07:33:28.722 INFO:teuthology.provision.fog.smithi037:Deploy complete!
2024-03-19T07:33:28.723 DEBUG:teuthology.parallel:result is None
2024-03-19T07:33:50.664 WARNING:teuthology.provision.fog.smithi063:timed out
2024-03-19T07:33:56.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:33:56.892 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-19T07:33:56.892 DEBUG:teuthology.orchestra.run.smithi063:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-19T07:33:57.245 INFO:teuthology.provision.fog.smithi063:Node is ready
2024-03-19T07:33:57.245 DEBUG:teuthology.orchestra.run.smithi063:> hostname
2024-03-19T07:33:57.260 INFO:teuthology.orchestra.run.smithi063.stdout:smithi063.front.sepia.ceph.com
2024-03-19T07:33:57.261 DEBUG:teuthology.orchestra.run.smithi063:> grep smithi063.front.sepia.ceph.com /etc/hosts
2024-03-19T07:33:57.316 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63 smithi063.front.sepia.ceph.com smithi063
2024-03-19T07:33:57.316 DEBUG:teuthology.orchestra.run.smithi063:> sudo hostname smithi063
2024-03-19T07:33:57.432 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i -e 's/smithi063.front.sepia.ceph.com/smithi063/g' /etc/hosts
2024-03-19T07:33:57.464 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i -e 's/172.21.15.63/172.21.15.63/g' /etc/hosts
2024-03-19T07:33:57.535 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i -e 's/smithi063.front.sepia.ceph.com/smithi063/g' /etc/hostname
2024-03-19T07:33:57.606 DEBUG:teuthology.orchestra.run.smithi063:> sudo hostname smithi063
2024-03-19T07:33:57.676 DEBUG:teuthology.orchestra.run.smithi063:> cat /etc/os-release
2024-03-19T07:33:57.730 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="CentOS Stream"
2024-03-19T07:33:57.731 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="9"
2024-03-19T07:33:57.731 INFO:teuthology.orchestra.run.smithi063.stdout:ID="centos"
2024-03-19T07:33:57.731 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE="rhel fedora"
2024-03-19T07:33:57.731 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="9"
2024-03-19T07:33:57.731 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM_ID="platform:el9"
2024-03-19T07:33:57.731 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-19T07:33:57.731 INFO:teuthology.orchestra.run.smithi063.stdout:ANSI_COLOR="0;31"
2024-03-19T07:33:57.731 INFO:teuthology.orchestra.run.smithi063.stdout:LOGO="fedora-logo-icon"
2024-03-19T07:33:57.731 INFO:teuthology.orchestra.run.smithi063.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-19T07:33:57.731 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://centos.org/"
2024-03-19T07:33:57.731 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-19T07:33:57.731 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-19T07:33:57.731 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-19T07:33:57.732 INFO:teuthology.provision.fog.smithi063:Deploy complete!
2024-03-19T07:33:57.732 DEBUG:teuthology.parallel:result is None
2024-03-19T07:33:57.909 INFO:teuthology.lock.ops:Checking smithi037.front.sepia.ceph.com
2024-03-19T07:33:57.910 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-19T07:33:57.935 INFO:teuthology.lock.ops:Checking smithi063.front.sepia.ceph.com
2024-03-19T07:33:57.935 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-19T07:33:57.952 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: set os type and version on server
2024-03-19T07:33:57.952 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com'
2024-03-19T07:33:57.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:33:58.058 DEBUG:teuthology.orchestra.run.smithi037:> true
2024-03-19T07:33:58.237 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com'
2024-03-19T07:33:58.237 DEBUG:teuthology.orchestra.run.smithi037:> uname -m
2024-03-19T07:33:58.292 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64
2024-03-19T07:33:58.292 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release
2024-03-19T07:33:58.347 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Stream"
2024-03-19T07:33:58.347 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="9"
2024-03-19T07:33:58.347 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos"
2024-03-19T07:33:58.347 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora"
2024-03-19T07:33:58.348 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="9"
2024-03-19T07:33:58.348 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el9"
2024-03-19T07:33:58.348 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-19T07:33:58.348 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31"
2024-03-19T07:33:58.348 INFO:teuthology.orchestra.run.smithi037.stdout:LOGO="fedora-logo-icon"
2024-03-19T07:33:58.348 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-19T07:33:58.348 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://centos.org/"
2024-03-19T07:33:58.348 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-19T07:33:58.348 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-19T07:33:58.348 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-19T07:33:58.349 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server
2024-03-19T07:33:58.368 INFO:teuthology.lock.ops:Updating [smithi063.front.sepia.ceph.com]: set os type and version on server
2024-03-19T07:33:58.368 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com'
2024-03-19T07:33:58.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:33:58.467 DEBUG:teuthology.orchestra.run.smithi063:> true
2024-03-19T07:33:58.537 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com'
2024-03-19T07:33:58.538 DEBUG:teuthology.orchestra.run.smithi063:> uname -m
2024-03-19T07:33:58.594 INFO:teuthology.orchestra.run.smithi063.stdout:x86_64
2024-03-19T07:33:58.594 DEBUG:teuthology.orchestra.run.smithi063:> cat /etc/os-release
2024-03-19T07:33:58.650 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="CentOS Stream"
2024-03-19T07:33:58.650 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="9"
2024-03-19T07:33:58.650 INFO:teuthology.orchestra.run.smithi063.stdout:ID="centos"
2024-03-19T07:33:58.650 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE="rhel fedora"
2024-03-19T07:33:58.650 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="9"
2024-03-19T07:33:58.650 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM_ID="platform:el9"
2024-03-19T07:33:58.651 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-19T07:33:58.651 INFO:teuthology.orchestra.run.smithi063.stdout:ANSI_COLOR="0;31"
2024-03-19T07:33:58.651 INFO:teuthology.orchestra.run.smithi063.stdout:LOGO="fedora-logo-icon"
2024-03-19T07:33:58.651 INFO:teuthology.orchestra.run.smithi063.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-19T07:33:58.651 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://centos.org/"
2024-03-19T07:33:58.651 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-19T07:33:58.651 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-19T07:33:58.651 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-19T07:33:58.651 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server
2024-03-19T07:33:58.676 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:33:58.761 INFO:teuthology.dispatcher.supervisor:Running job 7610597
2024-03-19T07:33:58.761 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-03-19_04:56:42-fs-wip-batrick-testing-20240318.181317-distro-default-smithi/7610597 --name pdonnell-2024-03-19_04:56:42-fs-wip-batrick-testing-20240318.181317-distro-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/pdonnell-2024-03-19_04:56:42-fs-wip-batrick-testing-20240318.181317-distro-default-smithi/7610597/orig.config.yaml
2024-03-19T07:33:58.764 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-03-19_04:56:42-fs-wip-batrick-testing-20240318.181317-distro-default-smithi/7610597
2024-03-19T07:33:58.764 INFO:teuthology.dispatcher.supervisor:Job PID: 755126
2024-03-19T07:33:58.765 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-19T07:35:58.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:37:59.029 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:39:59.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:41:59.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:43:59.553 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:45:59.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:47:59.878 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:50:00.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:52:00.230 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:54:00.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:56:00.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:58:00.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:00:00.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:02:01.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:04:01.205 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:06:01.370 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:08:01.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:10:01.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:12:01.882 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:14:02.064 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:16:02.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:18:02.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:20:02.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:22:02.753 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:24:02.921 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:26:03.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:28:03.226 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:30:03.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:32:03.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:34:03.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:36:03.905 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:38:04.054 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:40:04.245 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:42:04.413 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:44:04.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:46:04.776 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:48:04.933 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:50:05.101 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:52:05.265 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:54:05.434 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:56:05.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:58:05.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:00:05.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:02:06.090 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:04:06.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:06:06.454 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:08:06.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:10:06.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:12:06.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:14:07.134 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:16:07.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:18:07.476 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:20:07.636 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:22:07.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:24:07.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:26:08.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:28:08.444 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:30:08.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:32:08.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:34:08.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:36:09.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:38:09.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:40:09.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:42:09.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:44:09.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:46:10.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:48:10.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:50:10.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:52:10.507 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:54:10.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:56:10.856 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:58:11.033 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:00:11.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:02:11.378 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:04:11.568 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:06:11.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:08:11.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:10:12.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:12:12.228 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:14:12.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:16:12.560 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:18:12.728 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:20:12.906 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:22:13.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:24:13.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:26:13.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:28:13.586 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:30:13.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:32:13.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:34:14.103 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:36:14.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:38:14.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:40:14.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:42:14.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:44:15.021 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:46:15.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:48:15.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:50:15.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:52:15.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:54:15.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:56:15.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:58:16.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T11:00:16.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T11:02:16.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T11:04:16.644 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T11:06:16.814 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T11:08:16.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T11:10:17.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T11:12:17.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T11:14:17.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T11:16:17.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T11:18:17.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T11:18:17.895 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1