2024-03-24T11:18:56.225 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-24T11:18:56.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T11:18:56.378 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fc706901f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fc707962c10>, signals=[15])
2024-03-24T11:18:56.379 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging
2024-03-24T11:18:56.379 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server
2024-03-24T11:18:56.379 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server
2024-03-24T11:18:56.401 INFO:teuthology.lock.ops:Start node 'smithi162.front.sepia.ceph.com' reimaging
2024-03-24T11:18:56.401 INFO:teuthology.lock.ops:Updating [smithi162.front.sepia.ceph.com]: reset os type and version on server
2024-03-24T11:18:56.401 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server
2024-03-24T11:18:56.517 DEBUG:teuthology.provision.fog.smithi161:Requesting image smithi_centos_9.stream (ID 10)
2024-03-24T11:18:56.555 DEBUG:teuthology.provision.fog.smithi162:Requesting image smithi_centos_9.stream (ID 10)
2024-03-24T11:18:56.558 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of centos 9.stream
2024-03-24T11:18:56.602 INFO:teuthology.provision.fog.smithi162:Scheduling deploy of centos 9.stream
2024-03-24T11:18:56.780 INFO:teuthology.orchestra.console.smithi161:Power off
2024-03-24T11:18:56.780 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-24T11:18:56.803 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off
2024-03-24T11:18:56.804 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T11:18:56.826 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on
2024-03-24T11:18:56.843 INFO:teuthology.orchestra.console.smithi162:Power off
2024-03-24T11:18:56.844 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-24T11:18:56.865 DEBUG:teuthology.orchestra.console.smithi162:power off output: Chassis Power Control: Down/Off
2024-03-24T11:18:56.865 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T11:18:56.888 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on
2024-03-24T11:19:00.827 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T11:19:00.889 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T11:19:00.937 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on
2024-03-24T11:19:00.999 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on
2024-03-24T11:19:04.942 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T11:19:05.000 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T11:19:05.051 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on
2024-03-24T11:19:05.111 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off
2024-03-24T11:19:05.212 INFO:teuthology.orchestra.console.smithi162:Power off completed
2024-03-24T11:19:05.313 INFO:teuthology.orchestra.console.smithi162:Power on
2024-03-24T11:19:05.313 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-24T11:19:05.337 DEBUG:teuthology.orchestra.console.smithi162:power on output: Chassis Power Control: Up/On
2024-03-24T11:19:05.337 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T11:19:05.360 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off
2024-03-24T11:19:09.054 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T11:19:09.164 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off
2024-03-24T11:19:09.264 INFO:teuthology.orchestra.console.smithi161:Power off completed
2024-03-24T11:19:09.362 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T11:19:09.369 INFO:teuthology.orchestra.console.smithi161:Power on
2024-03-24T11:19:09.370 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-24T11:19:09.393 DEBUG:teuthology.orchestra.console.smithi161:power on output: Chassis Power Control: Up/On
2024-03-24T11:19:09.394 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T11:19:09.415 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off
2024-03-24T11:19:09.471 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off
2024-03-24T11:19:13.418 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T11:19:13.472 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T11:19:13.528 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on
2024-03-24T11:19:13.629 INFO:teuthology.orchestra.console.smithi161:Power on completed
2024-03-24T11:19:13.684 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on
2024-03-24T11:19:13.730 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish
2024-03-24T11:19:13.786 INFO:teuthology.orchestra.console.smithi162:Power on completed
2024-03-24T11:19:13.887 INFO:teuthology.provision.fog.smithi162:Waiting for deploy to finish
2024-03-24T11:21:59.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T11:21:59.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T11:22:02.622 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-03-24T11:22:02.623 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162
2024-03-24T11:22:08.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T11:22:08.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T11:22:11.678 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-03-24T11:22:11.710 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162
2024-03-24T11:22:17.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T11:22:17.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T11:22:20.766 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-03-24T11:22:20.767 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162
2024-03-24T11:22:26.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T11:22:26.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T11:22:29.826 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-03-24T11:22:29.827 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162
2024-03-24T11:22:35.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T11:22:35.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T11:22:38.914 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-03-24T11:22:38.915 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162
2024-03-24T11:22:44.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T11:22:44.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T11:22:48.002 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-03-24T11:22:48.003 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162
2024-03-24T11:22:54.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T11:22:54.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T11:23:54.067 WARNING:teuthology.provision.fog.smithi161:timed out
2024-03-24T11:23:54.067 WARNING:teuthology.provision.fog.smithi162:timed out
2024-03-24T11:24:00.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T11:24:00.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T11:24:00.374 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-24T11:24:00.375 DEBUG:teuthology.orchestra.run.smithi161:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-24T11:24:00.389 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-24T11:24:00.389 DEBUG:teuthology.orchestra.run.smithi162:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-24T11:24:00.697 INFO:teuthology.provision.fog.smithi161:Node is ready
2024-03-24T11:24:00.697 DEBUG:teuthology.orchestra.run.smithi161:> hostname
2024-03-24T11:24:00.706 INFO:teuthology.provision.fog.smithi162:Node is ready
2024-03-24T11:24:00.707 DEBUG:teuthology.orchestra.run.smithi162:> hostname
2024-03-24T11:24:00.712 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161.front.sepia.ceph.com
2024-03-24T11:24:00.712 DEBUG:teuthology.orchestra.run.smithi161:> grep smithi161.front.sepia.ceph.com /etc/hosts
2024-03-24T11:24:00.721 INFO:teuthology.orchestra.run.smithi162.stdout:smithi162.front.sepia.ceph.com
2024-03-24T11:24:00.721 DEBUG:teuthology.orchestra.run.smithi162:> grep smithi162.front.sepia.ceph.com /etc/hosts
2024-03-24T11:24:00.768 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161
2024-03-24T11:24:00.768 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161
2024-03-24T11:24:00.776 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.15.162 smithi162.front.sepia.ceph.com smithi162
2024-03-24T11:24:00.776 DEBUG:teuthology.orchestra.run.smithi162:> sudo hostname smithi162
2024-03-24T11:24:00.882 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/smithi162.front.sepia.ceph.com/smithi162/g' /etc/hosts
2024-03-24T11:24:00.893 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hosts
2024-03-24T11:24:00.911 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/172.21.15.162/172.21.15.162/g' /etc/hosts
2024-03-24T11:24:00.921 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/172.21.15.161/172.21.15.161/g' /etc/hosts
2024-03-24T11:24:00.977 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/smithi162.front.sepia.ceph.com/smithi162/g' /etc/hostname
2024-03-24T11:24:00.989 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hostname
2024-03-24T11:24:01.044 DEBUG:teuthology.orchestra.run.smithi162:> sudo hostname smithi162
2024-03-24T11:24:01.057 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161
2024-03-24T11:24:01.111 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release
2024-03-24T11:24:01.123 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release
2024-03-24T11:24:01.162 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="CentOS Stream"
2024-03-24T11:24:01.162 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="9"
2024-03-24T11:24:01.162 INFO:teuthology.orchestra.run.smithi162.stdout:ID="centos"
2024-03-24T11:24:01.162 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="rhel fedora"
2024-03-24T11:24:01.162 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="9"
2024-03-24T11:24:01.163 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el9"
2024-03-24T11:24:01.163 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-24T11:24:01.163 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31"
2024-03-24T11:24:01.163 INFO:teuthology.orchestra.run.smithi162.stdout:LOGO="fedora-logo-icon"
2024-03-24T11:24:01.163 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-24T11:24:01.163 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://centos.org/"
2024-03-24T11:24:01.163 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-24T11:24:01.163 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-24T11:24:01.163 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-24T11:24:01.164 INFO:teuthology.provision.fog.smithi162:Deploy complete!
2024-03-24T11:24:01.165 DEBUG:teuthology.parallel:result is None
2024-03-24T11:24:01.179 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream"
2024-03-24T11:24:01.179 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="9"
2024-03-24T11:24:01.179 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos"
2024-03-24T11:24:01.179 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora"
2024-03-24T11:24:01.179 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="9"
2024-03-24T11:24:01.179 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el9"
2024-03-24T11:24:01.179 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-24T11:24:01.179 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31"
2024-03-24T11:24:01.180 INFO:teuthology.orchestra.run.smithi161.stdout:LOGO="fedora-logo-icon"
2024-03-24T11:24:01.180 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-24T11:24:01.180 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/"
2024-03-24T11:24:01.180 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-24T11:24:01.180 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-24T11:24:01.180 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-24T11:24:01.180 INFO:teuthology.provision.fog.smithi161:Deploy complete!
2024-03-24T11:24:01.181 DEBUG:teuthology.parallel:result is None
2024-03-24T11:24:01.344 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com
2024-03-24T11:24:01.344 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-24T11:24:01.374 INFO:teuthology.lock.ops:Checking smithi162.front.sepia.ceph.com
2024-03-24T11:24:01.375 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-24T11:24:01.400 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server
2024-03-24T11:24:01.401 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com'
2024-03-24T11:24:01.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T11:24:01.486 DEBUG:teuthology.orchestra.run.smithi161:> true
2024-03-24T11:24:01.552 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com'
2024-03-24T11:24:01.552 DEBUG:teuthology.orchestra.run.smithi161:> uname -m
2024-03-24T11:24:01.607 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64
2024-03-24T11:24:01.607 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release
2024-03-24T11:24:01.662 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream"
2024-03-24T11:24:01.663 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="9"
2024-03-24T11:24:01.663 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos"
2024-03-24T11:24:01.663 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora"
2024-03-24T11:24:01.663 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="9"
2024-03-24T11:24:01.663 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el9"
2024-03-24T11:24:01.663 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-24T11:24:01.663 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31"
2024-03-24T11:24:01.663 INFO:teuthology.orchestra.run.smithi161.stdout:LOGO="fedora-logo-icon"
2024-03-24T11:24:01.664 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-24T11:24:01.664 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/"
2024-03-24T11:24:01.664 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-24T11:24:01.664 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-24T11:24:01.664 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-24T11:24:01.664 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server
2024-03-24T11:24:01.700 INFO:teuthology.lock.ops:Updating [smithi162.front.sepia.ceph.com]: set os type and version on server
2024-03-24T11:24:01.700 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com'
2024-03-24T11:24:01.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T11:24:01.828 DEBUG:teuthology.orchestra.run.smithi162:> true
2024-03-24T11:24:01.900 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com'
2024-03-24T11:24:01.900 DEBUG:teuthology.orchestra.run.smithi162:> uname -m
2024-03-24T11:24:01.954 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64
2024-03-24T11:24:01.954 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release
2024-03-24T11:24:02.006 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="CentOS Stream"
2024-03-24T11:24:02.006 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="9"
2024-03-24T11:24:02.007 INFO:teuthology.orchestra.run.smithi162.stdout:ID="centos"
2024-03-24T11:24:02.007 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="rhel fedora"
2024-03-24T11:24:02.007 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="9"
2024-03-24T11:24:02.007 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el9"
2024-03-24T11:24:02.007 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-24T11:24:02.007 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31"
2024-03-24T11:24:02.007 INFO:teuthology.orchestra.run.smithi162.stdout:LOGO="fedora-logo-icon"
2024-03-24T11:24:02.007 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-24T11:24:02.007 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://centos.org/"
2024-03-24T11:24:02.007 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-24T11:24:02.007 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-24T11:24:02.007 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-24T11:24:02.008 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server
2024-03-24T11:24:02.033 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T11:24:02.136 INFO:teuthology.dispatcher.supervisor:Running job 7617926
2024-03-24T11:24:02.136 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-03-22_21:08:02-orch-squid-distro-default-smithi/7617926 --name teuthology-2024-03-22_21:08:02-orch-squid-distro-default-smithi --description orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/teuthology-2024-03-22_21:08:02-orch-squid-distro-default-smithi/7617926/orig.config.yaml
2024-03-24T11:24:02.140 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-03-22_21:08:02-orch-squid-distro-default-smithi/7617926
2024-03-24T11:24:02.140 INFO:teuthology.dispatcher.supervisor:Job PID: 4178728
2024-03-24T11:24:02.140 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-24T11:26:02.240 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T11:28:02.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T11:30:02.595 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T11:32:02.769 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T11:34:02.944 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T11:36:03.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T11:38:03.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T11:40:03.459 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T11:42:03.642 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T11:44:03.817 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T11:46:04.000 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T11:48:04.172 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T11:50:04.500 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T11:52:04.677 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T11:54:04.846 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T11:56:05.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T11:58:05.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T12:00:05.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T12:02:05.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T12:04:05.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T12:06:05.818 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T12:08:05.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T12:10:06.240 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T12:12:06.404 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T12:14:06.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T12:16:06.770 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T12:18:06.932 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T12:20:07.070 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T12:22:07.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T12:24:07.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T12:26:07.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T12:28:07.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T12:30:07.946 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T12:32:08.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T12:34:08.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T12:36:08.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T12:38:08.721 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T12:40:08.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T12:42:09.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T12:44:09.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T12:46:09.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T12:48:09.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T12:50:09.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T12:52:09.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T12:54:10.103 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T12:56:10.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T12:58:10.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T13:00:10.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T13:02:10.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T13:04:10.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T13:06:11.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T13:08:11.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T13:10:11.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T13:12:11.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T13:14:11.873 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T13:16:12.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T13:18:12.222 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T13:20:12.399 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T13:22:12.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T13:24:12.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T13:26:12.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T13:28:13.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T13:30:13.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T13:32:13.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T13:34:13.620 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T13:36:13.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T13:38:13.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T13:40:14.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T13:42:14.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T13:44:14.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T13:46:14.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T13:48:14.848 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T13:50:15.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T13:52:15.201 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T13:54:15.365 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T13:56:15.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T13:58:15.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T14:00:15.872 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T14:02:16.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T14:04:16.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T14:06:16.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T14:08:16.553 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T14:10:16.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T14:12:16.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T14:14:17.072 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T14:16:17.246 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T14:18:17.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T14:20:17.572 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T14:22:17.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T14:24:17.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T14:26:18.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T14:28:18.184 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T14:30:18.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T14:32:18.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T14:34:18.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T14:36:18.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T14:38:19.001 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T14:40:19.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T14:42:19.329 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T14:44:19.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T14:46:19.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T14:48:19.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T14:50:19.976 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T14:52:20.146 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T14:54:20.323 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T14:56:20.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T14:58:20.654 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T15:00:20.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T15:02:21.004 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T15:04:21.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T15:06:21.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T15:08:21.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T15:08:21.571 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1