2024-04-02T04:53:57.715 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-04-02T04:53:57.716 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T04:53:57.850 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f849fdb4f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f84a0e15c10>, signals=[15])
2024-04-02T04:53:57.850 INFO:teuthology.lock.ops:Start node 'smithi040.front.sepia.ceph.com' reimaging
2024-04-02T04:53:57.851 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: reset os type and version on server
2024-04-02T04:53:57.851 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server
2024-04-02T04:53:57.871 INFO:teuthology.lock.ops:Start node 'smithi123.front.sepia.ceph.com' reimaging
2024-04-02T04:53:57.871 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: reset os type and version on server
2024-04-02T04:53:57.872 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server
2024-04-02T04:53:57.988 DEBUG:teuthology.provision.fog.smithi040:Requesting image smithi_centos_9.stream (ID 10)
2024-04-02T04:53:58.011 DEBUG:teuthology.provision.fog.smithi123:Requesting image smithi_centos_9.stream (ID 10)
2024-04-02T04:53:58.029 INFO:teuthology.provision.fog.smithi040:Scheduling deploy of centos 9.stream
2024-04-02T04:53:58.047 INFO:teuthology.provision.fog.smithi123:Scheduling deploy of centos 9.stream
2024-04-02T04:53:58.269 INFO:teuthology.orchestra.console.smithi040:Power off
2024-04-02T04:53:58.270 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-02T04:53:58.282 INFO:teuthology.orchestra.console.smithi123:Power off
2024-04-02T04:53:58.283 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-02T04:53:58.292 DEBUG:teuthology.orchestra.console.smithi040:power off output: Chassis Power Control: Down/Off
2024-04-02T04:53:58.293 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-02T04:53:58.303 DEBUG:teuthology.orchestra.console.smithi123:power off output: Chassis Power Control: Down/Off
2024-04-02T04:53:58.303 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-02T04:53:58.313 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on
2024-04-02T04:53:58.324 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on
2024-04-02T04:54:02.318 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-02T04:54:02.325 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-02T04:54:02.428 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on
2024-04-02T04:54:02.434 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on
2024-04-02T04:54:06.434 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-02T04:54:06.440 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-02T04:54:06.543 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on
2024-04-02T04:54:06.548 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on
2024-04-02T04:54:10.546 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-02T04:54:10.553 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-02T04:54:10.656 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off
2024-04-02T04:54:10.661 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off
2024-04-02T04:54:10.757 INFO:teuthology.orchestra.console.smithi040:Power off completed
2024-04-02T04:54:10.762 INFO:teuthology.orchestra.console.smithi123:Power off completed
2024-04-02T04:54:10.858 INFO:teuthology.orchestra.console.smithi040:Power on
2024-04-02T04:54:10.858 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-02T04:54:10.866 INFO:teuthology.orchestra.console.smithi123:Power on
2024-04-02T04:54:10.866 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-02T04:54:10.883 DEBUG:teuthology.orchestra.console.smithi040:power on output: Chassis Power Control: Up/On
2024-04-02T04:54:10.883 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-02T04:54:10.891 DEBUG:teuthology.orchestra.console.smithi123:power on output: Chassis Power Control: Up/On
2024-04-02T04:54:10.891 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-02T04:54:10.904 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off
2024-04-02T04:54:10.913 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off
2024-04-02T04:54:14.906 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-02T04:54:14.914 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-02T04:54:15.016 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on
2024-04-02T04:54:15.021 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on
2024-04-02T04:54:15.118 INFO:teuthology.orchestra.console.smithi040:Power on completed
2024-04-02T04:54:15.122 INFO:teuthology.orchestra.console.smithi123:Power on completed
2024-04-02T04:54:15.219 INFO:teuthology.provision.fog.smithi040:Waiting for deploy to finish
2024-04-02T04:54:15.223 INFO:teuthology.provision.fog.smithi123:Waiting for deploy to finish
2024-04-02T04:56:45.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T04:56:49.023 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40
2024-04-02T04:56:55.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T04:56:58.110 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40
2024-04-02T04:57:00.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T04:57:04.062 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2024-04-02T04:57:04.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T04:57:07.170 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40
2024-04-02T04:57:10.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T04:57:13.118 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2024-04-02T04:57:13.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T04:57:16.226 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40
2024-04-02T04:57:19.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T04:57:22.174 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2024-04-02T04:57:22.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T04:57:25.282 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40
2024-04-02T04:57:28.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T04:57:31.230 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2024-04-02T04:57:31.283 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T04:57:34.334 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40
2024-04-02T04:57:37.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T04:57:40.286 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2024-04-02T04:57:40.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T04:57:46.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T04:57:49.342 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2024-04-02T04:57:55.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T04:58:40.383 WARNING:teuthology.provision.fog.smithi040:timed out
2024-04-02T04:58:46.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T04:58:46.633 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-02T04:58:46.634 DEBUG:teuthology.orchestra.run.smithi040:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-02T04:58:47.035 INFO:teuthology.provision.fog.smithi040:Node is ready
2024-04-02T04:58:47.036 DEBUG:teuthology.orchestra.run.smithi040:> hostname
2024-04-02T04:58:47.051 INFO:teuthology.orchestra.run.smithi040.stdout:smithi040.front.sepia.ceph.com
2024-04-02T04:58:47.051 DEBUG:teuthology.orchestra.run.smithi040:> grep smithi040.front.sepia.ceph.com /etc/hosts
2024-04-02T04:58:47.109 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40 smithi040.front.sepia.ceph.com smithi040
2024-04-02T04:58:47.110 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040
2024-04-02T04:58:47.229 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hosts
2024-04-02T04:58:47.262 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/172.21.15.40/172.21.15.40/g' /etc/hosts
2024-04-02T04:58:47.333 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hostname
2024-04-02T04:58:47.405 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040
2024-04-02T04:58:47.476 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release
2024-04-02T04:58:47.532 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream"
2024-04-02T04:58:47.532 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="9"
2024-04-02T04:58:47.532 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos"
2024-04-02T04:58:47.532 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora"
2024-04-02T04:58:47.532 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="9"
2024-04-02T04:58:47.532 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el9"
2024-04-02T04:58:47.532 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-02T04:58:47.532 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31"
2024-04-02T04:58:47.532 INFO:teuthology.orchestra.run.smithi040.stdout:LOGO="fedora-logo-icon"
2024-04-02T04:58:47.532 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-02T04:58:47.532 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/"
2024-04-02T04:58:47.533 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-02T04:58:47.533 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-02T04:58:47.533 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-02T04:58:47.533 INFO:teuthology.provision.fog.smithi040:Deploy complete!
2024-04-02T04:58:47.535 DEBUG:teuthology.parallel:result is None
2024-04-02T04:58:55.354 WARNING:teuthology.provision.fog.smithi123:timed out
2024-04-02T04:59:01.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T04:59:01.575 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-02T04:59:01.575 DEBUG:teuthology.orchestra.run.smithi123:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-02T04:59:01.900 INFO:teuthology.provision.fog.smithi123:Node is ready
2024-04-02T04:59:01.900 DEBUG:teuthology.orchestra.run.smithi123:> hostname
2024-04-02T04:59:01.917 INFO:teuthology.orchestra.run.smithi123.stdout:smithi123.front.sepia.ceph.com
2024-04-02T04:59:01.917 DEBUG:teuthology.orchestra.run.smithi123:> grep smithi123.front.sepia.ceph.com /etc/hosts
2024-04-02T04:59:01.974 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123 smithi123.front.sepia.ceph.com smithi123
2024-04-02T04:59:01.974 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123
2024-04-02T04:59:02.079 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123.front.sepia.ceph.com/smithi123/g' /etc/hosts
2024-04-02T04:59:02.111 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/172.21.15.123/172.21.15.123/g' /etc/hosts
2024-04-02T04:59:02.184 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123.front.sepia.ceph.com/smithi123/g' /etc/hostname
2024-04-02T04:59:02.255 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123
2024-04-02T04:59:02.326 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release
2024-04-02T04:59:02.382 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="CentOS Stream"
2024-04-02T04:59:02.382 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="9"
2024-04-02T04:59:02.382 INFO:teuthology.orchestra.run.smithi123.stdout:ID="centos"
2024-04-02T04:59:02.382 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="rhel fedora"
2024-04-02T04:59:02.383 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="9"
2024-04-02T04:59:02.383 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el9"
2024-04-02T04:59:02.383 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-02T04:59:02.383 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31"
2024-04-02T04:59:02.383 INFO:teuthology.orchestra.run.smithi123.stdout:LOGO="fedora-logo-icon"
2024-04-02T04:59:02.383 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-02T04:59:02.383 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://centos.org/"
2024-04-02T04:59:02.383 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-02T04:59:02.383 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-02T04:59:02.383 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-02T04:59:02.383 INFO:teuthology.provision.fog.smithi123:Deploy complete!
2024-04-02T04:59:02.384 DEBUG:teuthology.parallel:result is None
2024-04-02T04:59:02.557 INFO:teuthology.lock.ops:Checking smithi040.front.sepia.ceph.com
2024-04-02T04:59:02.557 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-02T04:59:02.583 INFO:teuthology.lock.ops:Checking smithi123.front.sepia.ceph.com
2024-04-02T04:59:02.584 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-02T04:59:02.601 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: set os type and version on server
2024-04-02T04:59:02.601 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com'
2024-04-02T04:59:02.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T04:59:02.703 DEBUG:teuthology.orchestra.run.smithi040:> true
2024-04-02T04:59:02.880 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com'
2024-04-02T04:59:02.880 DEBUG:teuthology.orchestra.run.smithi040:> uname -m
2024-04-02T04:59:02.935 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64
2024-04-02T04:59:02.936 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release
2024-04-02T04:59:02.991 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream"
2024-04-02T04:59:02.991 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="9"
2024-04-02T04:59:02.991 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos"
2024-04-02T04:59:02.991 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora"
2024-04-02T04:59:02.991 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="9"
2024-04-02T04:59:02.991 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el9"
2024-04-02T04:59:02.991 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-02T04:59:02.991 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31"
2024-04-02T04:59:02.991 INFO:teuthology.orchestra.run.smithi040.stdout:LOGO="fedora-logo-icon"
2024-04-02T04:59:02.991 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-02T04:59:02.991 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/"
2024-04-02T04:59:02.991 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-02T04:59:02.992 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-02T04:59:02.992 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-02T04:59:02.992 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server
2024-04-02T04:59:03.016 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: set os type and version on server
2024-04-02T04:59:03.017 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com'
2024-04-02T04:59:03.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T04:59:03.104 DEBUG:teuthology.orchestra.run.smithi123:> true
2024-04-02T04:59:03.175 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com'
2024-04-02T04:59:03.175 DEBUG:teuthology.orchestra.run.smithi123:> uname -m
2024-04-02T04:59:03.230 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64
2024-04-02T04:59:03.230 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release
2024-04-02T04:59:03.284 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="CentOS Stream"
2024-04-02T04:59:03.284 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="9"
2024-04-02T04:59:03.284 INFO:teuthology.orchestra.run.smithi123.stdout:ID="centos"
2024-04-02T04:59:03.284 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="rhel fedora"
2024-04-02T04:59:03.284 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="9"
2024-04-02T04:59:03.284 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el9"
2024-04-02T04:59:03.284 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-02T04:59:03.284 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31"
2024-04-02T04:59:03.285 INFO:teuthology.orchestra.run.smithi123.stdout:LOGO="fedora-logo-icon"
2024-04-02T04:59:03.285 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-02T04:59:03.285 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://centos.org/"
2024-04-02T04:59:03.285 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-02T04:59:03.285 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-02T04:59:03.285 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-02T04:59:03.285 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server
2024-04-02T04:59:03.308 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T04:59:03.421 INFO:teuthology.dispatcher.supervisor:Running job 7634894
2024-04-02T04:59:03.421 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-01_21:08:08-orch-squid-distro-default-smithi/7634894 --name teuthology-2024-04-01_21:08:08-orch-squid-distro-default-smithi --description orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/teuthology-2024-04-01_21:08:08-orch-squid-distro-default-smithi/7634894/orig.config.yaml
2024-04-02T04:59:03.424 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-01_21:08:08-orch-squid-distro-default-smithi/7634894
2024-04-02T04:59:03.424 INFO:teuthology.dispatcher.supervisor:Job PID: 2528716
2024-04-02T04:59:03.425 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-04-02T05:01:03.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T05:03:03.692 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T05:05:03.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T05:07:04.024 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T05:09:04.196 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T05:11:04.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T05:13:04.541 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T05:15:04.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T05:17:04.897 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T05:19:05.059 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T05:21:05.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T05:23:05.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T05:25:05.538 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T05:27:05.702 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T05:29:05.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T05:31:06.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T05:33:06.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T05:35:06.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T05:37:06.521 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T05:39:06.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T05:41:06.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T05:43:07.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T05:45:07.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T05:47:07.376 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T05:49:07.521 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T05:51:07.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T05:53:07.866 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T05:55:08.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T05:57:08.192 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T05:59:08.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T06:01:08.533 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T06:03:08.678 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T06:05:08.846 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T06:07:09.006 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T06:09:09.172 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T06:11:09.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T06:13:09.516 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T06:15:09.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T06:17:09.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T06:19:10.045 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T06:21:10.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T06:23:10.371 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T06:25:10.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T06:27:10.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T06:29:10.897 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T06:31:11.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T06:33:11.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T06:35:11.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T06:37:11.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T06:39:11.744 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T06:41:11.893 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T06:43:12.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T06:45:12.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T06:47:12.380 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T06:49:12.546 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T06:51:12.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T06:53:12.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T06:55:13.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T06:57:13.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T06:59:13.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T07:01:13.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T07:03:13.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T07:05:13.890 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T07:07:14.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T07:09:14.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T07:11:14.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T07:13:14.577 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T07:15:14.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T07:17:14.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T07:19:15.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T07:21:15.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T07:23:15.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T07:25:15.642 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T07:27:15.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T07:29:15.940 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T07:31:16.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T07:33:16.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T07:35:16.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T07:37:16.615 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T07:39:16.774 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T07:41:16.940 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T07:43:17.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T07:45:17.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T07:47:17.453 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T07:49:17.561 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T07:51:17.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T07:53:17.897 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T07:55:18.069 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T07:57:18.243 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T07:59:18.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T08:01:18.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T08:03:18.760 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T08:05:18.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T08:07:19.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T08:09:19.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T08:11:19.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T08:13:19.610 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T08:15:19.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T08:17:19.974 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T08:19:20.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T08:21:20.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T08:23:20.486 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T08:25:20.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T08:27:20.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T08:29:21.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T08:31:21.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T08:33:21.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T08:35:21.536 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T08:37:21.704 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T08:39:21.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T08:41:22.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T08:43:22.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T08:45:22.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T08:47:22.550 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T08:47:22.617 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1