2024-03-18T11:09:37.434 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-18T11:09:37.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T11:09:37.587 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f5bd37a2f70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f5bd4803c10>, signals=[15])
2024-03-18T11:09:37.588 INFO:teuthology.lock.ops:Start node 'smithi094.front.sepia.ceph.com' reimaging
2024-03-18T11:09:37.589 INFO:teuthology.lock.ops:Updating [smithi094.front.sepia.ceph.com]: reset os type and version on server
2024-03-18T11:09:37.589 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server
2024-03-18T11:09:37.613 INFO:teuthology.lock.ops:Start node 'smithi155.front.sepia.ceph.com' reimaging
2024-03-18T11:09:37.614 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: reset os type and version on server
2024-03-18T11:09:37.614 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server
2024-03-18T11:09:37.731 DEBUG:teuthology.provision.fog.smithi094:Requesting image smithi_centos_9.stream (ID 10)
2024-03-18T11:09:37.752 DEBUG:teuthology.provision.fog.smithi155:Requesting image smithi_centos_9.stream (ID 10)
2024-03-18T11:09:37.775 INFO:teuthology.provision.fog.smithi094:Scheduling deploy of centos 9.stream
2024-03-18T11:09:37.799 INFO:teuthology.provision.fog.smithi155:Scheduling deploy of centos 9.stream
2024-03-18T11:09:38.108 INFO:teuthology.orchestra.console.smithi155:Power off
2024-03-18T11:09:38.108 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-18T11:09:38.122 INFO:teuthology.orchestra.console.smithi094:Power off
2024-03-18T11:09:38.122 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-18T11:09:38.133 DEBUG:teuthology.orchestra.console.smithi155:power off output: Chassis Power Control: Down/Off
2024-03-18T11:09:38.133 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-18T11:09:38.149 DEBUG:teuthology.orchestra.console.smithi094:power off output: Chassis Power Control: Down/Off
2024-03-18T11:09:38.149 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-18T11:09:38.160 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on
2024-03-18T11:09:38.173 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on
2024-03-18T11:09:42.162 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-18T11:09:42.174 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-18T11:09:42.273 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on
2024-03-18T11:09:42.283 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on
2024-03-18T11:09:46.274 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-18T11:09:46.284 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-18T11:09:46.384 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off
2024-03-18T11:09:46.392 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on
2024-03-18T11:09:46.486 INFO:teuthology.orchestra.console.smithi155:Power off completed
2024-03-18T11:09:46.586 INFO:teuthology.orchestra.console.smithi155:Power on
2024-03-18T11:09:46.586 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-18T11:09:46.608 DEBUG:teuthology.orchestra.console.smithi155:power on output: Chassis Power Control: Up/On
2024-03-18T11:09:46.609 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-18T11:09:46.630 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off
2024-03-18T11:09:50.397 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-18T11:09:50.506 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off
2024-03-18T11:09:50.607 INFO:teuthology.orchestra.console.smithi094:Power off completed
2024-03-18T11:09:50.631 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-18T11:09:50.708 INFO:teuthology.orchestra.console.smithi094:Power on
2024-03-18T11:09:50.709 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-18T11:09:50.733 DEBUG:teuthology.orchestra.console.smithi094:power on output: Chassis Power Control: Up/On
2024-03-18T11:09:50.734 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-18T11:09:50.744 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off
2024-03-18T11:09:50.756 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off
2024-03-18T11:09:54.746 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-18T11:09:54.757 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-18T11:09:54.866 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on
2024-03-18T11:09:54.897 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on
2024-03-18T11:09:54.968 INFO:teuthology.orchestra.console.smithi094:Power on completed
2024-03-18T11:09:54.998 INFO:teuthology.orchestra.console.smithi155:Power on completed
2024-03-18T11:09:55.069 INFO:teuthology.provision.fog.smithi094:Waiting for deploy to finish
2024-03-18T11:09:55.099 INFO:teuthology.provision.fog.smithi155:Waiting for deploy to finish
2024-03-18T11:12:40.977 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T11:12:40.981 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T11:12:59.423 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94
2024-03-18T11:12:59.423 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155
2024-03-18T11:13:05.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T11:13:05.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T11:13:08.510 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94
2024-03-18T11:13:08.511 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155
2024-03-18T11:13:14.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T11:13:14.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T11:13:17.598 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94
2024-03-18T11:13:17.599 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155
2024-03-18T11:13:23.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T11:13:23.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T11:13:26.686 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155
2024-03-18T11:13:26.687 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94
2024-03-18T11:13:32.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T11:13:32.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T11:14:32.745 WARNING:teuthology.provision.fog.smithi155:timed out
2024-03-18T11:14:32.746 WARNING:teuthology.provision.fog.smithi094:timed out
2024-03-18T11:14:38.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T11:14:38.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T11:14:39.102 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-18T11:14:39.102 DEBUG:teuthology.orchestra.run.smithi094:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-18T11:14:39.129 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-18T11:14:39.130 DEBUG:teuthology.orchestra.run.smithi155:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-18T11:14:39.433 INFO:teuthology.provision.fog.smithi094:Node is ready
2024-03-18T11:14:39.434 DEBUG:teuthology.orchestra.run.smithi094:> hostname
2024-03-18T11:14:39.448 INFO:teuthology.orchestra.run.smithi094.stdout:smithi094.front.sepia.ceph.com
2024-03-18T11:14:39.448 DEBUG:teuthology.orchestra.run.smithi094:> grep smithi094.front.sepia.ceph.com /etc/hosts
2024-03-18T11:14:39.474 INFO:teuthology.provision.fog.smithi155:Node is ready
2024-03-18T11:14:39.474 DEBUG:teuthology.orchestra.run.smithi155:> hostname
2024-03-18T11:14:39.489 INFO:teuthology.orchestra.run.smithi155.stdout:smithi155.front.sepia.ceph.com
2024-03-18T11:14:39.489 DEBUG:teuthology.orchestra.run.smithi155:> grep smithi155.front.sepia.ceph.com /etc/hosts
2024-03-18T11:14:39.506 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.15.94 smithi094.front.sepia.ceph.com smithi094
2024-03-18T11:14:39.507 DEBUG:teuthology.orchestra.run.smithi094:> sudo hostname smithi094
2024-03-18T11:14:39.545 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155 smithi155.front.sepia.ceph.com smithi155
2024-03-18T11:14:39.545 DEBUG:teuthology.orchestra.run.smithi155:> sudo hostname smithi155
2024-03-18T11:14:39.617 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i -e 's/smithi094.front.sepia.ceph.com/smithi094/g' /etc/hosts
2024-03-18T11:14:39.643 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i -e 's/172.21.15.94/172.21.15.94/g' /etc/hosts
2024-03-18T11:14:39.654 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/smithi155.front.sepia.ceph.com/smithi155/g' /etc/hosts
2024-03-18T11:14:39.682 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/172.21.15.155/172.21.15.155/g' /etc/hosts
2024-03-18T11:14:39.714 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i -e 's/smithi094.front.sepia.ceph.com/smithi094/g' /etc/hostname
2024-03-18T11:14:39.750 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/smithi155.front.sepia.ceph.com/smithi155/g' /etc/hostname
2024-03-18T11:14:39.784 DEBUG:teuthology.orchestra.run.smithi094:> sudo hostname smithi094
2024-03-18T11:14:39.817 DEBUG:teuthology.orchestra.run.smithi155:> sudo hostname smithi155
2024-03-18T11:14:39.854 DEBUG:teuthology.orchestra.run.smithi094:> cat /etc/os-release
2024-03-18T11:14:39.883 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release
2024-03-18T11:14:39.913 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="CentOS Stream"
2024-03-18T11:14:39.913 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="9"
2024-03-18T11:14:39.914 INFO:teuthology.orchestra.run.smithi094.stdout:ID="centos"
2024-03-18T11:14:39.914 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE="rhel fedora"
2024-03-18T11:14:39.914 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="9"
2024-03-18T11:14:39.915 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM_ID="platform:el9"
2024-03-18T11:14:39.915 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-18T11:14:39.916 INFO:teuthology.orchestra.run.smithi094.stdout:ANSI_COLOR="0;31"
2024-03-18T11:14:39.916 INFO:teuthology.orchestra.run.smithi094.stdout:LOGO="fedora-logo-icon"
2024-03-18T11:14:39.916 INFO:teuthology.orchestra.run.smithi094.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-18T11:14:39.916 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://centos.org/"
2024-03-18T11:14:39.916 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-18T11:14:39.916 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-18T11:14:39.917 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-18T11:14:39.918 INFO:teuthology.provision.fog.smithi094:Deploy complete!
2024-03-18T11:14:39.920 DEBUG:teuthology.parallel:result is None
2024-03-18T11:14:39.938 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="CentOS Stream"
2024-03-18T11:14:39.938 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="9"
2024-03-18T11:14:39.938 INFO:teuthology.orchestra.run.smithi155.stdout:ID="centos"
2024-03-18T11:14:39.938 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="rhel fedora"
2024-03-18T11:14:39.938 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="9"
2024-03-18T11:14:39.938 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el9"
2024-03-18T11:14:39.939 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-18T11:14:39.939 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31"
2024-03-18T11:14:39.939 INFO:teuthology.orchestra.run.smithi155.stdout:LOGO="fedora-logo-icon"
2024-03-18T11:14:39.939 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-18T11:14:39.939 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://centos.org/"
2024-03-18T11:14:39.939 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-18T11:14:39.939 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-18T11:14:39.939 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-18T11:14:39.939 INFO:teuthology.provision.fog.smithi155:Deploy complete!
2024-03-18T11:14:39.940 DEBUG:teuthology.parallel:result is None
2024-03-18T11:14:40.100 INFO:teuthology.lock.ops:Checking smithi094.front.sepia.ceph.com
2024-03-18T11:14:40.100 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-18T11:14:40.134 INFO:teuthology.lock.ops:Checking smithi155.front.sepia.ceph.com
2024-03-18T11:14:40.134 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-18T11:14:40.151 INFO:teuthology.lock.ops:Updating [smithi094.front.sepia.ceph.com]: set os type and version on server
2024-03-18T11:14:40.151 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com'
2024-03-18T11:14:40.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T11:14:40.243 DEBUG:teuthology.orchestra.run.smithi094:> true
2024-03-18T11:14:40.308 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi094.front.sepia.ceph.com'
2024-03-18T11:14:40.308 DEBUG:teuthology.orchestra.run.smithi094:> uname -m
2024-03-18T11:14:40.365 INFO:teuthology.orchestra.run.smithi094.stdout:x86_64
2024-03-18T11:14:40.366 DEBUG:teuthology.orchestra.run.smithi094:> cat /etc/os-release
2024-03-18T11:14:40.423 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="CentOS Stream"
2024-03-18T11:14:40.424 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="9"
2024-03-18T11:14:40.424 INFO:teuthology.orchestra.run.smithi094.stdout:ID="centos"
2024-03-18T11:14:40.424 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE="rhel fedora"
2024-03-18T11:14:40.424 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="9"
2024-03-18T11:14:40.424 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM_ID="platform:el9"
2024-03-18T11:14:40.424 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-18T11:14:40.424 INFO:teuthology.orchestra.run.smithi094.stdout:ANSI_COLOR="0;31"
2024-03-18T11:14:40.424 INFO:teuthology.orchestra.run.smithi094.stdout:LOGO="fedora-logo-icon"
2024-03-18T11:14:40.424 INFO:teuthology.orchestra.run.smithi094.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-18T11:14:40.424 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://centos.org/"
2024-03-18T11:14:40.424 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-18T11:14:40.424 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-18T11:14:40.425 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-18T11:14:40.425 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server
2024-03-18T11:14:40.451 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: set os type and version on server
2024-03-18T11:14:40.451 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com'
2024-03-18T11:14:40.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T11:14:40.538 DEBUG:teuthology.orchestra.run.smithi155:> true
2024-03-18T11:14:40.608 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com'
2024-03-18T11:14:40.608 DEBUG:teuthology.orchestra.run.smithi155:> uname -m
2024-03-18T11:14:40.663 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64
2024-03-18T11:14:40.663 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release
2024-03-18T11:14:40.718 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="CentOS Stream"
2024-03-18T11:14:40.718 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="9"
2024-03-18T11:14:40.718 INFO:teuthology.orchestra.run.smithi155.stdout:ID="centos"
2024-03-18T11:14:40.718 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="rhel fedora"
2024-03-18T11:14:40.718 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="9"
2024-03-18T11:14:40.718 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el9"
2024-03-18T11:14:40.718 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-18T11:14:40.718 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31"
2024-03-18T11:14:40.718 INFO:teuthology.orchestra.run.smithi155.stdout:LOGO="fedora-logo-icon"
2024-03-18T11:14:40.718 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-18T11:14:40.718 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://centos.org/"
2024-03-18T11:14:40.719 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-18T11:14:40.719 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-18T11:14:40.719 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-18T11:14:40.719 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server
2024-03-18T11:14:40.742 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T11:14:40.835 INFO:teuthology.dispatcher.supervisor:Running job 7604817
2024-03-18T11:14:40.836 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-03-15_21:08:03-orch-squid-distro-default-smithi/7604817 --name teuthology-2024-03-15_21:08:03-orch-squid-distro-default-smithi --description orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/teuthology-2024-03-15_21:08:03-orch-squid-distro-default-smithi/7604817/orig.config.yaml
2024-03-18T11:14:40.838 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-03-15_21:08:03-orch-squid-distro-default-smithi/7604817
2024-03-18T11:14:40.839 INFO:teuthology.dispatcher.supervisor:Job PID: 84174
2024-03-18T11:14:40.839 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-18T11:16:40.938 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T11:18:41.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T11:20:41.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T11:22:41.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T11:24:41.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T11:26:41.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T11:28:42.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T11:30:42.170 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T11:32:42.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T11:34:42.516 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T11:36:42.669 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T11:38:42.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T11:40:43.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T11:42:43.196 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T11:44:43.361 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T11:46:43.532 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T11:48:43.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T11:50:43.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T11:52:44.061 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T11:54:44.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T11:56:44.406 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T11:58:44.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T12:00:44.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T12:02:44.922 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T12:04:45.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T12:06:45.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T12:08:45.456 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T12:10:45.631 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T12:12:45.788 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T12:14:45.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T12:16:46.133 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T12:18:46.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T12:20:46.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T12:22:46.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T12:24:46.856 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T12:26:47.026 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T12:28:47.200 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T12:30:47.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T12:32:48.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T12:34:48.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T12:36:48.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T12:38:48.614 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T12:40:48.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T12:42:48.940 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T12:44:49.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T12:46:49.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T12:48:49.420 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T12:50:49.591 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T12:52:49.750 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T12:54:49.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T12:56:50.091 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T12:58:50.243 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T13:00:50.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T13:02:50.606 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T13:04:50.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T13:06:50.917 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T13:08:51.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T13:10:51.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T13:12:51.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T13:14:51.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T13:16:51.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T13:18:51.844 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T13:20:52.008 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T13:22:52.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T13:24:52.326 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T13:26:52.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T13:28:52.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T13:30:52.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T13:32:52.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T13:34:52.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T13:36:53.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T13:38:53.270 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T13:40:53.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T13:42:53.604 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T13:44:53.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T13:46:53.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T13:48:54.108 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T13:50:54.239 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T13:52:54.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T13:54:54.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T13:56:54.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T13:58:54.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T14:00:55.078 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T14:02:55.180 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T14:04:55.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T14:06:55.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T14:08:55.700 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T14:10:55.870 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T14:12:55.942 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T14:14:56.074 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T14:16:56.237 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T14:18:56.320 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T14:20:56.426 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T14:22:56.518 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T14:24:56.640 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T14:26:56.906 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T14:28:57.141 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T14:30:57.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T14:32:57.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T14:34:57.646 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T14:36:57.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T14:38:57.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T14:40:58.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T14:42:58.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T14:44:58.506 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T14:46:58.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T14:48:58.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T14:50:58.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T14:50:59.052 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-03-18T14:50:59.245 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi094 but it was locked by another job: /home/teuthworker/archive/pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608856
2024-03-18T14:50:59.246 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi155 but it was locked by another job: /home/teuthworker/archive/pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608859