2024-03-19T07:46:07.499 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-19T07:46:07.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:46:07.637 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f35987a8f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f3599747c10>, signals=[15])
2024-03-19T07:46:07.638 INFO:teuthology.lock.ops:Start node 'smithi107.front.sepia.ceph.com' reimaging
2024-03-19T07:46:07.638 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: reset os type and version on server
2024-03-19T07:46:07.638 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server
2024-03-19T07:46:07.664 INFO:teuthology.lock.ops:Start node 'smithi191.front.sepia.ceph.com' reimaging
2024-03-19T07:46:07.664 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: reset os type and version on server
2024-03-19T07:46:07.664 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server
2024-03-19T07:46:07.777 DEBUG:teuthology.provision.fog.smithi107:Requesting image smithi_centos_9.stream (ID 10)
2024-03-19T07:46:07.793 DEBUG:teuthology.provision.fog.smithi191:Requesting image smithi_centos_9.stream (ID 10)
2024-03-19T07:46:07.829 INFO:teuthology.provision.fog.smithi107:Scheduling deploy of centos 9.stream
2024-03-19T07:46:07.832 INFO:teuthology.provision.fog.smithi191:Scheduling deploy of centos 9.stream
2024-03-19T07:46:08.067 INFO:teuthology.orchestra.console.smithi191:Power off
2024-03-19T07:46:08.067 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-19T07:46:08.081 INFO:teuthology.orchestra.console.smithi107:Power off
2024-03-19T07:46:08.081 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-19T07:46:08.090 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off
2024-03-19T07:46:08.090 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T07:46:08.102 DEBUG:teuthology.orchestra.console.smithi107:power off output: Chassis Power Control: Down/Off
2024-03-19T07:46:08.103 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T07:46:08.112 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on
2024-03-19T07:46:08.126 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off
2024-03-19T07:46:08.226 INFO:teuthology.orchestra.console.smithi107:Power off completed
2024-03-19T07:46:08.327 INFO:teuthology.orchestra.console.smithi107:Power on
2024-03-19T07:46:08.327 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-19T07:46:08.350 DEBUG:teuthology.orchestra.console.smithi107:power on output: Chassis Power Control: Up/On
2024-03-19T07:46:08.351 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T07:46:08.372 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off
2024-03-19T07:46:12.115 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T07:46:12.225 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on
2024-03-19T07:46:12.374 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T07:46:12.483 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off
2024-03-19T07:46:16.226 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T07:46:16.335 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off
2024-03-19T07:46:16.436 INFO:teuthology.orchestra.console.smithi191:Power off completed
2024-03-19T07:46:16.484 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T07:46:16.537 INFO:teuthology.orchestra.console.smithi191:Power on
2024-03-19T07:46:16.538 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-19T07:46:16.559 DEBUG:teuthology.orchestra.console.smithi191:power on output: Chassis Power Control: Up/On
2024-03-19T07:46:16.559 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T07:46:16.581 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off
2024-03-19T07:46:16.592 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on
2024-03-19T07:46:16.693 INFO:teuthology.orchestra.console.smithi107:Power on completed
2024-03-19T07:46:16.794 INFO:teuthology.provision.fog.smithi107:Waiting for deploy to finish
2024-03-19T07:46:20.585 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T07:46:20.694 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off
2024-03-19T07:46:24.698 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T07:46:24.807 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on
2024-03-19T07:46:24.908 INFO:teuthology.orchestra.console.smithi191:Power on completed
2024-03-19T07:46:25.008 INFO:teuthology.provision.fog.smithi191:Waiting for deploy to finish
2024-03-19T07:48:47.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:48:50.690 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2024-03-19T07:48:55.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:48:56.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:48:58.878 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2024-03-19T07:48:59.778 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2024-03-19T07:49:04.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:49:05.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:49:07.938 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2024-03-19T07:49:08.830 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2024-03-19T07:49:13.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:49:14.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:49:17.022 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2024-03-19T07:49:17.886 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2024-03-19T07:49:23.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:49:23.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:49:26.078 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2024-03-19T07:49:26.942 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2024-03-19T07:49:32.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:49:32.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:49:35.166 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2024-03-19T07:49:35.998 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2024-03-19T07:49:41.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:49:42.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:49:44.222 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2024-03-19T07:49:45.058 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2024-03-19T07:49:50.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:49:51.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:49:54.114 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2024-03-19T07:50:00.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:50:50.271 WARNING:teuthology.provision.fog.smithi191:timed out
2024-03-19T07:50:56.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:50:56.522 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-19T07:50:56.523 DEBUG:teuthology.orchestra.run.smithi191:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-19T07:50:56.855 INFO:teuthology.provision.fog.smithi191:Node is ready
2024-03-19T07:50:56.855 DEBUG:teuthology.orchestra.run.smithi191:> hostname
2024-03-19T07:50:56.869 INFO:teuthology.orchestra.run.smithi191.stdout:smithi191.front.sepia.ceph.com
2024-03-19T07:50:56.869 DEBUG:teuthology.orchestra.run.smithi191:> grep smithi191.front.sepia.ceph.com /etc/hosts
2024-03-19T07:50:56.924 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.15.191 smithi191.front.sepia.ceph.com smithi191
2024-03-19T07:50:56.925 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191
2024-03-19T07:50:57.024 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hosts
2024-03-19T07:50:57.051 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/172.21.15.191/172.21.15.191/g' /etc/hosts
2024-03-19T07:50:57.118 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hostname
2024-03-19T07:50:57.185 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191
2024-03-19T07:50:57.251 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release
2024-03-19T07:50:57.306 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream"
2024-03-19T07:50:57.306 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="9"
2024-03-19T07:50:57.306 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos"
2024-03-19T07:50:57.306 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora"
2024-03-19T07:50:57.306 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="9"
2024-03-19T07:50:57.306 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el9"
2024-03-19T07:50:57.306 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-19T07:50:57.306 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31"
2024-03-19T07:50:57.306 INFO:teuthology.orchestra.run.smithi191.stdout:LOGO="fedora-logo-icon"
2024-03-19T07:50:57.306 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-19T07:50:57.306 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/"
2024-03-19T07:50:57.306 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-19T07:50:57.307 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-19T07:50:57.307 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-19T07:50:57.307 INFO:teuthology.provision.fog.smithi191:Deploy complete!
2024-03-19T07:50:57.309 DEBUG:teuthology.parallel:result is None
2024-03-19T07:51:00.126 WARNING:teuthology.provision.fog.smithi107:timed out
2024-03-19T07:51:06.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:51:06.397 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-19T07:51:06.397 DEBUG:teuthology.orchestra.run.smithi107:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-19T07:51:06.714 INFO:teuthology.provision.fog.smithi107:Node is ready
2024-03-19T07:51:06.714 DEBUG:teuthology.orchestra.run.smithi107:> hostname
2024-03-19T07:51:06.729 INFO:teuthology.orchestra.run.smithi107.stdout:smithi107.front.sepia.ceph.com
2024-03-19T07:51:06.730 DEBUG:teuthology.orchestra.run.smithi107:> grep smithi107.front.sepia.ceph.com /etc/hosts
2024-03-19T07:51:06.786 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107 smithi107.front.sepia.ceph.com smithi107
2024-03-19T07:51:06.786 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107
2024-03-19T07:51:06.901 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hosts
2024-03-19T07:51:06.930 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/172.21.15.107/172.21.15.107/g' /etc/hosts
2024-03-19T07:51:06.995 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hostname
2024-03-19T07:51:07.063 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107
2024-03-19T07:51:07.130 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release
2024-03-19T07:51:07.185 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Stream"
2024-03-19T07:51:07.185 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="9"
2024-03-19T07:51:07.185 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos"
2024-03-19T07:51:07.185 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora"
2024-03-19T07:51:07.185 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="9"
2024-03-19T07:51:07.185 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el9"
2024-03-19T07:51:07.185 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-19T07:51:07.185 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31"
2024-03-19T07:51:07.185 INFO:teuthology.orchestra.run.smithi107.stdout:LOGO="fedora-logo-icon"
2024-03-19T07:51:07.185 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-19T07:51:07.186 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/"
2024-03-19T07:51:07.186 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-19T07:51:07.186 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-19T07:51:07.186 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-19T07:51:07.186 INFO:teuthology.provision.fog.smithi107:Deploy complete!
2024-03-19T07:51:07.186 DEBUG:teuthology.parallel:result is None
2024-03-19T07:51:07.368 INFO:teuthology.lock.ops:Checking smithi107.front.sepia.ceph.com
2024-03-19T07:51:07.368 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-19T07:51:07.392 INFO:teuthology.lock.ops:Checking smithi191.front.sepia.ceph.com
2024-03-19T07:51:07.392 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-19T07:51:07.409 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: set os type and version on server
2024-03-19T07:51:07.409 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com'
2024-03-19T07:51:07.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:51:07.496 DEBUG:teuthology.orchestra.run.smithi107:> true
2024-03-19T07:51:07.564 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com'
2024-03-19T07:51:07.564 DEBUG:teuthology.orchestra.run.smithi107:> uname -m
2024-03-19T07:51:07.616 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64
2024-03-19T07:51:07.616 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release
2024-03-19T07:51:07.668 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Stream"
2024-03-19T07:51:07.668 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="9"
2024-03-19T07:51:07.668 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos"
2024-03-19T07:51:07.668 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora"
2024-03-19T07:51:07.668 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="9"
2024-03-19T07:51:07.668 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el9"
2024-03-19T07:51:07.669 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-19T07:51:07.669 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31"
2024-03-19T07:51:07.669 INFO:teuthology.orchestra.run.smithi107.stdout:LOGO="fedora-logo-icon"
2024-03-19T07:51:07.669 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-19T07:51:07.669 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/"
2024-03-19T07:51:07.669 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-19T07:51:07.669 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-19T07:51:07.669 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-19T07:51:07.669 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server
2024-03-19T07:51:07.692 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: set os type and version on server
2024-03-19T07:51:07.692 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com'
2024-03-19T07:51:07.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:51:07.781 DEBUG:teuthology.orchestra.run.smithi191:> true
2024-03-19T07:51:07.952 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com'
2024-03-19T07:51:07.952 DEBUG:teuthology.orchestra.run.smithi191:> uname -m
2024-03-19T07:51:08.006 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64
2024-03-19T07:51:08.006 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release
2024-03-19T07:51:08.061 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream"
2024-03-19T07:51:08.061 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="9"
2024-03-19T07:51:08.061 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos"
2024-03-19T07:51:08.061 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora"
2024-03-19T07:51:08.061 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="9"
2024-03-19T07:51:08.061 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el9"
2024-03-19T07:51:08.061 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-19T07:51:08.061 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31"
2024-03-19T07:51:08.062 INFO:teuthology.orchestra.run.smithi191.stdout:LOGO="fedora-logo-icon"
2024-03-19T07:51:08.062 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-19T07:51:08.062 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/"
2024-03-19T07:51:08.062 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-19T07:51:08.062 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-19T07:51:08.062 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-19T07:51:08.062 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server
2024-03-19T07:51:08.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:51:08.175 INFO:teuthology.dispatcher.supervisor:Running job 7610612
2024-03-19T07:51:08.175 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-03-19_04:56:42-fs-wip-batrick-testing-20240318.181317-distro-default-smithi/7610612 --name pdonnell-2024-03-19_04:56:42-fs-wip-batrick-testing-20240318.181317-distro-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/pdonnell-2024-03-19_04:56:42-fs-wip-batrick-testing-20240318.181317-distro-default-smithi/7610612/orig.config.yaml
2024-03-19T07:51:08.177 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-03-19_04:56:42-fs-wip-batrick-testing-20240318.181317-distro-default-smithi/7610612
2024-03-19T07:51:08.178 INFO:teuthology.dispatcher.supervisor:Job PID: 837385
2024-03-19T07:51:08.178 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-19T07:53:08.276 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:55:08.442 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:57:08.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:59:08.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:01:08.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:03:09.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:05:09.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:07:09.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:09:09.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:11:09.781 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:13:10.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:15:10.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:17:10.370 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:19:10.522 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:21:10.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:23:10.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:25:11.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:27:11.236 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:29:11.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:31:11.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:33:11.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:35:11.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:37:12.103 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:39:12.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:41:12.990 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:43:13.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:45:13.304 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:47:13.484 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:49:13.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:51:13.842 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:53:14.009 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:55:14.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:57:14.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T08:59:14.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:01:14.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:03:14.913 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:05:15.072 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:07:15.243 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:09:15.418 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:11:15.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:13:15.782 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:15:15.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:17:16.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:19:16.323 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:21:16.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:23:16.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:25:16.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:27:17.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:29:17.192 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:31:17.371 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:33:17.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:35:17.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:37:17.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:39:18.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:41:18.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:43:18.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:45:18.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:47:18.826 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:49:18.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:51:19.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:53:19.330 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:55:19.507 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:57:19.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T09:59:19.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:01:20.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:03:20.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:05:20.338 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:07:20.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:09:20.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:11:20.840 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:13:21.012 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:15:21.173 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:17:21.342 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:19:21.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:21:21.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:23:21.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:25:22.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:27:22.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:29:22.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:31:22.534 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:33:22.686 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:35:22.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:37:23.005 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:39:23.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:41:23.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:43:23.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:45:23.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:47:23.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:49:24.013 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:51:24.188 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:53:24.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:55:24.516 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:57:24.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T10:59:24.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T11:01:25.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T11:03:25.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T11:05:25.350 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T11:07:25.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T11:09:25.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T11:11:25.858 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T11:13:26.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T11:15:26.200 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T11:17:26.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T11:19:26.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T11:21:26.624 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T11:23:26.792 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T11:25:26.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T11:27:27.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T11:29:27.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T11:31:27.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T11:33:27.631 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T11:35:27.806 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T11:35:27.885 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1