2024-03-15T13:19:48.369 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-15T13:19:48.369 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T13:19:48.546 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f6e65c17f70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f6e66c77c10>, signals=[15])
2024-03-15T13:19:48.594 INFO:teuthology.lock.ops:Start node 'smithi002.front.sepia.ceph.com' reimaging
2024-03-15T13:19:48.594 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: reset os type and version on server
2024-03-15T13:19:48.594 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server
2024-03-15T13:19:48.618 INFO:teuthology.lock.ops:Start node 'smithi149.front.sepia.ceph.com' reimaging
2024-03-15T13:19:48.619 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: reset os type and version on server
2024-03-15T13:19:48.619 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server
2024-03-15T13:19:48.643 INFO:teuthology.lock.ops:Start node 'smithi192.front.sepia.ceph.com' reimaging
2024-03-15T13:19:48.643 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: reset os type and version on server
2024-03-15T13:19:48.644 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server
2024-03-15T13:19:48.739 DEBUG:teuthology.provision.fog.smithi002:Requesting image smithi_centos_9.stream (ID 10)
2024-03-15T13:19:48.758 DEBUG:teuthology.provision.fog.smithi149:Requesting image smithi_centos_9.stream (ID 10)
2024-03-15T13:19:48.782 INFO:teuthology.provision.fog.smithi002:Scheduling deploy of centos 9.stream
2024-03-15T13:19:48.785 DEBUG:teuthology.provision.fog.smithi192:Requesting image smithi_centos_9.stream (ID 10)
2024-03-15T13:19:48.802 INFO:teuthology.provision.fog.smithi149:Scheduling deploy of centos 9.stream
2024-03-15T13:19:48.828 INFO:teuthology.provision.fog.smithi192:Scheduling deploy of centos 9.stream
2024-03-15T13:19:49.014 INFO:teuthology.orchestra.console.smithi002:Power off
2024-03-15T13:19:49.015 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-15T13:19:49.035 DEBUG:teuthology.orchestra.console.smithi002:power off output: Chassis Power Control: Down/Off
2024-03-15T13:19:49.035 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-15T13:19:49.058 INFO:teuthology.orchestra.console.smithi192:Power off
2024-03-15T13:19:49.059 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-15T13:19:49.072 INFO:teuthology.orchestra.console.smithi149:Power off
2024-03-15T13:19:49.073 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-15T13:19:49.081 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off
2024-03-15T13:19:49.082 DEBUG:teuthology.orchestra.console.smithi192:power off output: Chassis Power Control: Down/Off
2024-03-15T13:19:49.083 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-15T13:19:49.094 DEBUG:teuthology.orchestra.console.smithi149:power off output: Chassis Power Control: Down/Off
2024-03-15T13:19:49.094 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-15T13:19:49.103 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on
2024-03-15T13:19:49.114 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off
2024-03-15T13:19:49.182 INFO:teuthology.orchestra.console.smithi002:Power off completed
2024-03-15T13:19:49.215 INFO:teuthology.orchestra.console.smithi149:Power off completed
2024-03-15T13:19:49.283 INFO:teuthology.orchestra.console.smithi002:Power on
2024-03-15T13:19:49.283 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-15T13:19:49.307 DEBUG:teuthology.orchestra.console.smithi002:power on output: Chassis Power Control: Up/On
2024-03-15T13:19:49.308 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-15T13:19:49.318 INFO:teuthology.orchestra.console.smithi149:Power on
2024-03-15T13:19:49.318 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-15T13:19:49.331 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off
2024-03-15T13:19:49.342 DEBUG:teuthology.orchestra.console.smithi149:power on output: Chassis Power Control: Up/On
2024-03-15T13:19:49.342 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-15T13:19:49.364 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off
2024-03-15T13:19:53.104 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-15T13:19:53.213 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on
2024-03-15T13:19:53.333 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-15T13:19:53.365 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-15T13:19:53.443 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off
2024-03-15T13:19:53.474 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off
2024-03-15T13:19:57.216 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-15T13:19:57.325 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off
2024-03-15T13:19:57.426 INFO:teuthology.orchestra.console.smithi192:Power off completed
2024-03-15T13:19:57.444 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-15T13:19:57.475 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-15T13:19:57.528 INFO:teuthology.orchestra.console.smithi192:Power on
2024-03-15T13:19:57.528 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-15T13:19:57.549 DEBUG:teuthology.orchestra.console.smithi192:power on output: Chassis Power Control: Up/On
2024-03-15T13:19:57.550 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-15T13:19:57.558 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is on
2024-03-15T13:19:57.570 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off
2024-03-15T13:19:57.659 INFO:teuthology.orchestra.console.smithi002:Power on completed
2024-03-15T13:19:57.695 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on
2024-03-15T13:19:57.760 INFO:teuthology.provision.fog.smithi002:Waiting for deploy to finish
2024-03-15T13:19:57.795 INFO:teuthology.orchestra.console.smithi149:Power on completed
2024-03-15T13:19:57.896 INFO:teuthology.provision.fog.smithi149:Waiting for deploy to finish
2024-03-15T13:20:01.574 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-15T13:20:01.684 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off
2024-03-15T13:20:05.686 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-15T13:20:05.825 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on
2024-03-15T13:20:05.926 INFO:teuthology.orchestra.console.smithi192:Power on completed
2024-03-15T13:20:06.026 INFO:teuthology.provision.fog.smithi192:Waiting for deploy to finish
2024-03-15T13:22:28.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:22:28.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:22:36.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:22:47.198 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2
2024-03-15T13:22:47.199 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2024-03-15T13:22:53.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:22:53.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:22:55.394 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192
2024-03-15T13:22:56.254 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2024-03-15T13:22:56.254 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2
2024-03-15T13:23:01.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:23:02.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:23:02.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:23:04.478 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192
2024-03-15T13:23:05.310 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2024-03-15T13:23:05.311 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2
2024-03-15T13:23:10.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:23:11.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:23:11.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:23:13.534 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192
2024-03-15T13:23:14.366 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2024-03-15T13:23:14.367 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2
2024-03-15T13:23:19.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:23:20.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:23:20.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:23:22.590 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192
2024-03-15T13:23:23.422 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2024-03-15T13:23:23.423 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2
2024-03-15T13:23:28.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:23:29.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:23:29.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:23:32.478 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2
2024-03-15T13:23:38.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:23:41.538 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2
2024-03-15T13:23:47.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:23:50.626 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2
2024-03-15T13:23:56.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:24:28.628 WARNING:teuthology.provision.fog.smithi192:timed out
2024-03-15T13:24:29.428 WARNING:teuthology.provision.fog.smithi149:timed out
2024-03-15T13:24:34.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:24:34.907 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-15T13:24:34.907 DEBUG:teuthology.orchestra.run.smithi192:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-15T13:24:35.245 INFO:teuthology.provision.fog.smithi192:Node is ready
2024-03-15T13:24:35.245 DEBUG:teuthology.orchestra.run.smithi192:> hostname
2024-03-15T13:24:35.260 INFO:teuthology.orchestra.run.smithi192.stdout:smithi192.front.sepia.ceph.com
2024-03-15T13:24:35.260 DEBUG:teuthology.orchestra.run.smithi192:> grep smithi192.front.sepia.ceph.com /etc/hosts
2024-03-15T13:24:35.314 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.15.192 smithi192.front.sepia.ceph.com smithi192
2024-03-15T13:24:35.315 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192
2024-03-15T13:24:35.421 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hosts
2024-03-15T13:24:35.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:24:35.448 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/172.21.15.192/172.21.15.192/g' /etc/hosts
2024-03-15T13:24:35.557 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hostname
2024-03-15T13:24:35.623 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192
2024-03-15T13:24:35.640 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-15T13:24:35.640 DEBUG:teuthology.orchestra.run.smithi149:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-15T13:24:35.690 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release
2024-03-15T13:24:35.744 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream"
2024-03-15T13:24:35.744 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="9"
2024-03-15T13:24:35.744 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos"
2024-03-15T13:24:35.744 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora"
2024-03-15T13:24:35.744 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="9"
2024-03-15T13:24:35.744 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el9"
2024-03-15T13:24:35.744 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-15T13:24:35.745 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31"
2024-03-15T13:24:35.745 INFO:teuthology.orchestra.run.smithi192.stdout:LOGO="fedora-logo-icon"
2024-03-15T13:24:35.745 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-15T13:24:35.745 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/"
2024-03-15T13:24:35.745 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-15T13:24:35.745 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-15T13:24:35.745 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-15T13:24:35.746 INFO:teuthology.provision.fog.smithi192:Deploy complete!
2024-03-15T13:24:35.747 DEBUG:teuthology.parallel:result is None
2024-03-15T13:24:35.961 INFO:teuthology.provision.fog.smithi149:Node is ready
2024-03-15T13:24:35.961 DEBUG:teuthology.orchestra.run.smithi149:> hostname
2024-03-15T13:24:35.978 INFO:teuthology.orchestra.run.smithi149.stdout:smithi149.front.sepia.ceph.com
2024-03-15T13:24:35.978 DEBUG:teuthology.orchestra.run.smithi149:> grep smithi149.front.sepia.ceph.com /etc/hosts
2024-03-15T13:24:36.034 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.15.149 smithi149.front.sepia.ceph.com smithi149
2024-03-15T13:24:36.034 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149
2024-03-15T13:24:36.147 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hosts
2024-03-15T13:24:36.174 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/172.21.15.149/172.21.15.149/g' /etc/hosts
2024-03-15T13:24:36.242 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hostname
2024-03-15T13:24:36.308 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149
2024-03-15T13:24:36.374 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release
2024-03-15T13:24:36.429 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="CentOS Stream"
2024-03-15T13:24:36.429 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="9"
2024-03-15T13:24:36.429 INFO:teuthology.orchestra.run.smithi149.stdout:ID="centos"
2024-03-15T13:24:36.429 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="rhel fedora"
2024-03-15T13:24:36.429 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="9"
2024-03-15T13:24:36.429 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el9"
2024-03-15T13:24:36.429 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-15T13:24:36.429 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31"
2024-03-15T13:24:36.429 INFO:teuthology.orchestra.run.smithi149.stdout:LOGO="fedora-logo-icon"
2024-03-15T13:24:36.429 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-15T13:24:36.429 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://centos.org/"
2024-03-15T13:24:36.430 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-15T13:24:36.430 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-15T13:24:36.430 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-15T13:24:36.430 INFO:teuthology.provision.fog.smithi149:Deploy complete!
2024-03-15T13:24:36.430 DEBUG:teuthology.parallel:result is None
2024-03-15T13:24:56.652 WARNING:teuthology.provision.fog.smithi002:timed out
2024-03-15T13:25:02.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:25:02.926 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-15T13:25:02.927 DEBUG:teuthology.orchestra.run.smithi002:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-15T13:25:03.271 INFO:teuthology.provision.fog.smithi002:Node is ready
2024-03-15T13:25:03.271 DEBUG:teuthology.orchestra.run.smithi002:> hostname
2024-03-15T13:25:03.286 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002.front.sepia.ceph.com
2024-03-15T13:25:03.287 DEBUG:teuthology.orchestra.run.smithi002:> grep smithi002.front.sepia.ceph.com /etc/hosts
2024-03-15T13:25:03.342 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2 smithi002.front.sepia.ceph.com smithi002
2024-03-15T13:25:03.343 DEBUG:teuthology.orchestra.run.smithi002:> sudo hostname smithi002
2024-03-15T13:25:03.464 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/smithi002.front.sepia.ceph.com/smithi002/g' /etc/hosts
2024-03-15T13:25:03.496 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/172.21.15.2/172.21.15.2/g' /etc/hosts
2024-03-15T13:25:03.567 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/smithi002.front.sepia.ceph.com/smithi002/g' /etc/hostname
2024-03-15T13:25:03.638 DEBUG:teuthology.orchestra.run.smithi002:> sudo hostname smithi002
2024-03-15T13:25:03.708 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release
2024-03-15T13:25:03.763 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream"
2024-03-15T13:25:03.763 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="9"
2024-03-15T13:25:03.763 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos"
2024-03-15T13:25:03.763 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora"
2024-03-15T13:25:03.763 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="9"
2024-03-15T13:25:03.764 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el9"
2024-03-15T13:25:03.764 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-15T13:25:03.764 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31"
2024-03-15T13:25:03.764 INFO:teuthology.orchestra.run.smithi002.stdout:LOGO="fedora-logo-icon"
2024-03-15T13:25:03.764 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-15T13:25:03.764 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/"
2024-03-15T13:25:03.764 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-15T13:25:03.764 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-15T13:25:03.764 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-15T13:25:03.764 INFO:teuthology.provision.fog.smithi002:Deploy complete!
2024-03-15T13:25:03.765 DEBUG:teuthology.parallel:result is None
2024-03-15T13:25:03.980 INFO:teuthology.lock.ops:Checking smithi002.front.sepia.ceph.com
2024-03-15T13:25:03.980 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-15T13:25:04.004 INFO:teuthology.lock.ops:Checking smithi149.front.sepia.ceph.com
2024-03-15T13:25:04.004 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-15T13:25:04.020 INFO:teuthology.lock.ops:Checking smithi192.front.sepia.ceph.com
2024-03-15T13:25:04.020 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-15T13:25:04.038 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: set os type and version on server
2024-03-15T13:25:04.038 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com'
2024-03-15T13:25:04.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:25:04.138 DEBUG:teuthology.orchestra.run.smithi002:> true
2024-03-15T13:25:04.206 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com'
2024-03-15T13:25:04.206 DEBUG:teuthology.orchestra.run.smithi002:> uname -m
2024-03-15T13:25:04.261 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64
2024-03-15T13:25:04.261 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release
2024-03-15T13:25:04.315 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream"
2024-03-15T13:25:04.316 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="9"
2024-03-15T13:25:04.316 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos"
2024-03-15T13:25:04.316 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora"
2024-03-15T13:25:04.316 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="9"
2024-03-15T13:25:04.316 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el9"
2024-03-15T13:25:04.316 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-15T13:25:04.316 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31"
2024-03-15T13:25:04.316 INFO:teuthology.orchestra.run.smithi002.stdout:LOGO="fedora-logo-icon"
2024-03-15T13:25:04.316 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-15T13:25:04.316 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/"
2024-03-15T13:25:04.316 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-15T13:25:04.316 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-15T13:25:04.316 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-15T13:25:04.317 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server
2024-03-15T13:25:04.337 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: set os type and version on server
2024-03-15T13:25:04.337 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com'
2024-03-15T13:25:04.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:25:04.429 DEBUG:teuthology.orchestra.run.smithi149:> true
2024-03-15T13:25:04.596 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com'
2024-03-15T13:25:04.596 DEBUG:teuthology.orchestra.run.smithi149:> uname -m
2024-03-15T13:25:04.651 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64
2024-03-15T13:25:04.652 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release
2024-03-15T13:25:04.706 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="CentOS Stream"
2024-03-15T13:25:04.706 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="9"
2024-03-15T13:25:04.706 INFO:teuthology.orchestra.run.smithi149.stdout:ID="centos"
2024-03-15T13:25:04.706 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="rhel fedora"
2024-03-15T13:25:04.707 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="9"
2024-03-15T13:25:04.707 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el9"
2024-03-15T13:25:04.707 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-15T13:25:04.707 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31"
2024-03-15T13:25:04.707 INFO:teuthology.orchestra.run.smithi149.stdout:LOGO="fedora-logo-icon"
2024-03-15T13:25:04.707 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-15T13:25:04.707 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://centos.org/"
2024-03-15T13:25:04.707 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-15T13:25:04.707 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-15T13:25:04.707 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-15T13:25:04.708 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server
2024-03-15T13:25:04.729 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: set os type and version on server
2024-03-15T13:25:04.729 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com'
2024-03-15T13:25:04.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:25:04.819 DEBUG:teuthology.orchestra.run.smithi192:> true
2024-03-15T13:25:04.984 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com'
2024-03-15T13:25:04.985 DEBUG:teuthology.orchestra.run.smithi192:> uname -m
2024-03-15T13:25:05.039 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64
2024-03-15T13:25:05.040 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release
2024-03-15T13:25:05.095 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream"
2024-03-15T13:25:05.095 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="9"
2024-03-15T13:25:05.095 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos"
2024-03-15T13:25:05.095 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora"
2024-03-15T13:25:05.095 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="9"
2024-03-15T13:25:05.095 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el9"
2024-03-15T13:25:05.095 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-15T13:25:05.095 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31"
2024-03-15T13:25:05.095 INFO:teuthology.orchestra.run.smithi192.stdout:LOGO="fedora-logo-icon"
2024-03-15T13:25:05.095 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-15T13:25:05.095 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/"
2024-03-15T13:25:05.095 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-15T13:25:05.096 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-15T13:25:05.096 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-15T13:25:05.096 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server
2024-03-15T13:25:05.121 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T13:25:05.216 INFO:teuthology.dispatcher.supervisor:Running job 7602206
2024-03-15T13:25:05.216 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7602206 --name pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/fs/norstats}} -- /home/teuthworker/archive/pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7602206/orig.config.yaml
2024-03-15T13:25:05.219 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7602206
2024-03-15T13:25:05.220 INFO:teuthology.dispatcher.supervisor:Job PID: 1599403
2024-03-15T13:25:05.220 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-15T13:27:05.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T13:29:05.502 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T13:31:05.676 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T13:33:05.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T13:35:05.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T13:37:06.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T13:39:06.309 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T13:41:06.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T13:43:06.654 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T13:45:06.822 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T13:47:06.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T13:49:07.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T13:51:07.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T13:53:07.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T13:55:07.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T13:57:07.810 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T13:59:07.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T14:01:08.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T14:01:08.145 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1