2024-03-19T07:01:05.448 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-19T07:01:05.449 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:01:05.628 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f545d3dbf40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f545e379c10>, signals=[15])
2024-03-19T07:01:05.629 INFO:teuthology.lock.ops:Start node 'smithi100.front.sepia.ceph.com' reimaging
2024-03-19T07:01:05.629 INFO:teuthology.lock.ops:Updating [smithi100.front.sepia.ceph.com]: reset os type and version on server
2024-03-19T07:01:05.629 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server
2024-03-19T07:01:05.649 INFO:teuthology.lock.ops:Start node 'smithi134.front.sepia.ceph.com' reimaging
2024-03-19T07:01:05.649 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: reset os type and version on server
2024-03-19T07:01:05.649 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server
2024-03-19T07:01:05.665 INFO:teuthology.lock.ops:Start node 'smithi196.front.sepia.ceph.com' reimaging
2024-03-19T07:01:05.665 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: reset os type and version on server
2024-03-19T07:01:05.666 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server
2024-03-19T07:01:05.770 DEBUG:teuthology.provision.fog.smithi100:Requesting image smithi_centos_9.stream (ID 10)
2024-03-19T07:01:05.779 DEBUG:teuthology.provision.fog.smithi134:Requesting image smithi_centos_9.stream (ID 10)
2024-03-19T07:01:05.783 DEBUG:teuthology.provision.fog.smithi196:Requesting image smithi_centos_9.stream (ID 10)
2024-03-19T07:01:05.810 INFO:teuthology.provision.fog.smithi100:Scheduling deploy of centos 9.stream
2024-03-19T07:01:05.832 INFO:teuthology.provision.fog.smithi134:Scheduling deploy of centos 9.stream
2024-03-19T07:01:05.838 INFO:teuthology.provision.fog.smithi196:Scheduling deploy of centos 9.stream
2024-03-19T07:01:06.075 INFO:teuthology.orchestra.console.smithi134:Power off
2024-03-19T07:01:06.075 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-19T07:01:06.089 INFO:teuthology.orchestra.console.smithi196:Power off
2024-03-19T07:01:06.089 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-19T07:01:06.102 INFO:teuthology.orchestra.console.smithi100:Power off
2024-03-19T07:01:06.102 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-19T07:01:06.110 DEBUG:teuthology.orchestra.console.smithi196:power off output: Chassis Power Control: Down/Off
2024-03-19T07:01:06.111 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T07:01:06.118 DEBUG:teuthology.orchestra.console.smithi134:power off output: Chassis Power Control: Down/Off
2024-03-19T07:01:06.118 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T07:01:06.127 DEBUG:teuthology.orchestra.console.smithi100:power off output: Chassis Power Control: Down/Off
2024-03-19T07:01:06.127 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T07:01:06.135 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off
2024-03-19T07:01:06.140 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off
2024-03-19T07:01:06.149 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on
2024-03-19T07:01:06.236 INFO:teuthology.orchestra.console.smithi196:Power off completed
2024-03-19T07:01:06.241 INFO:teuthology.orchestra.console.smithi134:Power off completed
2024-03-19T07:01:06.337 INFO:teuthology.orchestra.console.smithi196:Power on
2024-03-19T07:01:06.338 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-19T07:01:06.345 INFO:teuthology.orchestra.console.smithi134:Power on
2024-03-19T07:01:06.345 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-19T07:01:06.358 DEBUG:teuthology.orchestra.console.smithi196:power on output: Chassis Power Control: Up/On
2024-03-19T07:01:06.358 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T07:01:06.366 DEBUG:teuthology.orchestra.console.smithi134:power on output: Chassis Power Control: Up/On
2024-03-19T07:01:06.366 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T07:01:06.379 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off
2024-03-19T07:01:06.388 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off
2024-03-19T07:01:10.150 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T07:01:10.259 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on
2024-03-19T07:01:10.379 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T07:01:10.389 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T07:01:10.488 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on
2024-03-19T07:01:10.499 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off
2024-03-19T07:01:10.590 INFO:teuthology.orchestra.console.smithi196:Power on completed
2024-03-19T07:01:10.690 INFO:teuthology.provision.fog.smithi196:Waiting for deploy to finish
2024-03-19T07:01:14.263 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T07:01:14.371 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off
2024-03-19T07:01:14.472 INFO:teuthology.orchestra.console.smithi100:Power off completed
2024-03-19T07:01:14.501 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T07:01:14.573 INFO:teuthology.orchestra.console.smithi100:Power on
2024-03-19T07:01:14.573 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-19T07:01:14.596 DEBUG:teuthology.orchestra.console.smithi100:power on output: Chassis Power Control: Up/On
2024-03-19T07:01:14.596 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T07:01:14.610 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on
2024-03-19T07:01:14.616 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off
2024-03-19T07:01:14.711 INFO:teuthology.orchestra.console.smithi134:Power on completed
2024-03-19T07:01:14.811 INFO:teuthology.provision.fog.smithi134:Waiting for deploy to finish
2024-03-19T07:01:18.618 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T07:01:18.727 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off
2024-03-19T07:01:22.730 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T07:01:22.839 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on
2024-03-19T07:01:22.940 INFO:teuthology.orchestra.console.smithi100:Power on completed
2024-03-19T07:01:23.040 INFO:teuthology.provision.fog.smithi100:Waiting for deploy to finish
2024-03-19T07:03:41.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:03:44.705 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2024-03-19T07:03:45.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:03:48.798 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2024-03-19T07:03:50.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:03:53.790 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2024-03-19T07:03:54.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:03:54.800 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:03:57.086 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-03-19T07:03:57.854 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2024-03-19T07:03:59.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:04:02.846 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2024-03-19T07:04:03.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:04:03.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:04:06.142 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-03-19T07:04:06.910 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2024-03-19T07:04:08.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:04:11.902 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2024-03-19T07:04:12.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:04:12.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:04:15.198 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-03-19T07:04:15.970 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2024-03-19T07:04:17.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:04:20.958 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2024-03-19T07:04:21.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:04:21.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:04:24.254 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-03-19T07:04:25.022 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2024-03-19T07:04:26.961 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:04:30.014 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2024-03-19T07:04:30.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:04:31.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:04:33.314 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-03-19T07:04:34.078 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2024-03-19T07:04:36.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:04:39.070 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2024-03-19T07:04:39.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:04:40.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:04:42.366 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-03-19T07:04:43.134 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2024-03-19T07:04:45.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:04:48.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:04:49.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:04:51.422 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-03-19T07:04:57.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:05:03.518 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2024-03-19T07:05:07.614 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2024-03-19T07:05:09.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:05:12.574 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2024-03-19T07:05:13.617 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:05:16.670 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2024-03-19T07:05:18.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:05:21.630 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2024-03-19T07:05:22.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:05:25.726 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2024-03-19T07:05:27.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:05:27.939 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-19T07:05:27.940 DEBUG:teuthology.orchestra.run.smithi196:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-19T07:05:31.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:05:31.973 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-19T07:05:31.973 DEBUG:teuthology.orchestra.run.smithi134:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-19T07:05:48.264 INFO:teuthology.provision.fog.smithi196:Node is ready
2024-03-19T07:05:48.265 DEBUG:teuthology.orchestra.run.smithi196:> hostname
2024-03-19T07:05:48.283 INFO:teuthology.orchestra.run.smithi196.stdout:smithi196.front.sepia.ceph.com
2024-03-19T07:05:48.284 DEBUG:teuthology.orchestra.run.smithi196:> grep smithi196.front.sepia.ceph.com /etc/hosts
2024-03-19T07:05:48.340 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.15.196 smithi196.front.sepia.ceph.com smithi196
2024-03-19T07:05:48.341 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196
2024-03-19T07:05:48.481 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi196.front.sepia.ceph.com/smithi196/g' /etc/hosts
2024-03-19T07:05:48.511 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/172.21.15.196/172.21.15.196/g' /etc/hosts
2024-03-19T07:05:48.579 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi196.front.sepia.ceph.com/smithi196/g' /etc/hostname
2024-03-19T07:05:48.647 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196
2024-03-19T07:05:48.715 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release
2024-03-19T07:05:48.769 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Stream"
2024-03-19T07:05:48.769 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="9"
2024-03-19T07:05:48.769 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos"
2024-03-19T07:05:48.769 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora"
2024-03-19T07:05:48.769 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="9"
2024-03-19T07:05:48.770 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el9"
2024-03-19T07:05:48.770 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-19T07:05:48.770 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31"
2024-03-19T07:05:48.770 INFO:teuthology.orchestra.run.smithi196.stdout:LOGO="fedora-logo-icon"
2024-03-19T07:05:48.770 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-19T07:05:48.770 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://centos.org/"
2024-03-19T07:05:48.770 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-19T07:05:48.770 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-19T07:05:48.770 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-19T07:05:48.771 INFO:teuthology.provision.fog.smithi196:Deploy complete!
2024-03-19T07:05:48.772 DEBUG:teuthology.parallel:result is None
2024-03-19T07:05:52.351 INFO:teuthology.provision.fog.smithi134:Node is ready
2024-03-19T07:05:52.351 DEBUG:teuthology.orchestra.run.smithi134:> hostname
2024-03-19T07:05:52.369 INFO:teuthology.orchestra.run.smithi134.stdout:smithi134.front.sepia.ceph.com
2024-03-19T07:05:52.369 DEBUG:teuthology.orchestra.run.smithi134:> grep smithi134.front.sepia.ceph.com /etc/hosts
2024-03-19T07:05:52.426 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134 smithi134.front.sepia.ceph.com smithi134
2024-03-19T07:05:52.426 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname smithi134
2024-03-19T07:05:52.553 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/smithi134.front.sepia.ceph.com/smithi134/g' /etc/hosts
2024-03-19T07:05:52.583 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/172.21.15.134/172.21.15.134/g' /etc/hosts
2024-03-19T07:05:52.652 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/smithi134.front.sepia.ceph.com/smithi134/g' /etc/hostname
2024-03-19T07:05:52.720 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname smithi134
2024-03-19T07:05:52.787 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release
2024-03-19T07:05:52.842 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="CentOS Stream"
2024-03-19T07:05:52.842 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="9"
2024-03-19T07:05:52.842 INFO:teuthology.orchestra.run.smithi134.stdout:ID="centos"
2024-03-19T07:05:52.842 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="rhel fedora"
2024-03-19T07:05:52.842 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="9"
2024-03-19T07:05:52.843 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el9"
2024-03-19T07:05:52.843 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-19T07:05:52.843 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31"
2024-03-19T07:05:52.843 INFO:teuthology.orchestra.run.smithi134.stdout:LOGO="fedora-logo-icon"
2024-03-19T07:05:52.843 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-19T07:05:52.843 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://centos.org/"
2024-03-19T07:05:52.843 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-19T07:05:52.843 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-19T07:05:52.843 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-19T07:05:52.843 INFO:teuthology.provision.fog.smithi134:Deploy complete!
2024-03-19T07:05:52.844 DEBUG:teuthology.parallel:result is None
2024-03-19T07:05:57.436 WARNING:teuthology.provision.fog.smithi100:timed out
2024-03-19T07:06:03.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:06:03.794 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-19T07:06:03.795 DEBUG:teuthology.orchestra.run.smithi100:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-19T07:06:04.124 INFO:teuthology.provision.fog.smithi100:Node is ready
2024-03-19T07:06:04.124 DEBUG:teuthology.orchestra.run.smithi100:> hostname
2024-03-19T07:06:04.139 INFO:teuthology.orchestra.run.smithi100.stdout:smithi100.front.sepia.ceph.com
2024-03-19T07:06:04.139 DEBUG:teuthology.orchestra.run.smithi100:> grep smithi100.front.sepia.ceph.com /etc/hosts
2024-03-19T07:06:04.194 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100 smithi100.front.sepia.ceph.com smithi100
2024-03-19T07:06:04.194 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname smithi100
2024-03-19T07:06:04.321 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/smithi100.front.sepia.ceph.com/smithi100/g' /etc/hosts
2024-03-19T07:06:04.349 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/172.21.15.100/172.21.15.100/g' /etc/hosts
2024-03-19T07:06:04.417 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/smithi100.front.sepia.ceph.com/smithi100/g' /etc/hostname
2024-03-19T07:06:04.484 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname smithi100
2024-03-19T07:06:04.550 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release
2024-03-19T07:06:04.604 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="CentOS Stream"
2024-03-19T07:06:04.604 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="9"
2024-03-19T07:06:04.604 INFO:teuthology.orchestra.run.smithi100.stdout:ID="centos"
2024-03-19T07:06:04.605 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="rhel fedora"
2024-03-19T07:06:04.605 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="9"
2024-03-19T07:06:04.605 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el9"
2024-03-19T07:06:04.605 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-19T07:06:04.605 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31"
2024-03-19T07:06:04.605 INFO:teuthology.orchestra.run.smithi100.stdout:LOGO="fedora-logo-icon"
2024-03-19T07:06:04.605 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-19T07:06:04.605 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://centos.org/"
2024-03-19T07:06:04.605 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-19T07:06:04.605 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-19T07:06:04.605 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-19T07:06:04.605 INFO:teuthology.provision.fog.smithi100:Deploy complete!
2024-03-19T07:06:04.606 DEBUG:teuthology.parallel:result is None
2024-03-19T07:06:04.844 INFO:teuthology.lock.ops:Checking smithi100.front.sepia.ceph.com
2024-03-19T07:06:04.845 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-19T07:06:04.864 INFO:teuthology.lock.ops:Checking smithi134.front.sepia.ceph.com
2024-03-19T07:06:04.864 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-19T07:06:04.880 INFO:teuthology.lock.ops:Checking smithi196.front.sepia.ceph.com
2024-03-19T07:06:04.880 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-19T07:06:04.898 INFO:teuthology.lock.ops:Updating [smithi100.front.sepia.ceph.com]: set os type and version on server
2024-03-19T07:06:04.898 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com'
2024-03-19T07:06:04.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:06:05.026 DEBUG:teuthology.orchestra.run.smithi100:> true
2024-03-19T07:06:05.096 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com'
2024-03-19T07:06:05.096 DEBUG:teuthology.orchestra.run.smithi100:> uname -m
2024-03-19T07:06:05.150 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64
2024-03-19T07:06:05.151 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release
2024-03-19T07:06:05.204 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="CentOS Stream"
2024-03-19T07:06:05.204 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="9"
2024-03-19T07:06:05.204 INFO:teuthology.orchestra.run.smithi100.stdout:ID="centos"
2024-03-19T07:06:05.204 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="rhel fedora"
2024-03-19T07:06:05.205 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="9"
2024-03-19T07:06:05.205 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el9"
2024-03-19T07:06:05.205 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-19T07:06:05.205 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31"
2024-03-19T07:06:05.205 INFO:teuthology.orchestra.run.smithi100.stdout:LOGO="fedora-logo-icon"
2024-03-19T07:06:05.205 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-19T07:06:05.205 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://centos.org/"
2024-03-19T07:06:05.205 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-19T07:06:05.205 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-19T07:06:05.205 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-19T07:06:05.206 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server
2024-03-19T07:06:05.230 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: set os type and version on server
2024-03-19T07:06:05.231 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com'
2024-03-19T07:06:05.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:06:05.317 DEBUG:teuthology.orchestra.run.smithi134:> true
2024-03-19T07:06:05.488 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com'
2024-03-19T07:06:05.488 DEBUG:teuthology.orchestra.run.smithi134:> uname -m
2024-03-19T07:06:05.543 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64
2024-03-19T07:06:05.543 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release
2024-03-19T07:06:05.597 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="CentOS Stream"
2024-03-19T07:06:05.597 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="9"
2024-03-19T07:06:05.597 INFO:teuthology.orchestra.run.smithi134.stdout:ID="centos"
2024-03-19T07:06:05.597 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="rhel fedora"
2024-03-19T07:06:05.597 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="9"
2024-03-19T07:06:05.597 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el9"
2024-03-19T07:06:05.597 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-19T07:06:05.598 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31"
2024-03-19T07:06:05.598 INFO:teuthology.orchestra.run.smithi134.stdout:LOGO="fedora-logo-icon"
2024-03-19T07:06:05.598 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-19T07:06:05.598 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://centos.org/"
2024-03-19T07:06:05.598 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-19T07:06:05.598 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-19T07:06:05.598 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-19T07:06:05.598 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server
2024-03-19T07:06:05.622 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: set os type and version on server
2024-03-19T07:06:05.622 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com'
2024-03-19T07:06:05.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T07:06:05.707 DEBUG:teuthology.orchestra.run.smithi196:> true
2024-03-19T07:06:05.876 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com'
2024-03-19T07:06:05.876 DEBUG:teuthology.orchestra.run.smithi196:> uname -m
2024-03-19T07:06:05.930 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64
2024-03-19T07:06:05.931 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release
2024-03-19T07:06:05.984 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Stream"
2024-03-19T07:06:05.985 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="9"
2024-03-19T07:06:05.985 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos"
2024-03-19T07:06:05.985 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora"
2024-03-19T07:06:05.985 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="9"
2024-03-19T07:06:05.985 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el9"
2024-03-19T07:06:05.985 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-19T07:06:05.985 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31"
2024-03-19T07:06:05.985 INFO:teuthology.orchestra.run.smithi196.stdout:LOGO="fedora-logo-icon"
2024-03-19T07:06:05.985 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-19T07:06:05.985 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://centos.org/"
2024-03-19T07:06:05.985 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-19T07:06:05.985 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-19T07:06:05.985 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-19T07:06:05.986 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server
2024-03-19T07:06:06.005 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:06:06.101 INFO:teuthology.dispatcher.supervisor:Running job 7610580
2024-03-19T07:06:06.101 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-03-19_04:56:42-fs-wip-batrick-testing-20240318.181317-distro-default-smithi/7610580 --name pdonnell-2024-03-19_04:56:42-fs-wip-batrick-testing-20240318.181317-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/suites/ffsb}} -- /home/teuthworker/archive/pdonnell-2024-03-19_04:56:42-fs-wip-batrick-testing-20240318.181317-distro-default-smithi/7610580/orig.config.yaml
2024-03-19T07:06:06.105 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-03-19_04:56:42-fs-wip-batrick-testing-20240318.181317-distro-default-smithi/7610580
2024-03-19T07:06:06.105 INFO:teuthology.dispatcher.supervisor:Job PID: 639905
2024-03-19T07:06:06.105 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-19T07:08:06.108 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:10:06.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:12:06.449 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:14:06.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:16:06.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:18:06.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:20:07.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:22:07.349 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:24:07.513 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:26:07.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:28:07.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:30:08.005 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:32:08.164 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:34:08.322 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:36:08.494 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:38:08.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:40:08.828 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:42:08.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:44:09.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:46:09.308 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:48:09.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:50:09.660 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:50:09.735 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1