2024-02-18T15:19:02.983 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55
2024-02-18T15:19:02.984 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-18T15:19:03.153 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fa2ea6ddf40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fa2eb73ec10>, signals=[15])
2024-02-18T15:19:03.153 INFO:teuthology.lock.ops:Start node 'smithi044.front.sepia.ceph.com' reimaging
2024-02-18T15:19:03.154 INFO:teuthology.lock.ops:Updating [smithi044.front.sepia.ceph.com]: reset os type and version on server
2024-02-18T15:19:03.154 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server
2024-02-18T15:19:03.175 INFO:teuthology.lock.ops:Start node 'smithi153.front.sepia.ceph.com' reimaging
2024-02-18T15:19:03.175 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: reset os type and version on server
2024-02-18T15:19:03.175 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server
2024-02-18T15:19:03.199 INFO:teuthology.lock.ops:Start node 'smithi155.front.sepia.ceph.com' reimaging
2024-02-18T15:19:03.200 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: reset os type and version on server
2024-02-18T15:19:03.200 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server
2024-02-18T15:19:03.305 DEBUG:teuthology.provision.fog.smithi044:Requesting image smithi_centos_9.stream (ID 10)
2024-02-18T15:19:03.328 DEBUG:teuthology.provision.fog.smithi155:Requesting image smithi_centos_9.stream (ID 10)
2024-02-18T15:19:03.331 DEBUG:teuthology.provision.fog.smithi153:Requesting image smithi_centos_9.stream (ID 10)
2024-02-18T15:19:03.352 INFO:teuthology.provision.fog.smithi044:Scheduling deploy of centos 9.stream
2024-02-18T15:19:03.379 INFO:teuthology.provision.fog.smithi155:Scheduling deploy of centos 9.stream
2024-02-18T15:19:03.382 INFO:teuthology.provision.fog.smithi153:Scheduling deploy of centos 9.stream
2024-02-18T15:19:03.569 INFO:teuthology.orchestra.console.smithi044:Power off
2024-02-18T15:19:03.569 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-18T15:19:03.582 INFO:teuthology.orchestra.console.smithi153:Power off
2024-02-18T15:19:03.582 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-18T15:19:03.595 INFO:teuthology.orchestra.console.smithi155:Power off
2024-02-18T15:19:03.596 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-18T15:19:03.602 DEBUG:teuthology.orchestra.console.smithi044:power off output: Chassis Power Control: Down/Off
2024-02-18T15:19:03.602 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-18T15:19:03.610 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off
2024-02-18T15:19:03.611 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-18T15:19:03.619 DEBUG:teuthology.orchestra.console.smithi155:power off output: Chassis Power Control: Down/Off
2024-02-18T15:19:03.619 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-18T15:19:03.627 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on
2024-02-18T15:19:03.632 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on
2024-02-18T15:19:03.640 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on
2024-02-18T15:19:07.632 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-18T15:19:07.639 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-18T15:19:07.645 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-18T15:19:07.741 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on
2024-02-18T15:19:07.747 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on
2024-02-18T15:19:07.753 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on
2024-02-18T15:19:11.744 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-18T15:19:11.753 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-18T15:19:11.760 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-18T15:19:11.856 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on
2024-02-18T15:19:11.862 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on
2024-02-18T15:19:11.867 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on
2024-02-18T15:19:15.861 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-18T15:19:15.868 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-18T15:19:15.875 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-18T15:19:15.970 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off
2024-02-18T15:19:15.977 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off
2024-02-18T15:19:15.984 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off
2024-02-18T15:19:16.071 INFO:teuthology.orchestra.console.smithi044:Power off completed
2024-02-18T15:19:16.078 INFO:teuthology.orchestra.console.smithi153:Power off completed
2024-02-18T15:19:16.085 INFO:teuthology.orchestra.console.smithi155:Power off completed
2024-02-18T15:19:16.172 INFO:teuthology.orchestra.console.smithi044:Power on
2024-02-18T15:19:16.173 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-18T15:19:16.180 INFO:teuthology.orchestra.console.smithi153:Power on
2024-02-18T15:19:16.180 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-18T15:19:16.188 INFO:teuthology.orchestra.console.smithi155:Power on
2024-02-18T15:19:16.188 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-18T15:19:16.197 DEBUG:teuthology.orchestra.console.smithi044:power on output: Chassis Power Control: Up/On
2024-02-18T15:19:16.198 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-18T15:19:16.206 DEBUG:teuthology.orchestra.console.smithi153:power on output: Chassis Power Control: Up/On
2024-02-18T15:19:16.206 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-18T15:19:16.214 DEBUG:teuthology.orchestra.console.smithi155:power on output: Chassis Power Control: Up/On
2024-02-18T15:19:16.215 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-18T15:19:16.223 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off
2024-02-18T15:19:16.227 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off
2024-02-18T15:19:16.235 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off
2024-02-18T15:19:20.224 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-18T15:19:20.232 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-18T15:19:20.240 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-18T15:19:20.334 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on
2024-02-18T15:19:20.341 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off
2024-02-18T15:19:20.349 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on
2024-02-18T15:19:20.435 INFO:teuthology.orchestra.console.smithi044:Power on completed
2024-02-18T15:19:20.450 INFO:teuthology.orchestra.console.smithi155:Power on completed
2024-02-18T15:19:20.537 INFO:teuthology.provision.fog.smithi044:Waiting for deploy to finish
2024-02-18T15:19:20.551 INFO:teuthology.provision.fog.smithi155:Waiting for deploy to finish
2024-02-18T15:19:24.344 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-18T15:19:24.453 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on
2024-02-18T15:19:24.554 INFO:teuthology.orchestra.console.smithi153:Power on completed
2024-02-18T15:19:24.655 INFO:teuthology.provision.fog.smithi153:Waiting for deploy to finish
2024-02-18T15:21:51.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-18T15:21:54.432 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44
2024-02-18T15:22:00.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-18T15:22:03.520 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44
2024-02-18T15:22:06.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-18T15:22:09.500 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155
2024-02-18T15:22:09.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-18T15:22:10.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-18T15:22:12.572 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44
2024-02-18T15:22:13.596 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2024-02-18T15:22:15.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-18T15:22:18.556 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155
2024-02-18T15:22:18.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-18T15:22:19.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-18T15:22:21.628 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44
2024-02-18T15:22:22.652 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2024-02-18T15:22:24.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-18T15:22:27.612 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155
2024-02-18T15:22:27.629 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-18T15:22:28.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-18T15:22:30.684 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44
2024-02-18T15:22:31.708 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2024-02-18T15:22:33.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-18T15:22:36.668 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155
2024-02-18T15:22:36.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-18T15:22:37.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-18T15:22:39.740 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44
2024-02-18T15:22:40.764 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2024-02-18T15:22:42.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-18T15:22:45.724 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155
2024-02-18T15:22:45.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-18T15:22:46.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-18T15:22:49.820 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2024-02-18T15:22:51.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-18T15:22:54.780 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155
2024-02-18T15:22:55.821 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-18T15:22:58.876 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2024-02-18T15:23:00.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-18T15:23:03.836 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155
2024-02-18T15:23:04.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-18T15:23:07.936 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2024-02-18T15:23:09.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-18T15:23:13.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-18T15:23:45.768 WARNING:teuthology.provision.fog.smithi044:timed out
2024-02-18T15:23:51.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-18T15:23:51.993 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-18T15:23:51.993 DEBUG:teuthology.orchestra.run.smithi044:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-18T15:23:52.330 INFO:teuthology.provision.fog.smithi044:Node is ready
2024-02-18T15:23:52.330 DEBUG:teuthology.orchestra.run.smithi044:> hostname
2024-02-18T15:23:52.346 INFO:teuthology.orchestra.run.smithi044.stdout:smithi044.front.sepia.ceph.com
2024-02-18T15:23:52.346 DEBUG:teuthology.orchestra.run.smithi044:> grep smithi044.front.sepia.ceph.com /etc/hosts
2024-02-18T15:23:52.401 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44 smithi044.front.sepia.ceph.com smithi044
2024-02-18T15:23:52.401 DEBUG:teuthology.orchestra.run.smithi044:> sudo hostname smithi044
2024-02-18T15:23:52.514 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i -e 's/smithi044.front.sepia.ceph.com/smithi044/g' /etc/hosts
2024-02-18T15:23:52.545 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i -e 's/172.21.15.44/172.21.15.44/g' /etc/hosts
2024-02-18T15:23:52.617 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i -e 's/smithi044.front.sepia.ceph.com/smithi044/g' /etc/hostname
2024-02-18T15:23:52.688 DEBUG:teuthology.orchestra.run.smithi044:> sudo hostname smithi044
2024-02-18T15:23:52.758 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release
2024-02-18T15:23:52.813 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="CentOS Stream"
2024-02-18T15:23:52.813 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="9"
2024-02-18T15:23:52.813 INFO:teuthology.orchestra.run.smithi044.stdout:ID="centos"
2024-02-18T15:23:52.813 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE="rhel fedora"
2024-02-18T15:23:52.813 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="9"
2024-02-18T15:23:52.813 INFO:teuthology.orchestra.run.smithi044.stdout:PLATFORM_ID="platform:el9"
2024-02-18T15:23:52.813 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-18T15:23:52.813 INFO:teuthology.orchestra.run.smithi044.stdout:ANSI_COLOR="0;31"
2024-02-18T15:23:52.813 INFO:teuthology.orchestra.run.smithi044.stdout:LOGO="fedora-logo-icon"
2024-02-18T15:23:52.813 INFO:teuthology.orchestra.run.smithi044.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-18T15:23:52.813 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://centos.org/"
2024-02-18T15:23:52.813 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-18T15:23:52.814 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-18T15:23:52.814 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-18T15:23:52.814 INFO:teuthology.provision.fog.smithi044:Deploy complete!
2024-02-18T15:23:52.816 DEBUG:teuthology.parallel:result is None
2024-02-18T15:24:09.856 WARNING:teuthology.provision.fog.smithi155:timed out
2024-02-18T15:24:13.947 WARNING:teuthology.provision.fog.smithi153:timed out
2024-02-18T15:24:15.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-18T15:24:16.170 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-18T15:24:16.170 DEBUG:teuthology.orchestra.run.smithi155:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-18T15:24:16.498 INFO:teuthology.provision.fog.smithi155:Node is ready
2024-02-18T15:24:16.498 DEBUG:teuthology.orchestra.run.smithi155:> hostname
2024-02-18T15:24:16.514 INFO:teuthology.orchestra.run.smithi155.stdout:smithi155.front.sepia.ceph.com
2024-02-18T15:24:16.514 DEBUG:teuthology.orchestra.run.smithi155:> grep smithi155.front.sepia.ceph.com /etc/hosts
2024-02-18T15:24:16.574 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155 smithi155.front.sepia.ceph.com smithi155
2024-02-18T15:24:16.574 DEBUG:teuthology.orchestra.run.smithi155:> sudo hostname smithi155
2024-02-18T15:24:16.678 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/smithi155.front.sepia.ceph.com/smithi155/g' /etc/hosts
2024-02-18T15:24:16.705 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/172.21.15.155/172.21.15.155/g' /etc/hosts
2024-02-18T15:24:16.774 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/smithi155.front.sepia.ceph.com/smithi155/g' /etc/hostname
2024-02-18T15:24:16.846 DEBUG:teuthology.orchestra.run.smithi155:> sudo hostname smithi155
2024-02-18T15:24:16.915 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release
2024-02-18T15:24:16.971 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="CentOS Stream"
2024-02-18T15:24:16.971 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="9"
2024-02-18T15:24:16.971 INFO:teuthology.orchestra.run.smithi155.stdout:ID="centos"
2024-02-18T15:24:16.972 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="rhel fedora"
2024-02-18T15:24:16.972 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="9"
2024-02-18T15:24:16.972 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el9"
2024-02-18T15:24:16.972 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-18T15:24:16.972 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31"
2024-02-18T15:24:16.972 INFO:teuthology.orchestra.run.smithi155.stdout:LOGO="fedora-logo-icon"
2024-02-18T15:24:16.972 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-18T15:24:16.972 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://centos.org/"
2024-02-18T15:24:16.972 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-18T15:24:16.972 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-18T15:24:16.972 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-18T15:24:16.973 INFO:teuthology.provision.fog.smithi155:Deploy complete!
2024-02-18T15:24:16.974 DEBUG:teuthology.parallel:result is None
2024-02-18T15:24:19.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-18T15:24:20.198 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-18T15:24:20.198 DEBUG:teuthology.orchestra.run.smithi153:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-18T15:24:20.497 INFO:teuthology.provision.fog.smithi153:Node is ready
2024-02-18T15:24:20.497 DEBUG:teuthology.orchestra.run.smithi153:> hostname
2024-02-18T15:24:20.511 INFO:teuthology.orchestra.run.smithi153.stdout:smithi153.front.sepia.ceph.com
2024-02-18T15:24:20.512 DEBUG:teuthology.orchestra.run.smithi153:> grep smithi153.front.sepia.ceph.com /etc/hosts
2024-02-18T15:24:20.566 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.15.153 smithi153.front.sepia.ceph.com smithi153
2024-02-18T15:24:20.567 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153
2024-02-18T15:24:20.672 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153.front.sepia.ceph.com/smithi153/g' /etc/hosts
2024-02-18T15:24:20.700 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/172.21.15.153/172.21.15.153/g' /etc/hosts
2024-02-18T15:24:20.766 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153.front.sepia.ceph.com/smithi153/g' /etc/hostname
2024-02-18T15:24:20.833 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153
2024-02-18T15:24:20.900 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release
2024-02-18T15:24:20.955 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="CentOS Stream"
2024-02-18T15:24:20.955 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="9"
2024-02-18T15:24:20.955 INFO:teuthology.orchestra.run.smithi153.stdout:ID="centos"
2024-02-18T15:24:20.955 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="rhel fedora"
2024-02-18T15:24:20.955 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="9"
2024-02-18T15:24:20.955 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el9"
2024-02-18T15:24:20.955 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-18T15:24:20.955 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31"
2024-02-18T15:24:20.955 INFO:teuthology.orchestra.run.smithi153.stdout:LOGO="fedora-logo-icon"
2024-02-18T15:24:20.956 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-18T15:24:20.956 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://centos.org/"
2024-02-18T15:24:20.956 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-18T15:24:20.956 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-18T15:24:20.956 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-18T15:24:20.956 INFO:teuthology.provision.fog.smithi153:Deploy complete!
2024-02-18T15:24:20.957 DEBUG:teuthology.parallel:result is None
2024-02-18T15:24:21.203 INFO:teuthology.lock.ops:Checking smithi044.front.sepia.ceph.com
2024-02-18T15:24:21.204 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-18T15:24:21.233 INFO:teuthology.lock.ops:Checking smithi153.front.sepia.ceph.com
2024-02-18T15:24:21.233 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-18T15:24:21.249 INFO:teuthology.lock.ops:Checking smithi155.front.sepia.ceph.com
2024-02-18T15:24:21.249 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-18T15:24:21.267 INFO:teuthology.lock.ops:Updating [smithi044.front.sepia.ceph.com]: set os type and version on server
2024-02-18T15:24:21.268 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com'
2024-02-18T15:24:21.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-18T15:24:21.373 DEBUG:teuthology.orchestra.run.smithi044:> true
2024-02-18T15:24:21.558 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com'
2024-02-18T15:24:21.558 DEBUG:teuthology.orchestra.run.smithi044:> uname -m
2024-02-18T15:24:21.613 INFO:teuthology.orchestra.run.smithi044.stdout:x86_64
2024-02-18T15:24:21.614 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release
2024-02-18T15:24:21.668 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="CentOS Stream"
2024-02-18T15:24:21.668 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="9"
2024-02-18T15:24:21.668 INFO:teuthology.orchestra.run.smithi044.stdout:ID="centos"
2024-02-18T15:24:21.668 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE="rhel fedora"
2024-02-18T15:24:21.669 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="9"
2024-02-18T15:24:21.669 INFO:teuthology.orchestra.run.smithi044.stdout:PLATFORM_ID="platform:el9"
2024-02-18T15:24:21.669 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-18T15:24:21.669 INFO:teuthology.orchestra.run.smithi044.stdout:ANSI_COLOR="0;31"
2024-02-18T15:24:21.669 INFO:teuthology.orchestra.run.smithi044.stdout:LOGO="fedora-logo-icon"
2024-02-18T15:24:21.669 INFO:teuthology.orchestra.run.smithi044.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-18T15:24:21.669 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://centos.org/"
2024-02-18T15:24:21.669 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-18T15:24:21.669 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-18T15:24:21.669 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-18T15:24:21.670 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server
2024-02-18T15:24:21.691 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: set os type and version on server
2024-02-18T15:24:21.691 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com'
2024-02-18T15:24:21.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-18T15:24:21.788 DEBUG:teuthology.orchestra.run.smithi153:> true
2024-02-18T15:24:21.855 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com'
2024-02-18T15:24:21.855 DEBUG:teuthology.orchestra.run.smithi153:> uname -m
2024-02-18T15:24:21.909 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64
2024-02-18T15:24:21.909 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release
2024-02-18T15:24:21.964 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="CentOS Stream"
2024-02-18T15:24:21.964 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="9"
2024-02-18T15:24:21.964 INFO:teuthology.orchestra.run.smithi153.stdout:ID="centos"
2024-02-18T15:24:21.964 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="rhel fedora"
2024-02-18T15:24:21.964 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="9"
2024-02-18T15:24:21.964 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el9"
2024-02-18T15:24:21.964 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-18T15:24:21.964 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31"
2024-02-18T15:24:21.965 INFO:teuthology.orchestra.run.smithi153.stdout:LOGO="fedora-logo-icon"
2024-02-18T15:24:21.965 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-18T15:24:21.965 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://centos.org/"
2024-02-18T15:24:21.965 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-18T15:24:21.965 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-18T15:24:21.965 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-18T15:24:21.965 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server
2024-02-18T15:24:21.991 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: set os type and version on server
2024-02-18T15:24:21.991 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com'
2024-02-18T15:24:21.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-18T15:24:22.080 DEBUG:teuthology.orchestra.run.smithi155:> true
2024-02-18T15:24:22.149 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com'
2024-02-18T15:24:22.149 DEBUG:teuthology.orchestra.run.smithi155:> uname -m
2024-02-18T15:24:22.205 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64
2024-02-18T15:24:22.206 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release
2024-02-18T15:24:22.262 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="CentOS Stream"
2024-02-18T15:24:22.263 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="9"
2024-02-18T15:24:22.263 INFO:teuthology.orchestra.run.smithi155.stdout:ID="centos"
2024-02-18T15:24:22.263 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="rhel fedora"
2024-02-18T15:24:22.263 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="9"
2024-02-18T15:24:22.263 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el9"
2024-02-18T15:24:22.263 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-18T15:24:22.263 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31"
2024-02-18T15:24:22.263 INFO:teuthology.orchestra.run.smithi155.stdout:LOGO="fedora-logo-icon"
2024-02-18T15:24:22.263 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-18T15:24:22.263 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://centos.org/"
2024-02-18T15:24:22.263 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-18T15:24:22.263 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-18T15:24:22.263 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-18T15:24:22.264 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server
2024-02-18T15:24:22.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-18T15:24:22.384 INFO:teuthology.dispatcher.supervisor:Running job 7565837
2024-02-18T15:24:22.384 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_leonidus@teuthology --archive /home/teuthworker/archive/leonidus-2024-02-18_11:27:24-fs-wip-lusov-qdb-distro-default-smithi/7565837 --name leonidus-2024-02-18_11:27:24-fs-wip-lusov-qdb-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/suites/blogbench}} -- /home/teuthworker/archive/leonidus-2024-02-18_11:27:24-fs-wip-lusov-qdb-distro-default-smithi/7565837/orig.config.yaml
2024-02-18T15:24:22.391 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/leonidus-2024-02-18_11:27:24-fs-wip-lusov-qdb-distro-default-smithi/7565837
2024-02-18T15:24:22.391 INFO:teuthology.dispatcher.supervisor:Job PID: 3347706
2024-02-18T15:24:22.391 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-02-18T15:26:22.492 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-18T15:28:22.668 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-18T15:30:22.872 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-18T15:32:23.068 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-18T15:34:23.252 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-18T15:36:23.424 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-18T15:38:23.593 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-18T15:40:23.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-18T15:42:23.933 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-18T15:44:24.100 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-18T15:46:24.276 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-18T15:48:24.464 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-18T15:50:24.629 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-18T15:52:24.734 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-18T15:54:24.900 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-18T15:56:25.066 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-18T15:58:25.249 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-18T16:00:25.421 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-18T16:00:25.488 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1