2024-03-31T19:56:39.482 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-31T19:56:39.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-31T19:56:39.650 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f1b161abf70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f1b1720cc10>, signals=[15])
2024-03-31T19:56:39.650 INFO:teuthology.lock.ops:Start node 'smithi026.front.sepia.ceph.com' reimaging
2024-03-31T19:56:39.650 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: reset os type and version on server
2024-03-31T19:56:39.651 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server
2024-03-31T19:56:39.680 INFO:teuthology.lock.ops:Start node 'smithi046.front.sepia.ceph.com' reimaging
2024-03-31T19:56:39.681 INFO:teuthology.lock.ops:Updating [smithi046.front.sepia.ceph.com]: reset os type and version on server
2024-03-31T19:56:39.681 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server
2024-03-31T19:56:39.705 INFO:teuthology.lock.ops:Start node 'smithi142.front.sepia.ceph.com' reimaging
2024-03-31T19:56:39.705 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: reset os type and version on server
2024-03-31T19:56:39.705 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server
2024-03-31T19:56:39.804 DEBUG:teuthology.provision.fog.smithi026:Requesting image smithi_centos_9.stream (ID 10)
2024-03-31T19:56:39.811 DEBUG:teuthology.provision.fog.smithi046:Requesting image smithi_centos_9.stream (ID 10)
2024-03-31T19:56:39.853 DEBUG:teuthology.provision.fog.smithi142:Requesting image smithi_centos_9.stream (ID 10)
2024-03-31T19:56:39.858 INFO:teuthology.provision.fog.smithi046:Scheduling deploy of centos 9.stream
2024-03-31T19:56:39.858 INFO:teuthology.provision.fog.smithi026:Scheduling deploy of centos 9.stream
2024-03-31T19:56:39.923 INFO:teuthology.provision.fog.smithi142:Scheduling deploy of centos 9.stream
2024-03-31T19:56:40.144 INFO:teuthology.orchestra.console.smithi026:Power off
2024-03-31T19:56:40.145 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-31T19:56:40.158 INFO:teuthology.orchestra.console.smithi046:Power off
2024-03-31T19:56:40.158 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-31T19:56:40.170 DEBUG:teuthology.orchestra.console.smithi026:power off output: Chassis Power Control: Down/Off
2024-03-31T19:56:40.170 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-31T19:56:40.182 INFO:teuthology.orchestra.console.smithi142:Power off
2024-03-31T19:56:40.182 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-31T19:56:40.190 DEBUG:teuthology.orchestra.console.smithi046:power off output: Chassis Power Control: Down/Off
2024-03-31T19:56:40.190 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-31T19:56:40.197 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on
2024-03-31T19:56:40.203 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off
2024-03-31T19:56:40.203 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-31T19:56:40.217 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on
2024-03-31T19:56:40.224 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on
2024-03-31T19:56:44.202 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-31T19:56:44.219 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-31T19:56:44.225 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-31T19:56:44.311 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on
2024-03-31T19:56:44.327 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on
2024-03-31T19:56:44.334 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on
2024-03-31T19:56:48.314 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-31T19:56:48.328 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-31T19:56:48.335 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-31T19:56:48.424 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off
2024-03-31T19:56:48.437 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off
2024-03-31T19:56:48.444 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off
2024-03-31T19:56:48.525 INFO:teuthology.orchestra.console.smithi026:Power off completed
2024-03-31T19:56:48.538 INFO:teuthology.orchestra.console.smithi046:Power off completed
2024-03-31T19:56:48.544 INFO:teuthology.orchestra.console.smithi142:Power off completed
2024-03-31T19:56:48.627 INFO:teuthology.orchestra.console.smithi026:Power on
2024-03-31T19:56:48.627 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-31T19:56:48.639 INFO:teuthology.orchestra.console.smithi046:Power on
2024-03-31T19:56:48.639 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-31T19:56:48.646 INFO:teuthology.orchestra.console.smithi142:Power on
2024-03-31T19:56:48.646 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-31T19:56:48.656 DEBUG:teuthology.orchestra.console.smithi026:power on output: Chassis Power Control: Up/On
2024-03-31T19:56:48.656 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-31T19:56:48.665 DEBUG:teuthology.orchestra.console.smithi046:power on output: Chassis Power Control: Up/On
2024-03-31T19:56:48.665 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-31T19:56:48.672 DEBUG:teuthology.orchestra.console.smithi142:power on output: Chassis Power Control: Up/On
2024-03-31T19:56:48.673 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-31T19:56:48.680 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off
2024-03-31T19:56:48.685 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off
2024-03-31T19:56:48.693 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off
2024-03-31T19:56:52.682 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-31T19:56:52.690 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-31T19:56:52.697 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-31T19:56:52.792 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off
2024-03-31T19:56:52.799 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off
2024-03-31T19:56:52.805 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off
2024-03-31T19:56:56.796 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-31T19:56:56.803 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-31T19:56:56.810 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-31T19:56:56.905 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on
2024-03-31T19:56:56.912 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on
2024-03-31T19:56:56.918 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on
2024-03-31T19:56:57.007 INFO:teuthology.orchestra.console.smithi026:Power on completed
2024-03-31T19:56:57.012 INFO:teuthology.orchestra.console.smithi046:Power on completed
2024-03-31T19:56:57.019 INFO:teuthology.orchestra.console.smithi142:Power on completed
2024-03-31T19:56:57.108 INFO:teuthology.provision.fog.smithi026:Waiting for deploy to finish
2024-03-31T19:56:57.112 INFO:teuthology.provision.fog.smithi046:Waiting for deploy to finish
2024-03-31T19:56:57.121 INFO:teuthology.provision.fog.smithi142:Waiting for deploy to finish
2024-03-31T19:59:13.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T19:59:16.098 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26
2024-03-31T19:59:22.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T19:59:25.186 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26
2024-03-31T19:59:28.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T19:59:28.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T19:59:31.166 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46
2024-03-31T19:59:31.167 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-03-31T19:59:31.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T19:59:34.242 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26
2024-03-31T19:59:37.169 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T19:59:37.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T19:59:40.222 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46
2024-03-31T19:59:40.223 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-03-31T19:59:40.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T19:59:43.298 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26
2024-03-31T19:59:46.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T19:59:46.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T19:59:49.278 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46
2024-03-31T19:59:49.279 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-03-31T19:59:49.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T19:59:52.350 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26
2024-03-31T19:59:55.283 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T19:59:55.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T19:59:58.334 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46
2024-03-31T19:59:58.335 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-03-31T19:59:58.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T20:00:04.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T20:00:04.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T20:00:07.390 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46
2024-03-31T20:00:07.391 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-03-31T20:00:13.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T20:00:13.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T20:00:16.446 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46
2024-03-31T20:00:16.447 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-03-31T20:00:16.670 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26
2024-03-31T20:00:22.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T20:00:22.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T20:00:22.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T20:00:25.502 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46
2024-03-31T20:00:25.726 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26
2024-03-31T20:00:31.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T20:00:31.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T20:00:34.506 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-31T20:00:34.507 DEBUG:teuthology.orchestra.run.smithi026:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-31T20:00:54.873 INFO:teuthology.provision.fog.smithi026:Node is ready
2024-03-31T20:00:54.874 DEBUG:teuthology.orchestra.run.smithi026:> hostname
2024-03-31T20:00:54.937 INFO:teuthology.orchestra.run.smithi026.stdout:smithi026.front.sepia.ceph.com
2024-03-31T20:00:54.937 DEBUG:teuthology.orchestra.run.smithi026:> grep smithi026.front.sepia.ceph.com /etc/hosts
2024-03-31T20:00:54.995 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26 smithi026.front.sepia.ceph.com smithi026
2024-03-31T20:00:54.995 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026
2024-03-31T20:00:55.125 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hosts
2024-03-31T20:00:55.161 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/172.21.15.26/172.21.15.26/g' /etc/hosts
2024-03-31T20:00:55.234 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hostname
2024-03-31T20:00:55.308 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026
2024-03-31T20:00:55.379 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release
2024-03-31T20:00:55.436 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="CentOS Stream"
2024-03-31T20:00:55.436 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="9"
2024-03-31T20:00:55.436 INFO:teuthology.orchestra.run.smithi026.stdout:ID="centos"
2024-03-31T20:00:55.436 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="rhel fedora"
2024-03-31T20:00:55.436 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="9"
2024-03-31T20:00:55.436 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el9"
2024-03-31T20:00:55.436 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-31T20:00:55.436 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31"
2024-03-31T20:00:55.436 INFO:teuthology.orchestra.run.smithi026.stdout:LOGO="fedora-logo-icon"
2024-03-31T20:00:55.436 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-31T20:00:55.437 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://centos.org/"
2024-03-31T20:00:55.437 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-31T20:00:55.437 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-31T20:00:55.437 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-31T20:00:55.438 INFO:teuthology.provision.fog.smithi026:Deploy complete!
2024-03-31T20:00:55.439 DEBUG:teuthology.parallel:result is None
2024-03-31T20:01:22.454 WARNING:teuthology.provision.fog.smithi142:timed out
2024-03-31T20:01:28.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T20:01:28.722 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-31T20:01:28.722 DEBUG:teuthology.orchestra.run.smithi142:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-31T20:01:29.057 INFO:teuthology.provision.fog.smithi142:Node is ready
2024-03-31T20:01:29.058 DEBUG:teuthology.orchestra.run.smithi142:> hostname
2024-03-31T20:01:29.073 INFO:teuthology.orchestra.run.smithi142.stdout:smithi142.front.sepia.ceph.com
2024-03-31T20:01:29.073 DEBUG:teuthology.orchestra.run.smithi142:> grep smithi142.front.sepia.ceph.com /etc/hosts
2024-03-31T20:01:29.129 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142 smithi142.front.sepia.ceph.com smithi142
2024-03-31T20:01:29.130 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142
2024-03-31T20:01:29.226 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hosts
2024-03-31T20:01:29.254 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/172.21.15.142/172.21.15.142/g' /etc/hosts
2024-03-31T20:01:29.322 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hostname
2024-03-31T20:01:29.389 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142
2024-03-31T20:01:29.455 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release
2024-03-31T20:01:29.510 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream"
2024-03-31T20:01:29.510 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="9"
2024-03-31T20:01:29.510 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos"
2024-03-31T20:01:29.510 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora"
2024-03-31T20:01:29.510 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="9"
2024-03-31T20:01:29.510 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el9"
2024-03-31T20:01:29.510 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-31T20:01:29.510 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31"
2024-03-31T20:01:29.510 INFO:teuthology.orchestra.run.smithi142.stdout:LOGO="fedora-logo-icon"
2024-03-31T20:01:29.510 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-31T20:01:29.511 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/"
2024-03-31T20:01:29.511 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-31T20:01:29.511 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-31T20:01:29.511 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-31T20:01:29.511 INFO:teuthology.provision.fog.smithi142:Deploy complete!
2024-03-31T20:01:29.512 DEBUG:teuthology.parallel:result is None
2024-03-31T20:01:31.510 WARNING:teuthology.provision.fog.smithi046:timed out
2024-03-31T20:01:37.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T20:01:37.793 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-31T20:01:37.793 DEBUG:teuthology.orchestra.run.smithi046:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-31T20:01:38.144 INFO:teuthology.provision.fog.smithi046:Node is ready
2024-03-31T20:01:38.144 DEBUG:teuthology.orchestra.run.smithi046:> hostname
2024-03-31T20:01:38.159 INFO:teuthology.orchestra.run.smithi046.stdout:smithi046.front.sepia.ceph.com
2024-03-31T20:01:38.160 DEBUG:teuthology.orchestra.run.smithi046:> grep smithi046.front.sepia.ceph.com /etc/hosts
2024-03-31T20:01:38.215 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046
2024-03-31T20:01:38.215 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname smithi046
2024-03-31T20:01:38.339 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/smithi046.front.sepia.ceph.com/smithi046/g' /etc/hosts
2024-03-31T20:01:38.371 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/172.21.15.46/172.21.15.46/g' /etc/hosts
2024-03-31T20:01:38.443 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/smithi046.front.sepia.ceph.com/smithi046/g' /etc/hostname
2024-03-31T20:01:38.514 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname smithi046
2024-03-31T20:01:38.585 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release
2024-03-31T20:01:38.639 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="CentOS Stream"
2024-03-31T20:01:38.640 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="9"
2024-03-31T20:01:38.640 INFO:teuthology.orchestra.run.smithi046.stdout:ID="centos"
2024-03-31T20:01:38.640 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="rhel fedora"
2024-03-31T20:01:38.640 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="9"
2024-03-31T20:01:38.640 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el9"
2024-03-31T20:01:38.640 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-31T20:01:38.640 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31"
2024-03-31T20:01:38.640 INFO:teuthology.orchestra.run.smithi046.stdout:LOGO="fedora-logo-icon"
2024-03-31T20:01:38.640 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-31T20:01:38.640 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://centos.org/"
2024-03-31T20:01:38.640 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-31T20:01:38.640 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-31T20:01:38.640 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-31T20:01:38.641 INFO:teuthology.provision.fog.smithi046:Deploy complete!
2024-03-31T20:01:38.641 DEBUG:teuthology.parallel:result is None
2024-03-31T20:01:38.888 INFO:teuthology.lock.ops:Checking smithi026.front.sepia.ceph.com
2024-03-31T20:01:38.888 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-31T20:01:38.910 INFO:teuthology.lock.ops:Checking smithi046.front.sepia.ceph.com
2024-03-31T20:01:38.910 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-31T20:01:38.934 INFO:teuthology.lock.ops:Checking smithi142.front.sepia.ceph.com
2024-03-31T20:01:38.934 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-31T20:01:38.952 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: set os type and version on server
2024-03-31T20:01:38.952 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com'
2024-03-31T20:01:38.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T20:01:39.054 DEBUG:teuthology.orchestra.run.smithi026:> true
2024-03-31T20:01:39.237 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com'
2024-03-31T20:01:39.237 DEBUG:teuthology.orchestra.run.smithi026:> uname -m
2024-03-31T20:01:39.292 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64
2024-03-31T20:01:39.292 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release
2024-03-31T20:01:39.346 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="CentOS Stream"
2024-03-31T20:01:39.346 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="9"
2024-03-31T20:01:39.347 INFO:teuthology.orchestra.run.smithi026.stdout:ID="centos"
2024-03-31T20:01:39.347 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="rhel fedora"
2024-03-31T20:01:39.347 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="9"
2024-03-31T20:01:39.347 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el9"
2024-03-31T20:01:39.347 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-31T20:01:39.347 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31"
2024-03-31T20:01:39.347 INFO:teuthology.orchestra.run.smithi026.stdout:LOGO="fedora-logo-icon"
2024-03-31T20:01:39.347 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-31T20:01:39.347 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://centos.org/"
2024-03-31T20:01:39.347 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-31T20:01:39.347 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-31T20:01:39.347 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-31T20:01:39.348 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server
2024-03-31T20:01:39.368 INFO:teuthology.lock.ops:Updating [smithi046.front.sepia.ceph.com]: set os type and version on server
2024-03-31T20:01:39.369 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com'
2024-03-31T20:01:39.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T20:01:39.469 DEBUG:teuthology.orchestra.run.smithi046:> true
2024-03-31T20:01:39.537 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com'
2024-03-31T20:01:39.537 DEBUG:teuthology.orchestra.run.smithi046:> uname -m
2024-03-31T20:01:39.593 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64
2024-03-31T20:01:39.594 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release
2024-03-31T20:01:39.649 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="CentOS Stream"
2024-03-31T20:01:39.649 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="9"
2024-03-31T20:01:39.649 INFO:teuthology.orchestra.run.smithi046.stdout:ID="centos"
2024-03-31T20:01:39.650 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="rhel fedora"
2024-03-31T20:01:39.650 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="9"
2024-03-31T20:01:39.650 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el9"
2024-03-31T20:01:39.650 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-31T20:01:39.651 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31"
2024-03-31T20:01:39.651 INFO:teuthology.orchestra.run.smithi046.stdout:LOGO="fedora-logo-icon"
2024-03-31T20:01:39.651 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-31T20:01:39.651 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://centos.org/"
2024-03-31T20:01:39.651 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-31T20:01:39.651 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-31T20:01:39.651 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-31T20:01:39.652 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server
2024-03-31T20:01:39.677 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: set os type and version on server
2024-03-31T20:01:39.677 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com'
2024-03-31T20:01:39.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T20:01:39.767 DEBUG:teuthology.orchestra.run.smithi142:> true
2024-03-31T20:01:39.932 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com'
2024-03-31T20:01:39.932 DEBUG:teuthology.orchestra.run.smithi142:> uname -m
2024-03-31T20:01:39.987 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64
2024-03-31T20:01:39.987 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release
2024-03-31T20:01:40.042 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream"
2024-03-31T20:01:40.042 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="9"
2024-03-31T20:01:40.042 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos"
2024-03-31T20:01:40.042 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora"
2024-03-31T20:01:40.042 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="9"
2024-03-31T20:01:40.042 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el9"
2024-03-31T20:01:40.042 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-31T20:01:40.042 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31"
2024-03-31T20:01:40.042 INFO:teuthology.orchestra.run.smithi142.stdout:LOGO="fedora-logo-icon"
2024-03-31T20:01:40.042 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-31T20:01:40.043 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/"
2024-03-31T20:01:40.043 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-31T20:01:40.043 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-31T20:01:40.043 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-31T20:01:40.043 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server
2024-03-31T20:01:40.068 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-31T20:01:40.167 INFO:teuthology.dispatcher.supervisor:Running job 7632268
2024-03-31T20:01:40.167 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-03-31_13:02:52-fs-wip-vshankar-testing-20240330.172700-testing-default-smithi/7632268 --name vshankar-2024-03-31_13:02:52-fs-wip-vshankar-testing-20240330.172700-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/suites/fsstress}} -- /home/teuthworker/archive/vshankar-2024-03-31_13:02:52-fs-wip-vshankar-testing-20240330.172700-testing-default-smithi/7632268/orig.config.yaml
2024-03-31T20:01:40.170 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-03-31_13:02:52-fs-wip-vshankar-testing-20240330.172700-testing-default-smithi/7632268
2024-03-31T20:01:40.170 INFO:teuthology.dispatcher.supervisor:Job PID: 1584308
2024-03-31T20:01:40.171 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-31T20:03:40.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-31T20:05:40.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-31T20:07:40.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-31T20:09:40.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-31T20:11:40.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-31T20:13:41.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-31T20:15:41.281 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-31T20:17:41.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-31T20:17:41.520 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1