2024-03-28T12:37:54.925 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-28T12:37:54.926 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T12:37:55.091 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fb45fe9bf70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fb460efcc10>, signals=[15])
2024-03-28T12:37:55.092 INFO:teuthology.lock.ops:Start node 'smithi016.front.sepia.ceph.com' reimaging
2024-03-28T12:37:55.092 INFO:teuthology.lock.ops:Updating [smithi016.front.sepia.ceph.com]: reset os type and version on server
2024-03-28T12:37:55.092 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server
2024-03-28T12:37:55.113 INFO:teuthology.lock.ops:Start node 'smithi171.front.sepia.ceph.com' reimaging
2024-03-28T12:37:55.113 INFO:teuthology.lock.ops:Updating [smithi171.front.sepia.ceph.com]: reset os type and version on server
2024-03-28T12:37:55.113 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server
2024-03-28T12:37:55.137 INFO:teuthology.lock.ops:Start node 'smithi189.front.sepia.ceph.com' reimaging
2024-03-28T12:37:55.138 INFO:teuthology.lock.ops:Updating [smithi189.front.sepia.ceph.com]: reset os type and version on server
2024-03-28T12:37:55.138 INFO:teuthology.lock.ops:Updating smithi189.front.sepia.ceph.com on lock server
2024-03-28T12:37:55.231 DEBUG:teuthology.provision.fog.smithi016:Requesting image smithi_centos_9.stream (ID 10)
2024-03-28T12:37:55.276 DEBUG:teuthology.provision.fog.smithi171:Requesting image smithi_centos_9.stream (ID 10)
2024-03-28T12:37:55.291 INFO:teuthology.provision.fog.smithi016:Scheduling deploy of centos 9.stream
2024-03-28T12:37:55.339 INFO:teuthology.provision.fog.smithi171:Scheduling deploy of centos 9.stream
2024-03-28T12:37:55.345 DEBUG:teuthology.provision.fog.smithi189:Requesting image smithi_centos_9.stream (ID 10)
2024-03-28T12:37:55.403 INFO:teuthology.provision.fog.smithi189:Scheduling deploy of centos 9.stream
2024-03-28T12:37:56.226 INFO:teuthology.orchestra.console.smithi016:Power off
2024-03-28T12:37:56.226 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-28T12:37:56.248 DEBUG:teuthology.orchestra.console.smithi016:power off output: Chassis Power Control: Down/Off
2024-03-28T12:37:56.248 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T12:37:56.271 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is on
2024-03-28T12:37:56.335 INFO:teuthology.orchestra.console.smithi171:Power off
2024-03-28T12:37:56.336 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-28T12:37:56.348 INFO:teuthology.orchestra.console.smithi189:Power off
2024-03-28T12:37:56.348 DEBUG:teuthology.orchestra.console.smithi189:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-28T12:37:56.357 DEBUG:teuthology.orchestra.console.smithi171:power off output: Chassis Power Control: Down/Off
2024-03-28T12:37:56.357 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T12:37:56.377 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is off
2024-03-28T12:37:56.380 DEBUG:teuthology.orchestra.console.smithi189:power off output: Chassis Power Control: Down/Off
2024-03-28T12:37:56.380 DEBUG:teuthology.orchestra.console.smithi189:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T12:37:56.402 DEBUG:teuthology.orchestra.console.smithi189:check power output: Chassis Power is on
2024-03-28T12:37:56.478 INFO:teuthology.orchestra.console.smithi171:Power off completed
2024-03-28T12:37:56.579 INFO:teuthology.orchestra.console.smithi171:Power on
2024-03-28T12:37:56.579 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-28T12:37:56.599 DEBUG:teuthology.orchestra.console.smithi171:power on output: Chassis Power Control: Up/On
2024-03-28T12:37:56.599 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T12:37:56.621 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is off
2024-03-28T12:38:00.276 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T12:38:00.385 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is on
2024-03-28T12:38:00.402 DEBUG:teuthology.orchestra.console.smithi189:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T12:38:00.511 DEBUG:teuthology.orchestra.console.smithi189:check power output: Chassis Power is on
2024-03-28T12:38:00.622 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T12:38:00.730 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is on
2024-03-28T12:38:00.831 INFO:teuthology.orchestra.console.smithi171:Power on completed
2024-03-28T12:38:00.932 INFO:teuthology.provision.fog.smithi171:Waiting for deploy to finish
2024-03-28T12:38:04.390 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T12:38:04.498 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is off
2024-03-28T12:38:04.513 DEBUG:teuthology.orchestra.console.smithi189:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T12:38:04.599 INFO:teuthology.orchestra.console.smithi016:Power off completed
2024-03-28T12:38:04.622 DEBUG:teuthology.orchestra.console.smithi189:check power output: Chassis Power is off
2024-03-28T12:38:04.701 INFO:teuthology.orchestra.console.smithi016:Power on
2024-03-28T12:38:04.701 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-28T12:38:04.722 DEBUG:teuthology.orchestra.console.smithi016:power on output: Chassis Power Control: Up/On
2024-03-28T12:38:04.722 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T12:38:04.728 INFO:teuthology.orchestra.console.smithi189:Power off completed
2024-03-28T12:38:04.745 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is off
2024-03-28T12:38:04.830 INFO:teuthology.orchestra.console.smithi189:Power on
2024-03-28T12:38:04.830 DEBUG:teuthology.orchestra.console.smithi189:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-28T12:38:04.852 DEBUG:teuthology.orchestra.console.smithi189:power on output: Chassis Power Control: Up/On
2024-03-28T12:38:04.853 DEBUG:teuthology.orchestra.console.smithi189:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T12:38:04.876 DEBUG:teuthology.orchestra.console.smithi189:check power output: Chassis Power is off
2024-03-28T12:38:08.748 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T12:38:08.856 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is off
2024-03-28T12:38:08.877 DEBUG:teuthology.orchestra.console.smithi189:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T12:38:08.985 DEBUG:teuthology.orchestra.console.smithi189:check power output: Chassis Power is on
2024-03-28T12:38:09.085 INFO:teuthology.orchestra.console.smithi189:Power on completed
2024-03-28T12:38:09.186 INFO:teuthology.provision.fog.smithi189:Waiting for deploy to finish
2024-03-28T12:38:12.860 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T12:38:12.969 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is on
2024-03-28T12:38:13.070 INFO:teuthology.orchestra.console.smithi016:Power on completed
2024-03-28T12:38:13.170 INFO:teuthology.provision.fog.smithi016:Waiting for deploy to finish
2024-03-28T12:42:27.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T12:42:30.622 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189
2024-03-28T12:42:31.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T12:42:34.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T12:42:34.978 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16
2024-03-28T12:42:36.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T12:42:37.502 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171
2024-03-28T12:42:39.682 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189
2024-03-28T12:42:40.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T12:42:43.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T12:42:44.062 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16
2024-03-28T12:42:45.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T12:42:46.562 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171
2024-03-28T12:42:48.766 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189
2024-03-28T12:42:50.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T12:42:52.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T12:42:53.118 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16
2024-03-28T12:42:54.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T12:42:55.646 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171
2024-03-28T12:42:57.822 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189
2024-03-28T12:42:59.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T12:43:01.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T12:43:02.174 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16
2024-03-28T12:43:03.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T12:43:04.702 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171
2024-03-28T12:43:06.878 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189
2024-03-28T12:43:08.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T12:43:10.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T12:43:11.230 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16
2024-03-28T12:43:12.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T12:43:13.758 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171
2024-03-28T12:43:15.934 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189
2024-03-28T12:43:17.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T12:43:19.762 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T12:43:21.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T12:43:22.814 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171
2024-03-28T12:43:24.990 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189
2024-03-28T12:43:28.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T12:43:30.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T12:43:34.046 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189
2024-03-28T12:43:40.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T12:44:17.273 WARNING:teuthology.provision.fog.smithi016:timed out
2024-03-28T12:44:23.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T12:44:23.495 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-28T12:44:23.496 DEBUG:teuthology.orchestra.run.smithi016:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-28T12:44:23.844 INFO:teuthology.provision.fog.smithi016:Node is ready
2024-03-28T12:44:23.844 DEBUG:teuthology.orchestra.run.smithi016:> hostname
2024-03-28T12:44:23.859 INFO:teuthology.orchestra.run.smithi016.stdout:smithi016.front.sepia.ceph.com
2024-03-28T12:44:23.860 DEBUG:teuthology.orchestra.run.smithi016:> grep smithi016.front.sepia.ceph.com /etc/hosts
2024-03-28T12:44:23.915 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16 smithi016.front.sepia.ceph.com smithi016
2024-03-28T12:44:23.916 DEBUG:teuthology.orchestra.run.smithi016:> sudo hostname smithi016
2024-03-28T12:44:24.022 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i -e 's/smithi016.front.sepia.ceph.com/smithi016/g' /etc/hosts
2024-03-28T12:44:24.055 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i -e 's/172.21.15.16/172.21.15.16/g' /etc/hosts
2024-03-28T12:44:24.127 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i -e 's/smithi016.front.sepia.ceph.com/smithi016/g' /etc/hostname
2024-03-28T12:44:24.200 DEBUG:teuthology.orchestra.run.smithi016:> sudo hostname smithi016
2024-03-28T12:44:24.272 DEBUG:teuthology.orchestra.run.smithi016:> cat /etc/os-release
2024-03-28T12:44:24.327 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="CentOS Stream"
2024-03-28T12:44:24.327 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="9"
2024-03-28T12:44:24.327 INFO:teuthology.orchestra.run.smithi016.stdout:ID="centos"
2024-03-28T12:44:24.327 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE="rhel fedora"
2024-03-28T12:44:24.327 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="9"
2024-03-28T12:44:24.327 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM_ID="platform:el9"
2024-03-28T12:44:24.327 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-28T12:44:24.327 INFO:teuthology.orchestra.run.smithi016.stdout:ANSI_COLOR="0;31"
2024-03-28T12:44:24.328 INFO:teuthology.orchestra.run.smithi016.stdout:LOGO="fedora-logo-icon"
2024-03-28T12:44:24.328 INFO:teuthology.orchestra.run.smithi016.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-28T12:44:24.328 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://centos.org/"
2024-03-28T12:44:24.328 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-28T12:44:24.328 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-28T12:44:24.328 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-28T12:44:24.329 INFO:teuthology.provision.fog.smithi016:Deploy complete!
2024-03-28T12:44:24.330 DEBUG:teuthology.parallel:result is None
2024-03-28T12:44:28.823 WARNING:teuthology.provision.fog.smithi171:timed out
2024-03-28T12:44:34.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T12:44:35.100 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-28T12:44:35.100 DEBUG:teuthology.orchestra.run.smithi171:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-28T12:44:35.406 INFO:teuthology.provision.fog.smithi171:Node is ready
2024-03-28T12:44:35.406 DEBUG:teuthology.orchestra.run.smithi171:> hostname
2024-03-28T12:44:35.420 INFO:teuthology.orchestra.run.smithi171.stdout:smithi171.front.sepia.ceph.com
2024-03-28T12:44:35.420 DEBUG:teuthology.orchestra.run.smithi171:> grep smithi171.front.sepia.ceph.com /etc/hosts
2024-03-28T12:44:35.476 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.15.171 smithi171.front.sepia.ceph.com smithi171
2024-03-28T12:44:35.477 DEBUG:teuthology.orchestra.run.smithi171:> sudo hostname smithi171
2024-03-28T12:44:35.585 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i -e 's/smithi171.front.sepia.ceph.com/smithi171/g' /etc/hosts
2024-03-28T12:44:35.613 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i -e 's/172.21.15.171/172.21.15.171/g' /etc/hosts
2024-03-28T12:44:35.680 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i -e 's/smithi171.front.sepia.ceph.com/smithi171/g' /etc/hostname
2024-03-28T12:44:35.747 DEBUG:teuthology.orchestra.run.smithi171:> sudo hostname smithi171
2024-03-28T12:44:35.814 DEBUG:teuthology.orchestra.run.smithi171:> cat /etc/os-release
2024-03-28T12:44:35.868 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="CentOS Stream"
2024-03-28T12:44:35.868 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="9"
2024-03-28T12:44:35.869 INFO:teuthology.orchestra.run.smithi171.stdout:ID="centos"
2024-03-28T12:44:35.869 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE="rhel fedora"
2024-03-28T12:44:35.869 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="9"
2024-03-28T12:44:35.869 INFO:teuthology.orchestra.run.smithi171.stdout:PLATFORM_ID="platform:el9"
2024-03-28T12:44:35.869 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-28T12:44:35.869 INFO:teuthology.orchestra.run.smithi171.stdout:ANSI_COLOR="0;31"
2024-03-28T12:44:35.869 INFO:teuthology.orchestra.run.smithi171.stdout:LOGO="fedora-logo-icon"
2024-03-28T12:44:35.869 INFO:teuthology.orchestra.run.smithi171.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-28T12:44:35.869 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://centos.org/"
2024-03-28T12:44:35.869 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-28T12:44:35.869 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-28T12:44:35.869 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-28T12:44:35.870 INFO:teuthology.provision.fog.smithi171:Deploy complete!
2024-03-28T12:44:35.870 DEBUG:teuthology.parallel:result is None
2024-03-28T12:44:40.055 WARNING:teuthology.provision.fog.smithi189:timed out
2024-03-28T12:44:46.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T12:44:46.337 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-28T12:44:46.337 DEBUG:teuthology.orchestra.run.smithi189:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-28T12:44:46.679 INFO:teuthology.provision.fog.smithi189:Node is ready
2024-03-28T12:44:46.679 DEBUG:teuthology.orchestra.run.smithi189:> hostname
2024-03-28T12:44:46.693 INFO:teuthology.orchestra.run.smithi189.stdout:smithi189.front.sepia.ceph.com
2024-03-28T12:44:46.694 DEBUG:teuthology.orchestra.run.smithi189:> grep smithi189.front.sepia.ceph.com /etc/hosts
2024-03-28T12:44:46.749 INFO:teuthology.orchestra.run.smithi189.stdout:172.21.15.189 smithi189.front.sepia.ceph.com smithi189
2024-03-28T12:44:46.749 DEBUG:teuthology.orchestra.run.smithi189:> sudo hostname smithi189
2024-03-28T12:44:46.853 DEBUG:teuthology.orchestra.run.smithi189:> sudo sed -i -e 's/smithi189.front.sepia.ceph.com/smithi189/g' /etc/hosts
2024-03-28T12:44:46.881 DEBUG:teuthology.orchestra.run.smithi189:> sudo sed -i -e 's/172.21.15.189/172.21.15.189/g' /etc/hosts
2024-03-28T12:44:46.947 DEBUG:teuthology.orchestra.run.smithi189:> sudo sed -i -e 's/smithi189.front.sepia.ceph.com/smithi189/g' /etc/hostname
2024-03-28T12:44:47.015 DEBUG:teuthology.orchestra.run.smithi189:> sudo hostname smithi189
2024-03-28T12:44:47.081 DEBUG:teuthology.orchestra.run.smithi189:> cat /etc/os-release
2024-03-28T12:44:47.135 INFO:teuthology.orchestra.run.smithi189.stdout:NAME="CentOS Stream"
2024-03-28T12:44:47.136 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION="9"
2024-03-28T12:44:47.136 INFO:teuthology.orchestra.run.smithi189.stdout:ID="centos"
2024-03-28T12:44:47.136 INFO:teuthology.orchestra.run.smithi189.stdout:ID_LIKE="rhel fedora"
2024-03-28T12:44:47.136 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION_ID="9"
2024-03-28T12:44:47.136 INFO:teuthology.orchestra.run.smithi189.stdout:PLATFORM_ID="platform:el9"
2024-03-28T12:44:47.136 INFO:teuthology.orchestra.run.smithi189.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-28T12:44:47.136 INFO:teuthology.orchestra.run.smithi189.stdout:ANSI_COLOR="0;31"
2024-03-28T12:44:47.136 INFO:teuthology.orchestra.run.smithi189.stdout:LOGO="fedora-logo-icon"
2024-03-28T12:44:47.136 INFO:teuthology.orchestra.run.smithi189.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-28T12:44:47.137 INFO:teuthology.orchestra.run.smithi189.stdout:HOME_URL="https://centos.org/"
2024-03-28T12:44:47.137 INFO:teuthology.orchestra.run.smithi189.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-28T12:44:47.137 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-28T12:44:47.137 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-28T12:44:47.137 INFO:teuthology.provision.fog.smithi189:Deploy complete!
2024-03-28T12:44:47.138 DEBUG:teuthology.parallel:result is None
2024-03-28T12:44:47.353 INFO:teuthology.lock.ops:Checking smithi016.front.sepia.ceph.com
2024-03-28T12:44:47.353 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-28T12:44:47.382 INFO:teuthology.lock.ops:Checking smithi171.front.sepia.ceph.com
2024-03-28T12:44:47.382 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-28T12:44:47.398 INFO:teuthology.lock.ops:Checking smithi189.front.sepia.ceph.com
2024-03-28T12:44:47.398 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-28T12:44:47.416 INFO:teuthology.lock.ops:Updating [smithi016.front.sepia.ceph.com]: set os type and version on server
2024-03-28T12:44:47.416 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com'
2024-03-28T12:44:47.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T12:44:47.517 DEBUG:teuthology.orchestra.run.smithi016:> true
2024-03-28T12:44:47.697 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi016.front.sepia.ceph.com'
2024-03-28T12:44:47.697 DEBUG:teuthology.orchestra.run.smithi016:> uname -m
2024-03-28T12:44:47.751 INFO:teuthology.orchestra.run.smithi016.stdout:x86_64
2024-03-28T12:44:47.752 DEBUG:teuthology.orchestra.run.smithi016:> cat /etc/os-release
2024-03-28T12:44:47.807 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="CentOS Stream"
2024-03-28T12:44:47.807 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="9"
2024-03-28T12:44:47.807 INFO:teuthology.orchestra.run.smithi016.stdout:ID="centos"
2024-03-28T12:44:47.807 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE="rhel fedora"
2024-03-28T12:44:47.807 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="9"
2024-03-28T12:44:47.807 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM_ID="platform:el9"
2024-03-28T12:44:47.807 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-28T12:44:47.807 INFO:teuthology.orchestra.run.smithi016.stdout:ANSI_COLOR="0;31"
2024-03-28T12:44:47.807 INFO:teuthology.orchestra.run.smithi016.stdout:LOGO="fedora-logo-icon"
2024-03-28T12:44:47.808 INFO:teuthology.orchestra.run.smithi016.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-28T12:44:47.808 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://centos.org/"
2024-03-28T12:44:47.808 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-28T12:44:47.808 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-28T12:44:47.808 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-28T12:44:47.808 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server
2024-03-28T12:44:47.831 INFO:teuthology.lock.ops:Updating [smithi171.front.sepia.ceph.com]: set os type and version on server
2024-03-28T12:44:47.831 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com'
2024-03-28T12:44:47.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T12:44:47.921 DEBUG:teuthology.orchestra.run.smithi171:> true
2024-03-28T12:44:48.099 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi171.front.sepia.ceph.com'
2024-03-28T12:44:48.100 DEBUG:teuthology.orchestra.run.smithi171:> uname -m
2024-03-28T12:44:48.152 INFO:teuthology.orchestra.run.smithi171.stdout:x86_64
2024-03-28T12:44:48.152 DEBUG:teuthology.orchestra.run.smithi171:> cat /etc/os-release
2024-03-28T12:44:48.205 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="CentOS Stream"
2024-03-28T12:44:48.205 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="9"
2024-03-28T12:44:48.205 INFO:teuthology.orchestra.run.smithi171.stdout:ID="centos"
2024-03-28T12:44:48.205 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE="rhel fedora"
2024-03-28T12:44:48.206 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="9"
2024-03-28T12:44:48.206 INFO:teuthology.orchestra.run.smithi171.stdout:PLATFORM_ID="platform:el9"
2024-03-28T12:44:48.206 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-28T12:44:48.206 INFO:teuthology.orchestra.run.smithi171.stdout:ANSI_COLOR="0;31"
2024-03-28T12:44:48.206 INFO:teuthology.orchestra.run.smithi171.stdout:LOGO="fedora-logo-icon"
2024-03-28T12:44:48.206 INFO:teuthology.orchestra.run.smithi171.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-28T12:44:48.206 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://centos.org/"
2024-03-28T12:44:48.206 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-28T12:44:48.206 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-28T12:44:48.206 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-28T12:44:48.207 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server
2024-03-28T12:44:48.249 INFO:teuthology.lock.ops:Updating [smithi189.front.sepia.ceph.com]: set os type and version on server
2024-03-28T12:44:48.249 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com'
2024-03-28T12:44:48.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T12:44:48.338 DEBUG:teuthology.orchestra.run.smithi189:> true
2024-03-28T12:44:48.407 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi189.front.sepia.ceph.com'
2024-03-28T12:44:48.407 DEBUG:teuthology.orchestra.run.smithi189:> uname -m
2024-03-28T12:44:48.463 INFO:teuthology.orchestra.run.smithi189.stdout:x86_64
2024-03-28T12:44:48.463 DEBUG:teuthology.orchestra.run.smithi189:> cat /etc/os-release
2024-03-28T12:44:48.520 INFO:teuthology.orchestra.run.smithi189.stdout:NAME="CentOS Stream"
2024-03-28T12:44:48.520 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION="9"
2024-03-28T12:44:48.520 INFO:teuthology.orchestra.run.smithi189.stdout:ID="centos"
2024-03-28T12:44:48.520 INFO:teuthology.orchestra.run.smithi189.stdout:ID_LIKE="rhel fedora"
2024-03-28T12:44:48.520 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION_ID="9"
2024-03-28T12:44:48.520 INFO:teuthology.orchestra.run.smithi189.stdout:PLATFORM_ID="platform:el9"
2024-03-28T12:44:48.520 INFO:teuthology.orchestra.run.smithi189.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-28T12:44:48.520 INFO:teuthology.orchestra.run.smithi189.stdout:ANSI_COLOR="0;31"
2024-03-28T12:44:48.521 INFO:teuthology.orchestra.run.smithi189.stdout:LOGO="fedora-logo-icon"
2024-03-28T12:44:48.521 INFO:teuthology.orchestra.run.smithi189.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-28T12:44:48.521 INFO:teuthology.orchestra.run.smithi189.stdout:HOME_URL="https://centos.org/"
2024-03-28T12:44:48.521 INFO:teuthology.orchestra.run.smithi189.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-28T12:44:48.521 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-28T12:44:48.521 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-28T12:44:48.522 INFO:teuthology.lock.ops:Updating smithi189.front.sepia.ceph.com on lock server
2024-03-28T12:44:48.540 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T12:44:48.629 INFO:teuthology.dispatcher.supervisor:Running job 7627844
2024-03-28T12:44:48.630 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-03-28_07:14:07-fs-wip-batrick-testing-20240327.230800-distro-default-smithi/7627844 --name pdonnell-2024-03-28_07:14:07-fs-wip-batrick-testing-20240327.230800-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/suites/ffsb}} -- /home/teuthworker/archive/pdonnell-2024-03-28_07:14:07-fs-wip-batrick-testing-20240327.230800-distro-default-smithi/7627844/orig.config.yaml
2024-03-28T12:44:48.633 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-03-28_07:14:07-fs-wip-batrick-testing-20240327.230800-distro-default-smithi/7627844
2024-03-28T12:44:48.633 INFO:teuthology.dispatcher.supervisor:Job PID: 4084488
2024-03-28T12:44:48.633 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-28T12:46:48.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T12:48:48.922 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T12:50:49.149 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T12:52:49.323 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T12:54:49.488 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T12:56:49.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T12:58:49.885 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T13:00:49.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T13:02:50.049 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T13:04:50.218 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T13:06:50.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T13:08:50.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T13:10:50.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T13:12:50.892 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T13:14:51.080 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T13:16:51.244 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T13:18:51.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T13:20:51.578 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T13:22:51.882 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T13:24:52.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T13:26:52.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T13:28:52.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T13:30:52.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T13:32:52.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T13:32:52.817 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1