2024-04-02T14:20:40.741 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-04-02T14:20:40.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T14:20:40.913 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f9e080f8f70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f9e09159c10>, signals=[15])
2024-04-02T14:20:40.913 INFO:teuthology.lock.ops:Start node 'smithi017.front.sepia.ceph.com' reimaging
2024-04-02T14:20:40.913 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: reset os type and version on server
2024-04-02T14:20:40.914 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server
2024-04-02T14:20:40.936 INFO:teuthology.lock.ops:Start node 'smithi079.front.sepia.ceph.com' reimaging
2024-04-02T14:20:40.936 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: reset os type and version on server
2024-04-02T14:20:40.936 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server
2024-04-02T14:20:40.960 INFO:teuthology.lock.ops:Start node 'smithi129.front.sepia.ceph.com' reimaging
2024-04-02T14:20:40.960 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: reset os type and version on server
2024-04-02T14:20:40.960 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server
2024-04-02T14:20:41.060 DEBUG:teuthology.provision.fog.smithi017:Requesting image smithi_centos_9.stream (ID 10)
2024-04-02T14:20:41.070 DEBUG:teuthology.provision.fog.smithi079:Requesting image smithi_centos_9.stream (ID 10)
2024-04-02T14:20:41.086 DEBUG:teuthology.provision.fog.smithi129:Requesting image smithi_centos_9.stream (ID 10)
2024-04-02T14:20:41.113 INFO:teuthology.provision.fog.smithi017:Scheduling deploy of centos 9.stream
2024-04-02T14:20:41.119 INFO:teuthology.provision.fog.smithi079:Scheduling deploy of centos 9.stream
2024-04-02T14:20:41.129 INFO:teuthology.provision.fog.smithi129:Scheduling deploy of centos 9.stream
2024-04-02T14:20:41.420 INFO:teuthology.orchestra.console.smithi129:Power off
2024-04-02T14:20:41.421 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-02T14:20:41.437 INFO:teuthology.orchestra.console.smithi079:Power off
2024-04-02T14:20:41.437 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-02T14:20:41.449 DEBUG:teuthology.orchestra.console.smithi129:power off output: Chassis Power Control: Down/Off
2024-04-02T14:20:41.449 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-02T14:20:41.459 DEBUG:teuthology.orchestra.console.smithi079:power off output: Chassis Power Control: Down/Off
2024-04-02T14:20:41.460 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-02T14:20:41.472 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on
2024-04-02T14:20:41.480 INFO:teuthology.orchestra.console.smithi017:Power off
2024-04-02T14:20:41.481 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-02T14:20:41.490 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on
2024-04-02T14:20:41.503 DEBUG:teuthology.orchestra.console.smithi017:power off output: Chassis Power Control: Down/Off
2024-04-02T14:20:41.503 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-02T14:20:41.524 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on
2024-04-02T14:20:45.476 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-02T14:20:45.492 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-02T14:20:45.525 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-02T14:20:45.585 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on
2024-04-02T14:20:45.601 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on
2024-04-02T14:20:45.634 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on
2024-04-02T14:20:49.590 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-02T14:20:49.602 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-02T14:20:49.635 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-02T14:20:49.700 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off
2024-04-02T14:20:49.711 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off
2024-04-02T14:20:49.744 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off
2024-04-02T14:20:49.801 INFO:teuthology.orchestra.console.smithi129:Power off completed
2024-04-02T14:20:49.812 INFO:teuthology.orchestra.console.smithi079:Power off completed
2024-04-02T14:20:49.846 INFO:teuthology.orchestra.console.smithi017:Power off completed
2024-04-02T14:20:49.902 INFO:teuthology.orchestra.console.smithi129:Power on
2024-04-02T14:20:49.902 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-02T14:20:49.913 INFO:teuthology.orchestra.console.smithi079:Power on
2024-04-02T14:20:49.914 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-02T14:20:49.925 DEBUG:teuthology.orchestra.console.smithi129:power on output: Chassis Power Control: Up/On
2024-04-02T14:20:49.926 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-02T14:20:49.933 DEBUG:teuthology.orchestra.console.smithi079:power on output: Chassis Power Control: Up/On
2024-04-02T14:20:49.933 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-02T14:20:49.946 INFO:teuthology.orchestra.console.smithi017:Power on
2024-04-02T14:20:49.946 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-02T14:20:49.954 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off
2024-04-02T14:20:49.955 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off
2024-04-02T14:20:49.969 DEBUG:teuthology.orchestra.console.smithi017:power on output: Chassis Power Control: Up/On
2024-04-02T14:20:49.970 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-02T14:20:49.989 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off
2024-04-02T14:20:53.956 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-02T14:20:53.964 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-02T14:20:53.990 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-02T14:20:54.066 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off
2024-04-02T14:20:54.071 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on
2024-04-02T14:20:54.098 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off
2024-04-02T14:20:54.172 INFO:teuthology.orchestra.console.smithi079:Power on completed
2024-04-02T14:20:54.273 INFO:teuthology.provision.fog.smithi079:Waiting for deploy to finish
2024-04-02T14:20:58.069 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-02T14:20:58.099 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-02T14:20:58.209 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on
2024-04-02T14:20:58.244 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on
2024-04-02T14:20:58.310 INFO:teuthology.orchestra.console.smithi017:Power on completed
2024-04-02T14:20:58.345 INFO:teuthology.orchestra.console.smithi129:Power on completed
2024-04-02T14:20:58.410 INFO:teuthology.provision.fog.smithi017:Waiting for deploy to finish
2024-04-02T14:20:58.446 INFO:teuthology.provision.fog.smithi129:Waiting for deploy to finish
2024-04-02T14:23:29.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T14:23:29.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T14:23:32.158 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17
2024-04-02T14:23:32.159 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129
2024-04-02T14:23:38.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T14:23:38.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T14:23:40.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T14:23:41.250 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17
2024-04-02T14:23:41.251 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129
2024-04-02T14:23:43.170 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2024-04-02T14:23:47.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T14:23:47.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T14:23:49.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T14:23:50.334 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17
2024-04-02T14:23:50.335 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129
2024-04-02T14:23:52.258 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2024-04-02T14:23:56.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T14:23:56.341 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T14:23:58.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T14:23:59.390 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17
2024-04-02T14:23:59.391 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129
2024-04-02T14:24:01.342 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2024-04-02T14:24:05.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T14:24:05.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T14:24:07.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T14:24:08.446 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17
2024-04-02T14:24:08.478 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129
2024-04-02T14:24:10.398 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2024-04-02T14:24:14.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T14:24:14.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T14:24:16.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T14:24:17.502 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17
2024-04-02T14:24:17.534 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129
2024-04-02T14:24:19.454 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2024-04-02T14:24:23.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T14:24:23.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T14:24:25.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T14:24:26.590 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129
2024-04-02T14:24:28.514 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2024-04-02T14:24:32.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T14:24:34.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T14:24:55.289 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-02T14:24:55.289 DEBUG:teuthology.orchestra.run.smithi017:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-02T14:25:15.210 INFO:teuthology.provision.fog.smithi017:Node is ready
2024-04-02T14:25:15.210 DEBUG:teuthology.orchestra.run.smithi017:> hostname
2024-04-02T14:25:15.229 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017.front.sepia.ceph.com
2024-04-02T14:25:15.230 DEBUG:teuthology.orchestra.run.smithi017:> grep smithi017.front.sepia.ceph.com /etc/hosts
2024-04-02T14:25:15.288 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17 smithi017.front.sepia.ceph.com smithi017
2024-04-02T14:25:15.288 DEBUG:teuthology.orchestra.run.smithi017:> sudo hostname smithi017
2024-04-02T14:25:15.430 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/smithi017.front.sepia.ceph.com/smithi017/g' /etc/hosts
2024-04-02T14:25:15.465 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/172.21.15.17/172.21.15.17/g' /etc/hosts
2024-04-02T14:25:15.541 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/smithi017.front.sepia.ceph.com/smithi017/g' /etc/hostname
2024-04-02T14:25:15.615 DEBUG:teuthology.orchestra.run.smithi017:> sudo hostname smithi017
2024-04-02T14:25:15.687 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release
2024-04-02T14:25:15.744 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Stream"
2024-04-02T14:25:15.744 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="9"
2024-04-02T14:25:15.745 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos"
2024-04-02T14:25:15.745 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora"
2024-04-02T14:25:15.745 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="9"
2024-04-02T14:25:15.745 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el9"
2024-04-02T14:25:15.745 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-02T14:25:15.746 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31"
2024-04-02T14:25:15.746 INFO:teuthology.orchestra.run.smithi017.stdout:LOGO="fedora-logo-icon"
2024-04-02T14:25:15.746 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-02T14:25:15.746 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/"
2024-04-02T14:25:15.747 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-02T14:25:15.747 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-02T14:25:15.747 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-02T14:25:15.748 INFO:teuthology.provision.fog.smithi017:Deploy complete!
2024-04-02T14:25:15.751 DEBUG:teuthology.parallel:result is None
2024-04-02T14:25:32.612 WARNING:teuthology.provision.fog.smithi129:timed out
2024-04-02T14:25:34.522 WARNING:teuthology.provision.fog.smithi079:timed out
2024-04-02T14:25:38.618 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T14:25:38.883 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-02T14:25:38.883 DEBUG:teuthology.orchestra.run.smithi129:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-02T14:25:39.187 INFO:teuthology.provision.fog.smithi129:Node is ready
2024-04-02T14:25:39.187 DEBUG:teuthology.orchestra.run.smithi129:> hostname
2024-04-02T14:25:39.201 INFO:teuthology.orchestra.run.smithi129.stdout:smithi129.front.sepia.ceph.com
2024-04-02T14:25:39.201 DEBUG:teuthology.orchestra.run.smithi129:> grep smithi129.front.sepia.ceph.com /etc/hosts
2024-04-02T14:25:39.259 INFO:teuthology.orchestra.run.smithi129.stdout:172.21.15.129 smithi129.front.sepia.ceph.com smithi129
2024-04-02T14:25:39.260 DEBUG:teuthology.orchestra.run.smithi129:> sudo hostname smithi129
2024-04-02T14:25:39.364 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/smithi129.front.sepia.ceph.com/smithi129/g' /etc/hosts
2024-04-02T14:25:39.391 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/172.21.15.129/172.21.15.129/g' /etc/hosts
2024-04-02T14:25:39.463 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/smithi129.front.sepia.ceph.com/smithi129/g' /etc/hostname
2024-04-02T14:25:39.533 DEBUG:teuthology.orchestra.run.smithi129:> sudo hostname smithi129
2024-04-02T14:25:39.603 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release
2024-04-02T14:25:39.661 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="CentOS Stream"
2024-04-02T14:25:39.661 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="9"
2024-04-02T14:25:39.661 INFO:teuthology.orchestra.run.smithi129.stdout:ID="centos"
2024-04-02T14:25:39.661 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="rhel fedora"
2024-04-02T14:25:39.661 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="9"
2024-04-02T14:25:39.662 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el9"
2024-04-02T14:25:39.662 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-02T14:25:39.662 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31"
2024-04-02T14:25:39.662 INFO:teuthology.orchestra.run.smithi129.stdout:LOGO="fedora-logo-icon"
2024-04-02T14:25:39.662 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-02T14:25:39.662 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://centos.org/"
2024-04-02T14:25:39.662 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-02T14:25:39.662 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-02T14:25:39.662 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-02T14:25:39.662 INFO:teuthology.provision.fog.smithi129:Deploy complete!
2024-04-02T14:25:39.663 DEBUG:teuthology.parallel:result is None
2024-04-02T14:25:40.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T14:25:40.819 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-02T14:25:40.820 DEBUG:teuthology.orchestra.run.smithi079:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-02T14:25:41.129 INFO:teuthology.provision.fog.smithi079:Node is ready
2024-04-02T14:25:41.129 DEBUG:teuthology.orchestra.run.smithi079:> hostname
2024-04-02T14:25:41.186 INFO:teuthology.orchestra.run.smithi079.stdout:smithi079.front.sepia.ceph.com
2024-04-02T14:25:41.186 DEBUG:teuthology.orchestra.run.smithi079:> grep smithi079.front.sepia.ceph.com /etc/hosts
2024-04-02T14:25:41.244 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79 smithi079.front.sepia.ceph.com smithi079
2024-04-02T14:25:41.245 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079
2024-04-02T14:25:41.348 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079.front.sepia.ceph.com/smithi079/g' /etc/hosts
2024-04-02T14:25:41.379 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/172.21.15.79/172.21.15.79/g' /etc/hosts
2024-04-02T14:25:41.451 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079.front.sepia.ceph.com/smithi079/g' /etc/hostname
2024-04-02T14:25:41.519 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079
2024-04-02T14:25:41.585 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release
2024-04-02T14:25:41.639 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="CentOS Stream"
2024-04-02T14:25:41.639 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="9"
2024-04-02T14:25:41.639 INFO:teuthology.orchestra.run.smithi079.stdout:ID="centos"
2024-04-02T14:25:41.639 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="rhel fedora"
2024-04-02T14:25:41.639 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="9"
2024-04-02T14:25:41.639 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el9"
2024-04-02T14:25:41.640 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-02T14:25:41.640 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31"
2024-04-02T14:25:41.640 INFO:teuthology.orchestra.run.smithi079.stdout:LOGO="fedora-logo-icon"
2024-04-02T14:25:41.640 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-02T14:25:41.640 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://centos.org/"
2024-04-02T14:25:41.640 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-02T14:25:41.640 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-02T14:25:41.640 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-02T14:25:41.640 INFO:teuthology.provision.fog.smithi079:Deploy complete!
2024-04-02T14:25:41.641 DEBUG:teuthology.parallel:result is None
2024-04-02T14:25:41.859 INFO:teuthology.lock.ops:Checking smithi017.front.sepia.ceph.com
2024-04-02T14:25:41.859 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-02T14:25:41.886 INFO:teuthology.lock.ops:Checking smithi079.front.sepia.ceph.com
2024-04-02T14:25:41.887 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-02T14:25:41.903 INFO:teuthology.lock.ops:Checking smithi129.front.sepia.ceph.com
2024-04-02T14:25:41.903 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-02T14:25:41.921 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: set os type and version on server
2024-04-02T14:25:41.921 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com'
2024-04-02T14:25:41.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T14:25:42.024 DEBUG:teuthology.orchestra.run.smithi017:> true
2024-04-02T14:25:42.209 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com'
2024-04-02T14:25:42.209 DEBUG:teuthology.orchestra.run.smithi017:> uname -m
2024-04-02T14:25:42.263 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64
2024-04-02T14:25:42.263 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release
2024-04-02T14:25:42.318 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Stream"
2024-04-02T14:25:42.319 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="9"
2024-04-02T14:25:42.319 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos"
2024-04-02T14:25:42.319 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora"
2024-04-02T14:25:42.319 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="9"
2024-04-02T14:25:42.319 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el9"
2024-04-02T14:25:42.319 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-02T14:25:42.319 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31"
2024-04-02T14:25:42.319 INFO:teuthology.orchestra.run.smithi017.stdout:LOGO="fedora-logo-icon"
2024-04-02T14:25:42.319 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-02T14:25:42.319 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/"
2024-04-02T14:25:42.319 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-02T14:25:42.319 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-02T14:25:42.319 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-02T14:25:42.320 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server
2024-04-02T14:25:42.345 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: set os type and version on server
2024-04-02T14:25:42.345 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com'
2024-04-02T14:25:42.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T14:25:42.434 DEBUG:teuthology.orchestra.run.smithi079:> true
2024-04-02T14:25:42.501 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com'
2024-04-02T14:25:42.501 DEBUG:teuthology.orchestra.run.smithi079:> uname -m
2024-04-02T14:25:42.555 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64
2024-04-02T14:25:42.555 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release
2024-04-02T14:25:42.610 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="CentOS Stream"
2024-04-02T14:25:42.610 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="9"
2024-04-02T14:25:42.610 INFO:teuthology.orchestra.run.smithi079.stdout:ID="centos"
2024-04-02T14:25:42.610 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="rhel fedora"
2024-04-02T14:25:42.610 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="9"
2024-04-02T14:25:42.610 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el9"
2024-04-02T14:25:42.611 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-02T14:25:42.611 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31"
2024-04-02T14:25:42.611 INFO:teuthology.orchestra.run.smithi079.stdout:LOGO="fedora-logo-icon"
2024-04-02T14:25:42.611 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-02T14:25:42.611 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://centos.org/"
2024-04-02T14:25:42.611 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-02T14:25:42.611 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-02T14:25:42.611 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-02T14:25:42.611 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server
2024-04-02T14:25:42.628 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: set os type and version on server
2024-04-02T14:25:42.628 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com'
2024-04-02T14:25:42.629 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T14:25:42.717 DEBUG:teuthology.orchestra.run.smithi129:> true
2024-04-02T14:25:42.787 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi129.front.sepia.ceph.com'
2024-04-02T14:25:42.787 DEBUG:teuthology.orchestra.run.smithi129:> uname -m
2024-04-02T14:25:42.843 INFO:teuthology.orchestra.run.smithi129.stdout:x86_64
2024-04-02T14:25:42.844 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release
2024-04-02T14:25:42.900 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="CentOS Stream"
2024-04-02T14:25:42.900 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="9"
2024-04-02T14:25:42.901 INFO:teuthology.orchestra.run.smithi129.stdout:ID="centos"
2024-04-02T14:25:42.901 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="rhel fedora"
2024-04-02T14:25:42.901 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="9"
2024-04-02T14:25:42.901 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el9"
2024-04-02T14:25:42.901 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-02T14:25:42.901 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31"
2024-04-02T14:25:42.901 INFO:teuthology.orchestra.run.smithi129.stdout:LOGO="fedora-logo-icon"
2024-04-02T14:25:42.901 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-02T14:25:42.901 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://centos.org/"
2024-04-02T14:25:42.901 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-02T14:25:42.901 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-02T14:25:42.901 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-02T14:25:42.902 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server
2024-04-02T14:25:42.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T14:25:43.018 INFO:teuthology.dispatcher.supervisor:Running job 7635652
2024-04-02T14:25:43.018 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-04-02_11:52:43-fs-wip-batrick-testing-20240402.004512-distro-default-smithi/7635652 --name pdonnell-2024-04-02_11:52:43-fs-wip-batrick-testing-20240402.004512-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/fsx}} -- /home/teuthworker/archive/pdonnell-2024-04-02_11:52:43-fs-wip-batrick-testing-20240402.004512-distro-default-smithi/7635652/orig.config.yaml
2024-04-02T14:25:43.021 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-04-02_11:52:43-fs-wip-batrick-testing-20240402.004512-distro-default-smithi/7635652
2024-04-02T14:25:43.021 INFO:teuthology.dispatcher.supervisor:Job PID: 712377
2024-04-02T14:25:43.021 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-04-02T14:27:43.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T14:29:43.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T14:31:43.448 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T14:33:43.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T14:35:43.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T14:37:43.969 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T14:39:44.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T14:41:44.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T14:43:44.480 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T14:45:44.657 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T14:47:44.817 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T14:49:45.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T14:51:45.166 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T14:53:45.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T14:55:45.507 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T14:57:45.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T14:59:45.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T15:01:46.018 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T15:03:46.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T15:05:46.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T15:05:46.468 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1