2024-03-10T12:25:18.550 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-10T12:25:18.550 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-10T12:25:18.733 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f7bcfe7ef10>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f7bd0edfc10>, signals=[15])
2024-03-10T12:25:18.733 INFO:teuthology.lock.ops:Start node 'smithi103.front.sepia.ceph.com' reimaging
2024-03-10T12:25:18.734 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: reset os type and version on server
2024-03-10T12:25:18.734 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server
2024-03-10T12:25:18.761 INFO:teuthology.lock.ops:Start node 'smithi117.front.sepia.ceph.com' reimaging
2024-03-10T12:25:18.761 INFO:teuthology.lock.ops:Updating [smithi117.front.sepia.ceph.com]: reset os type and version on server
2024-03-10T12:25:18.762 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server
2024-03-10T12:25:18.786 INFO:teuthology.lock.ops:Start node 'smithi165.front.sepia.ceph.com' reimaging
2024-03-10T12:25:18.786 INFO:teuthology.lock.ops:Updating [smithi165.front.sepia.ceph.com]: reset os type and version on server
2024-03-10T12:25:18.786 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server
2024-03-10T12:25:18.877 DEBUG:teuthology.provision.fog.smithi103:Requesting image smithi_centos_9.stream (ID 10)
2024-03-10T12:25:18.893 DEBUG:teuthology.provision.fog.smithi117:Requesting image smithi_centos_9.stream (ID 10)
2024-03-10T12:25:18.920 DEBUG:teuthology.provision.fog.smithi165:Requesting image smithi_centos_9.stream (ID 10)
2024-03-10T12:25:18.927 INFO:teuthology.provision.fog.smithi103:Scheduling deploy of centos 9.stream
2024-03-10T12:25:18.937 INFO:teuthology.provision.fog.smithi117:Scheduling deploy of centos 9.stream
2024-03-10T12:25:18.979 INFO:teuthology.provision.fog.smithi165:Scheduling deploy of centos 9.stream
2024-03-10T12:25:19.196 INFO:teuthology.orchestra.console.smithi103:Power off
2024-03-10T12:25:19.196 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-10T12:25:19.213 INFO:teuthology.orchestra.console.smithi117:Power off
2024-03-10T12:25:19.213 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-10T12:25:19.229 DEBUG:teuthology.orchestra.console.smithi103:power off output: Chassis Power Control: Down/Off
2024-03-10T12:25:19.229 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-10T12:25:19.238 DEBUG:teuthology.orchestra.console.smithi117:power off output: Chassis Power Control: Down/Off
2024-03-10T12:25:19.238 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-10T12:25:19.250 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off
2024-03-10T12:25:19.259 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is off
2024-03-10T12:25:19.266 INFO:teuthology.orchestra.console.smithi165:Power off
2024-03-10T12:25:19.267 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-10T12:25:19.288 DEBUG:teuthology.orchestra.console.smithi165:power off output: Chassis Power Control: Down/Off
2024-03-10T12:25:19.288 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-10T12:25:19.318 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is on
2024-03-10T12:25:19.352 INFO:teuthology.orchestra.console.smithi103:Power off completed
2024-03-10T12:25:19.360 INFO:teuthology.orchestra.console.smithi117:Power off completed
2024-03-10T12:25:19.453 INFO:teuthology.orchestra.console.smithi103:Power on
2024-03-10T12:25:19.453 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-10T12:25:19.462 INFO:teuthology.orchestra.console.smithi117:Power on
2024-03-10T12:25:19.463 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-10T12:25:19.477 DEBUG:teuthology.orchestra.console.smithi103:power on output: Chassis Power Control: Up/On
2024-03-10T12:25:19.478 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-10T12:25:19.485 DEBUG:teuthology.orchestra.console.smithi117:power on output: Chassis Power Control: Up/On
2024-03-10T12:25:19.486 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-10T12:25:19.500 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off
2024-03-10T12:25:19.507 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is off
2024-03-10T12:25:23.322 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-10T12:25:23.431 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is off
2024-03-10T12:25:23.500 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-10T12:25:23.509 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-10T12:25:23.533 INFO:teuthology.orchestra.console.smithi165:Power off completed
2024-03-10T12:25:23.610 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on
2024-03-10T12:25:23.618 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is off
2024-03-10T12:25:23.634 INFO:teuthology.orchestra.console.smithi165:Power on
2024-03-10T12:25:23.634 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-10T12:25:23.654 DEBUG:teuthology.orchestra.console.smithi165:power on output: Chassis Power Control: Up/On
2024-03-10T12:25:23.655 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-10T12:25:23.676 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is off
2024-03-10T12:25:23.711 INFO:teuthology.orchestra.console.smithi103:Power on completed
2024-03-10T12:25:23.812 INFO:teuthology.provision.fog.smithi103:Waiting for deploy to finish
2024-03-10T12:25:27.622 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-10T12:25:27.677 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-10T12:25:27.733 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is on
2024-03-10T12:25:27.786 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is on
2024-03-10T12:25:27.834 INFO:teuthology.orchestra.console.smithi117:Power on completed
2024-03-10T12:25:27.887 INFO:teuthology.orchestra.console.smithi165:Power on completed
2024-03-10T12:25:27.935 INFO:teuthology.provision.fog.smithi117:Waiting for deploy to finish
2024-03-10T12:25:27.988 INFO:teuthology.provision.fog.smithi165:Waiting for deploy to finish
2024-03-10T12:27:58.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-10T12:28:01.758 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117
2024-03-10T12:28:07.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-10T12:28:09.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-10T12:28:10.814 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117
2024-03-10T12:28:12.734 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2024-03-10T12:28:13.753 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-10T12:28:16.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-10T12:28:16.830 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165
2024-03-10T12:28:18.737 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-10T12:28:19.870 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117
2024-03-10T12:28:21.794 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2024-03-10T12:28:22.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-10T12:28:25.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-10T12:28:25.890 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165
2024-03-10T12:28:27.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-10T12:28:28.926 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117
2024-03-10T12:28:30.882 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2024-03-10T12:28:31.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-10T12:28:34.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-10T12:28:34.978 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165
2024-03-10T12:28:36.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-10T12:28:37.986 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117
2024-03-10T12:28:39.966 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2024-03-10T12:28:40.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-10T12:28:43.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-10T12:28:44.030 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165
2024-03-10T12:28:45.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-10T12:28:47.070 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117
2024-03-10T12:28:49.022 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2024-03-10T12:28:50.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-10T12:28:53.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-10T12:28:53.086 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165
2024-03-10T12:28:55.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-10T12:28:58.082 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2024-03-10T12:28:59.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-10T12:29:02.142 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165
2024-03-10T12:29:04.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-10T12:29:07.138 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2024-03-10T12:29:08.145 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-10T12:29:11.198 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165
2024-03-10T12:29:13.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-10T12:29:16.222 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2024-03-10T12:29:17.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-10T12:29:22.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-10T12:29:53.107 WARNING:teuthology.provision.fog.smithi117:timed out
2024-03-10T12:29:59.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-10T12:29:59.467 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-10T12:29:59.468 DEBUG:teuthology.orchestra.run.smithi117:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-10T12:29:59.826 INFO:teuthology.provision.fog.smithi117:Node is ready
2024-03-10T12:29:59.826 DEBUG:teuthology.orchestra.run.smithi117:> hostname
2024-03-10T12:29:59.841 INFO:teuthology.orchestra.run.smithi117.stdout:smithi117.front.sepia.ceph.com
2024-03-10T12:29:59.841 DEBUG:teuthology.orchestra.run.smithi117:> grep smithi117.front.sepia.ceph.com /etc/hosts
2024-03-10T12:29:59.897 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117 smithi117.front.sepia.ceph.com smithi117
2024-03-10T12:29:59.898 DEBUG:teuthology.orchestra.run.smithi117:> sudo hostname smithi117
2024-03-10T12:30:00.013 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i -e 's/smithi117.front.sepia.ceph.com/smithi117/g' /etc/hosts
2024-03-10T12:30:00.042 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i -e 's/172.21.15.117/172.21.15.117/g' /etc/hosts
2024-03-10T12:30:00.110 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i -e 's/smithi117.front.sepia.ceph.com/smithi117/g' /etc/hostname
2024-03-10T12:30:00.177 DEBUG:teuthology.orchestra.run.smithi117:> sudo hostname smithi117
2024-03-10T12:30:00.243 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release
2024-03-10T12:30:00.297 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="CentOS Stream"
2024-03-10T12:30:00.297 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="9"
2024-03-10T12:30:00.297 INFO:teuthology.orchestra.run.smithi117.stdout:ID="centos"
2024-03-10T12:30:00.298 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="rhel fedora"
2024-03-10T12:30:00.298 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="9"
2024-03-10T12:30:00.298 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el9"
2024-03-10T12:30:00.298 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-10T12:30:00.298 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31"
2024-03-10T12:30:00.298 INFO:teuthology.orchestra.run.smithi117.stdout:LOGO="fedora-logo-icon"
2024-03-10T12:30:00.298 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-10T12:30:00.298 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://centos.org/"
2024-03-10T12:30:00.298 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-10T12:30:00.298 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-10T12:30:00.298 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-10T12:30:00.299 INFO:teuthology.provision.fog.smithi117:Deploy complete!
2024-03-10T12:30:00.301 DEBUG:teuthology.parallel:result is None
2024-03-10T12:30:17.219 WARNING:teuthology.provision.fog.smithi165:timed out
2024-03-10T12:30:22.230 WARNING:teuthology.provision.fog.smithi103:timed out
2024-03-10T12:30:23.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-10T12:30:23.463 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-10T12:30:23.464 DEBUG:teuthology.orchestra.run.smithi165:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-10T12:30:23.788 INFO:teuthology.provision.fog.smithi165:Node is ready
2024-03-10T12:30:23.788 DEBUG:teuthology.orchestra.run.smithi165:> hostname
2024-03-10T12:30:23.802 INFO:teuthology.orchestra.run.smithi165.stdout:smithi165.front.sepia.ceph.com
2024-03-10T12:30:23.803 DEBUG:teuthology.orchestra.run.smithi165:> grep smithi165.front.sepia.ceph.com /etc/hosts
2024-03-10T12:30:23.858 INFO:teuthology.orchestra.run.smithi165.stdout:172.21.15.165 smithi165.front.sepia.ceph.com smithi165
2024-03-10T12:30:23.859 DEBUG:teuthology.orchestra.run.smithi165:> sudo hostname smithi165
2024-03-10T12:30:23.955 DEBUG:teuthology.orchestra.run.smithi165:> sudo sed -i -e 's/smithi165.front.sepia.ceph.com/smithi165/g' /etc/hosts
2024-03-10T12:30:23.984 DEBUG:teuthology.orchestra.run.smithi165:> sudo sed -i -e 's/172.21.15.165/172.21.15.165/g' /etc/hosts
2024-03-10T12:30:24.052 DEBUG:teuthology.orchestra.run.smithi165:> sudo sed -i -e 's/smithi165.front.sepia.ceph.com/smithi165/g' /etc/hostname
2024-03-10T12:30:24.119 DEBUG:teuthology.orchestra.run.smithi165:> sudo hostname smithi165
2024-03-10T12:30:24.185 DEBUG:teuthology.orchestra.run.smithi165:> cat /etc/os-release
2024-03-10T12:30:24.240 INFO:teuthology.orchestra.run.smithi165.stdout:NAME="CentOS Stream"
2024-03-10T12:30:24.240 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION="9"
2024-03-10T12:30:24.240 INFO:teuthology.orchestra.run.smithi165.stdout:ID="centos"
2024-03-10T12:30:24.240 INFO:teuthology.orchestra.run.smithi165.stdout:ID_LIKE="rhel fedora"
2024-03-10T12:30:24.240 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION_ID="9"
2024-03-10T12:30:24.240 INFO:teuthology.orchestra.run.smithi165.stdout:PLATFORM_ID="platform:el9"
2024-03-10T12:30:24.240 INFO:teuthology.orchestra.run.smithi165.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-10T12:30:24.240 INFO:teuthology.orchestra.run.smithi165.stdout:ANSI_COLOR="0;31"
2024-03-10T12:30:24.240 INFO:teuthology.orchestra.run.smithi165.stdout:LOGO="fedora-logo-icon"
2024-03-10T12:30:24.240 INFO:teuthology.orchestra.run.smithi165.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-10T12:30:24.240 INFO:teuthology.orchestra.run.smithi165.stdout:HOME_URL="https://centos.org/"
2024-03-10T12:30:24.241 INFO:teuthology.orchestra.run.smithi165.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-10T12:30:24.241 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-10T12:30:24.241 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-10T12:30:24.241 INFO:teuthology.provision.fog.smithi165:Deploy complete!
2024-03-10T12:30:24.242 DEBUG:teuthology.parallel:result is None
2024-03-10T12:30:28.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-10T12:30:28.491 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-10T12:30:28.491 DEBUG:teuthology.orchestra.run.smithi103:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-10T12:30:28.844 INFO:teuthology.provision.fog.smithi103:Node is ready
2024-03-10T12:30:28.844 DEBUG:teuthology.orchestra.run.smithi103:> hostname
2024-03-10T12:30:28.858 INFO:teuthology.orchestra.run.smithi103.stdout:smithi103.front.sepia.ceph.com
2024-03-10T12:30:28.859 DEBUG:teuthology.orchestra.run.smithi103:> grep smithi103.front.sepia.ceph.com /etc/hosts
2024-03-10T12:30:28.915 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103 smithi103.front.sepia.ceph.com smithi103
2024-03-10T12:30:28.915 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname smithi103
2024-03-10T12:30:29.034 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi103.front.sepia.ceph.com/smithi103/g' /etc/hosts
2024-03-10T12:30:29.062 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/172.21.15.103/172.21.15.103/g' /etc/hosts
2024-03-10T12:30:29.130 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi103.front.sepia.ceph.com/smithi103/g' /etc/hostname
2024-03-10T12:30:29.198 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname smithi103
2024-03-10T12:30:29.264 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release
2024-03-10T12:30:29.319 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="CentOS Stream"
2024-03-10T12:30:29.320 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="9"
2024-03-10T12:30:29.320 INFO:teuthology.orchestra.run.smithi103.stdout:ID="centos"
2024-03-10T12:30:29.320 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="rhel fedora"
2024-03-10T12:30:29.320 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="9"
2024-03-10T12:30:29.320 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el9"
2024-03-10T12:30:29.320 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-10T12:30:29.320 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31"
2024-03-10T12:30:29.320 INFO:teuthology.orchestra.run.smithi103.stdout:LOGO="fedora-logo-icon"
2024-03-10T12:30:29.320 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-10T12:30:29.320 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://centos.org/"
2024-03-10T12:30:29.320 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-10T12:30:29.320 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-10T12:30:29.320 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-10T12:30:29.321 INFO:teuthology.provision.fog.smithi103:Deploy complete!
2024-03-10T12:30:29.321 DEBUG:teuthology.parallel:result is None
2024-03-10T12:30:29.567 INFO:teuthology.lock.ops:Checking smithi103.front.sepia.ceph.com
2024-03-10T12:30:29.567 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-10T12:30:29.597 INFO:teuthology.lock.ops:Checking smithi117.front.sepia.ceph.com
2024-03-10T12:30:29.597 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-10T12:30:29.622 INFO:teuthology.lock.ops:Checking smithi165.front.sepia.ceph.com
2024-03-10T12:30:29.622 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-10T12:30:29.641 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: set os type and version on server
2024-03-10T12:30:29.641 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com'
2024-03-10T12:30:29.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-10T12:30:29.732 DEBUG:teuthology.orchestra.run.smithi103:> true
2024-03-10T12:30:29.796 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com'
2024-03-10T12:30:29.797 DEBUG:teuthology.orchestra.run.smithi103:> uname -m
2024-03-10T12:30:29.851 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64
2024-03-10T12:30:29.851 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release
2024-03-10T12:30:29.905 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="CentOS Stream"
2024-03-10T12:30:29.905 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="9"
2024-03-10T12:30:29.905 INFO:teuthology.orchestra.run.smithi103.stdout:ID="centos"
2024-03-10T12:30:29.905 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="rhel fedora"
2024-03-10T12:30:29.905 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="9"
2024-03-10T12:30:29.905 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el9"
2024-03-10T12:30:29.906 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-10T12:30:29.906 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31"
2024-03-10T12:30:29.906 INFO:teuthology.orchestra.run.smithi103.stdout:LOGO="fedora-logo-icon"
2024-03-10T12:30:29.906 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-10T12:30:29.906 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://centos.org/"
2024-03-10T12:30:29.906 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-10T12:30:29.906 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-10T12:30:29.906 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-10T12:30:29.907 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server
2024-03-10T12:30:29.940 INFO:teuthology.lock.ops:Updating [smithi117.front.sepia.ceph.com]: set os type and version on server
2024-03-10T12:30:29.940 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com'
2024-03-10T12:30:29.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-10T12:30:30.041 DEBUG:teuthology.orchestra.run.smithi117:> true
2024-03-10T12:30:30.208 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com'
2024-03-10T12:30:30.208 DEBUG:teuthology.orchestra.run.smithi117:> uname -m
2024-03-10T12:30:30.263 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64
2024-03-10T12:30:30.264 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release
2024-03-10T12:30:30.318 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="CentOS Stream"
2024-03-10T12:30:30.318 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="9"
2024-03-10T12:30:30.318 INFO:teuthology.orchestra.run.smithi117.stdout:ID="centos"
2024-03-10T12:30:30.318 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="rhel fedora"
2024-03-10T12:30:30.319 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="9"
2024-03-10T12:30:30.319 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el9"
2024-03-10T12:30:30.319 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-10T12:30:30.319 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31"
2024-03-10T12:30:30.319 INFO:teuthology.orchestra.run.smithi117.stdout:LOGO="fedora-logo-icon"
2024-03-10T12:30:30.319 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-10T12:30:30.319 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://centos.org/"
2024-03-10T12:30:30.319 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-10T12:30:30.319 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-10T12:30:30.319 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-10T12:30:30.320 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server
2024-03-10T12:30:30.453 INFO:teuthology.lock.ops:Updating [smithi165.front.sepia.ceph.com]: set os type and version on server
2024-03-10T12:30:30.453 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com'
2024-03-10T12:30:30.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-10T12:30:30.541 DEBUG:teuthology.orchestra.run.smithi165:> true
2024-03-10T12:30:30.616 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi165.front.sepia.ceph.com'
2024-03-10T12:30:30.616 DEBUG:teuthology.orchestra.run.smithi165:> uname -m
2024-03-10T12:30:30.672 INFO:teuthology.orchestra.run.smithi165.stdout:x86_64
2024-03-10T12:30:30.672 DEBUG:teuthology.orchestra.run.smithi165:> cat /etc/os-release
2024-03-10T12:30:30.728 INFO:teuthology.orchestra.run.smithi165.stdout:NAME="CentOS Stream"
2024-03-10T12:30:30.728 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION="9"
2024-03-10T12:30:30.728 INFO:teuthology.orchestra.run.smithi165.stdout:ID="centos"
2024-03-10T12:30:30.728 INFO:teuthology.orchestra.run.smithi165.stdout:ID_LIKE="rhel fedora"
2024-03-10T12:30:30.728 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION_ID="9"
2024-03-10T12:30:30.728 INFO:teuthology.orchestra.run.smithi165.stdout:PLATFORM_ID="platform:el9"
2024-03-10T12:30:30.728 INFO:teuthology.orchestra.run.smithi165.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-10T12:30:30.728 INFO:teuthology.orchestra.run.smithi165.stdout:ANSI_COLOR="0;31"
2024-03-10T12:30:30.728 INFO:teuthology.orchestra.run.smithi165.stdout:LOGO="fedora-logo-icon"
2024-03-10T12:30:30.728 INFO:teuthology.orchestra.run.smithi165.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-10T12:30:30.728 INFO:teuthology.orchestra.run.smithi165.stdout:HOME_URL="https://centos.org/"
2024-03-10T12:30:30.729 INFO:teuthology.orchestra.run.smithi165.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-10T12:30:30.729 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-10T12:30:30.729 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-10T12:30:30.729 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server
2024-03-10T12:30:30.756 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-10T12:30:30.852 INFO:teuthology.dispatcher.supervisor:Running job 7589327
2024-03-10T12:30:30.852 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-03-10_05:12:46-fs-wip-batrick-testing-20240310.014948-distro-default-smithi/7589327 --name pdonnell-2024-03-10_05:12:46-fs-wip-batrick-testing-20240310.014948-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/postgres}} -- /home/teuthworker/archive/pdonnell-2024-03-10_05:12:46-fs-wip-batrick-testing-20240310.014948-distro-default-smithi/7589327/orig.config.yaml
2024-03-10T12:30:30.855 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-03-10_05:12:46-fs-wip-batrick-testing-20240310.014948-distro-default-smithi/7589327
2024-03-10T12:30:30.855 INFO:teuthology.dispatcher.supervisor:Job PID: 552960
2024-03-10T12:30:30.855 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-10T12:32:30.876 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-10T12:34:31.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-10T12:36:31.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-10T12:38:31.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-10T12:40:31.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-10T12:42:31.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-10T12:44:31.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-10T12:46:32.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-10T12:48:32.250 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-10T12:50:32.444 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-10T12:52:32.591 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-10T12:54:32.760 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-10T12:56:32.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-10T12:58:33.115 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-10T13:00:33.398 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-10T13:02:33.562 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-10T13:04:33.722 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-10T13:06:33.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-10T13:08:34.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-10T13:10:34.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-10T13:12:34.368 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-10T13:14:34.498 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-10T13:16:34.674 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-10T13:18:34.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-10T13:20:34.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-10T13:22:35.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-10T13:24:35.302 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-10T13:26:35.478 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-10T13:28:35.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-10T13:30:35.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-10T13:32:36.098 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-10T13:34:36.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-10T13:34:36.333 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1