2024-03-21T13:52:10.062 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-21T13:52:10.062 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T13:52:10.229 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f5e3195bf70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f5e329bcc10>, signals=[15])
2024-03-21T13:52:10.230 INFO:teuthology.lock.ops:Start node 'smithi028.front.sepia.ceph.com' reimaging
2024-03-21T13:52:10.230 INFO:teuthology.lock.ops:Updating [smithi028.front.sepia.ceph.com]: reset os type and version on server
2024-03-21T13:52:10.230 INFO:teuthology.lock.ops:Updating smithi028.front.sepia.ceph.com on lock server
2024-03-21T13:52:10.252 INFO:teuthology.lock.ops:Start node 'smithi031.front.sepia.ceph.com' reimaging
2024-03-21T13:52:10.252 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: reset os type and version on server
2024-03-21T13:52:10.252 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server
2024-03-21T13:52:10.276 INFO:teuthology.lock.ops:Start node 'smithi136.front.sepia.ceph.com' reimaging
2024-03-21T13:52:10.276 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: reset os type and version on server
2024-03-21T13:52:10.276 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server
2024-03-21T13:52:10.390 DEBUG:teuthology.provision.fog.smithi028:Requesting image smithi_centos_9.stream (ID 10)
2024-03-21T13:52:10.395 DEBUG:teuthology.provision.fog.smithi031:Requesting image smithi_centos_9.stream (ID 10)
2024-03-21T13:52:10.421 DEBUG:teuthology.provision.fog.smithi136:Requesting image smithi_centos_9.stream (ID 10)
2024-03-21T13:52:10.435 INFO:teuthology.provision.fog.smithi031:Scheduling deploy of centos 9.stream
2024-03-21T13:52:10.439 INFO:teuthology.provision.fog.smithi028:Scheduling deploy of centos 9.stream
2024-03-21T13:52:10.473 INFO:teuthology.provision.fog.smithi136:Scheduling deploy of centos 9.stream
2024-03-21T13:52:10.683 INFO:teuthology.orchestra.console.smithi028:Power off
2024-03-21T13:52:10.683 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-21T13:52:10.697 INFO:teuthology.orchestra.console.smithi136:Power off
2024-03-21T13:52:10.698 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-21T13:52:10.708 INFO:teuthology.orchestra.console.smithi031:Power off
2024-03-21T13:52:10.708 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-21T13:52:10.716 DEBUG:teuthology.orchestra.console.smithi028:power off output: Chassis Power Control: Down/Off
2024-03-21T13:52:10.717 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T13:52:10.725 DEBUG:teuthology.orchestra.console.smithi136:power off output: Chassis Power Control: Down/Off
2024-03-21T13:52:10.725 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T13:52:10.732 DEBUG:teuthology.orchestra.console.smithi031:power off output: Chassis Power Control: Down/Off
2024-03-21T13:52:10.733 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T13:52:10.741 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is on
2024-03-21T13:52:10.746 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on
2024-03-21T13:52:10.756 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on
2024-03-21T13:52:14.742 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T13:52:14.748 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T13:52:14.757 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T13:52:14.850 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is on
2024-03-21T13:52:14.856 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on
2024-03-21T13:52:14.867 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on
2024-03-21T13:52:18.854 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T13:52:18.862 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T13:52:18.869 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T13:52:18.965 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is off
2024-03-21T13:52:18.971 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on
2024-03-21T13:52:18.976 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off
2024-03-21T13:52:19.066 INFO:teuthology.orchestra.console.smithi028:Power off completed
2024-03-21T13:52:19.077 INFO:teuthology.orchestra.console.smithi031:Power off completed
2024-03-21T13:52:19.167 INFO:teuthology.orchestra.console.smithi028:Power on
2024-03-21T13:52:19.167 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-21T13:52:19.178 INFO:teuthology.orchestra.console.smithi031:Power on
2024-03-21T13:52:19.179 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-21T13:52:19.189 DEBUG:teuthology.orchestra.console.smithi028:power on output: Chassis Power Control: Up/On
2024-03-21T13:52:19.189 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T13:52:19.200 DEBUG:teuthology.orchestra.console.smithi031:power on output: Chassis Power Control: Up/On
2024-03-21T13:52:19.200 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T13:52:19.209 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is off
2024-03-21T13:52:19.220 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off
2024-03-21T13:52:22.972 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T13:52:23.081 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off
2024-03-21T13:52:23.182 INFO:teuthology.orchestra.console.smithi136:Power off completed
2024-03-21T13:52:23.210 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T13:52:23.221 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T13:52:23.283 INFO:teuthology.orchestra.console.smithi136:Power on
2024-03-21T13:52:23.283 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-21T13:52:23.306 DEBUG:teuthology.orchestra.console.smithi136:power on output: Chassis Power Control: Up/On
2024-03-21T13:52:23.307 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T13:52:23.319 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is off
2024-03-21T13:52:23.328 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off
2024-03-21T13:52:23.328 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off
2024-03-21T13:52:27.322 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T13:52:27.329 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T13:52:27.335 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-21T13:52:27.432 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is on
2024-03-21T13:52:27.438 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on
2024-03-21T13:52:27.443 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on
2024-03-21T13:52:27.533 INFO:teuthology.orchestra.console.smithi028:Power on completed
2024-03-21T13:52:27.538 INFO:teuthology.orchestra.console.smithi031:Power on completed
2024-03-21T13:52:27.544 INFO:teuthology.orchestra.console.smithi136:Power on completed
2024-03-21T13:52:27.634 INFO:teuthology.provision.fog.smithi028:Waiting for deploy to finish
2024-03-21T13:52:27.638 INFO:teuthology.provision.fog.smithi031:Waiting for deploy to finish
2024-03-21T13:52:27.645 INFO:teuthology.provision.fog.smithi136:Waiting for deploy to finish
2024-03-21T13:54:43.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T13:54:43.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T13:54:46.398 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2024-03-21T13:54:46.399 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28
2024-03-21T13:54:52.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T13:54:52.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T13:54:55.454 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2024-03-21T13:54:55.486 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28
2024-03-21T13:55:01.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T13:55:01.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T13:55:04.510 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2024-03-21T13:55:04.542 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28
2024-03-21T13:55:10.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T13:55:10.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T13:55:13.442 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T13:55:13.566 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2024-03-21T13:55:13.598 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28
2024-03-21T13:55:16.510 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2024-03-21T13:55:19.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T13:55:19.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T13:55:22.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T13:55:22.654 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2024-03-21T13:55:22.655 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28
2024-03-21T13:55:25.566 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2024-03-21T13:55:28.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T13:55:28.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T13:55:31.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T13:55:34.622 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2024-03-21T13:55:40.629 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T13:55:43.714 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2024-03-21T13:55:49.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T13:55:52.802 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2024-03-21T13:55:58.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T13:56:01.890 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2024-03-21T13:56:07.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T13:56:28.683 WARNING:teuthology.provision.fog.smithi031:timed out
2024-03-21T13:56:28.684 WARNING:teuthology.provision.fog.smithi028:timed out
2024-03-21T13:56:34.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T13:56:34.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T13:56:35.003 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-21T13:56:35.003 DEBUG:teuthology.orchestra.run.smithi031:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-21T13:56:35.040 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-21T13:56:35.041 DEBUG:teuthology.orchestra.run.smithi028:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-21T13:56:35.325 INFO:teuthology.provision.fog.smithi031:Node is ready
2024-03-21T13:56:35.325 DEBUG:teuthology.orchestra.run.smithi031:> hostname
2024-03-21T13:56:35.340 INFO:teuthology.orchestra.run.smithi031.stdout:smithi031.front.sepia.ceph.com
2024-03-21T13:56:35.341 DEBUG:teuthology.orchestra.run.smithi031:> grep smithi031.front.sepia.ceph.com /etc/hosts
2024-03-21T13:56:35.345 INFO:teuthology.provision.fog.smithi028:Node is ready
2024-03-21T13:56:35.345 DEBUG:teuthology.orchestra.run.smithi028:> hostname
2024-03-21T13:56:35.360 INFO:teuthology.orchestra.run.smithi028.stdout:smithi028.front.sepia.ceph.com
2024-03-21T13:56:35.360 DEBUG:teuthology.orchestra.run.smithi028:> grep smithi028.front.sepia.ceph.com /etc/hosts
2024-03-21T13:56:35.397 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31 smithi031.front.sepia.ceph.com smithi031
2024-03-21T13:56:35.397 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031
2024-03-21T13:56:35.416 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.15.28 smithi028.front.sepia.ceph.com smithi028
2024-03-21T13:56:35.416 DEBUG:teuthology.orchestra.run.smithi028:> sudo hostname smithi028
2024-03-21T13:56:35.511 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi031.front.sepia.ceph.com/smithi031/g' /etc/hosts
2024-03-21T13:56:35.519 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i -e 's/smithi028.front.sepia.ceph.com/smithi028/g' /etc/hosts
2024-03-21T13:56:35.543 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/172.21.15.31/172.21.15.31/g' /etc/hosts
2024-03-21T13:56:35.553 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i -e 's/172.21.15.28/172.21.15.28/g' /etc/hosts
2024-03-21T13:56:35.617 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi031.front.sepia.ceph.com/smithi031/g' /etc/hostname
2024-03-21T13:56:35.627 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i -e 's/smithi028.front.sepia.ceph.com/smithi028/g' /etc/hostname
2024-03-21T13:56:35.690 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031
2024-03-21T13:56:35.699 DEBUG:teuthology.orchestra.run.smithi028:> sudo hostname smithi028
2024-03-21T13:56:35.762 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release
2024-03-21T13:56:35.770 DEBUG:teuthology.orchestra.run.smithi028:> cat /etc/os-release
2024-03-21T13:56:35.817 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="CentOS Stream"
2024-03-21T13:56:35.817 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="9"
2024-03-21T13:56:35.817 INFO:teuthology.orchestra.run.smithi031.stdout:ID="centos"
2024-03-21T13:56:35.817 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="rhel fedora"
2024-03-21T13:56:35.817 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="9"
2024-03-21T13:56:35.817 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el9"
2024-03-21T13:56:35.818 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-21T13:56:35.818 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31"
2024-03-21T13:56:35.818 INFO:teuthology.orchestra.run.smithi031.stdout:LOGO="fedora-logo-icon"
2024-03-21T13:56:35.818 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-21T13:56:35.818 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://centos.org/"
2024-03-21T13:56:35.818 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-21T13:56:35.818 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-21T13:56:35.818 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-21T13:56:35.819 INFO:teuthology.provision.fog.smithi031:Deploy complete!
2024-03-21T13:56:35.821 DEBUG:teuthology.parallel:result is None
2024-03-21T13:56:35.825 INFO:teuthology.orchestra.run.smithi028.stdout:NAME="CentOS Stream"
2024-03-21T13:56:35.825 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION="9"
2024-03-21T13:56:35.825 INFO:teuthology.orchestra.run.smithi028.stdout:ID="centos"
2024-03-21T13:56:35.825 INFO:teuthology.orchestra.run.smithi028.stdout:ID_LIKE="rhel fedora"
2024-03-21T13:56:35.825 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION_ID="9"
2024-03-21T13:56:35.825 INFO:teuthology.orchestra.run.smithi028.stdout:PLATFORM_ID="platform:el9"
2024-03-21T13:56:35.825 INFO:teuthology.orchestra.run.smithi028.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-21T13:56:35.825 INFO:teuthology.orchestra.run.smithi028.stdout:ANSI_COLOR="0;31"
2024-03-21T13:56:35.825 INFO:teuthology.orchestra.run.smithi028.stdout:LOGO="fedora-logo-icon"
2024-03-21T13:56:35.825 INFO:teuthology.orchestra.run.smithi028.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-21T13:56:35.825 INFO:teuthology.orchestra.run.smithi028.stdout:HOME_URL="https://centos.org/"
2024-03-21T13:56:35.825 INFO:teuthology.orchestra.run.smithi028.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-21T13:56:35.826 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-21T13:56:35.826 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-21T13:56:35.826 INFO:teuthology.provision.fog.smithi028:Deploy complete!
2024-03-21T13:56:35.826 DEBUG:teuthology.parallel:result is None
2024-03-21T13:57:07.933 WARNING:teuthology.provision.fog.smithi136:timed out
2024-03-21T13:57:13.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T13:57:14.173 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-21T13:57:14.173 DEBUG:teuthology.orchestra.run.smithi136:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-21T13:57:14.481 INFO:teuthology.provision.fog.smithi136:Node is ready
2024-03-21T13:57:14.481 DEBUG:teuthology.orchestra.run.smithi136:> hostname
2024-03-21T13:57:14.495 INFO:teuthology.orchestra.run.smithi136.stdout:smithi136.front.sepia.ceph.com
2024-03-21T13:57:14.495 DEBUG:teuthology.orchestra.run.smithi136:> grep smithi136.front.sepia.ceph.com /etc/hosts
2024-03-21T13:57:14.550 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.15.136 smithi136.front.sepia.ceph.com smithi136
2024-03-21T13:57:14.551 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136
2024-03-21T13:57:14.678 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi136.front.sepia.ceph.com/smithi136/g' /etc/hosts
2024-03-21T13:57:14.707 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/172.21.15.136/172.21.15.136/g' /etc/hosts
2024-03-21T13:57:14.774 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi136.front.sepia.ceph.com/smithi136/g' /etc/hostname
2024-03-21T13:57:14.841 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136
2024-03-21T13:57:14.907 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release
2024-03-21T13:57:14.962 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="CentOS Stream"
2024-03-21T13:57:14.962 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="9"
2024-03-21T13:57:14.963 INFO:teuthology.orchestra.run.smithi136.stdout:ID="centos"
2024-03-21T13:57:14.963 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="rhel fedora"
2024-03-21T13:57:14.963 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="9"
2024-03-21T13:57:14.963 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el9"
2024-03-21T13:57:14.963 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-21T13:57:14.963 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31"
2024-03-21T13:57:14.963 INFO:teuthology.orchestra.run.smithi136.stdout:LOGO="fedora-logo-icon"
2024-03-21T13:57:14.963 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-21T13:57:14.963 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://centos.org/"
2024-03-21T13:57:14.963 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-21T13:57:14.963 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-21T13:57:14.963 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-21T13:57:14.964 INFO:teuthology.provision.fog.smithi136:Deploy complete!
2024-03-21T13:57:14.964 DEBUG:teuthology.parallel:result is None
2024-03-21T13:57:15.196 INFO:teuthology.lock.ops:Checking smithi028.front.sepia.ceph.com
2024-03-21T13:57:15.196 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-21T13:57:15.223 INFO:teuthology.lock.ops:Checking smithi031.front.sepia.ceph.com
2024-03-21T13:57:15.223 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-21T13:57:15.239 INFO:teuthology.lock.ops:Checking smithi136.front.sepia.ceph.com
2024-03-21T13:57:15.239 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-21T13:57:15.268 INFO:teuthology.lock.ops:Updating [smithi028.front.sepia.ceph.com]: set os type and version on server
2024-03-21T13:57:15.269 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com'
2024-03-21T13:57:15.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T13:57:15.382 DEBUG:teuthology.orchestra.run.smithi028:> true
2024-03-21T13:57:15.565 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi028.front.sepia.ceph.com'
2024-03-21T13:57:15.566 DEBUG:teuthology.orchestra.run.smithi028:> uname -m
2024-03-21T13:57:15.620 INFO:teuthology.orchestra.run.smithi028.stdout:x86_64
2024-03-21T13:57:15.621 DEBUG:teuthology.orchestra.run.smithi028:> cat /etc/os-release
2024-03-21T13:57:15.676 INFO:teuthology.orchestra.run.smithi028.stdout:NAME="CentOS Stream"
2024-03-21T13:57:15.676 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION="9"
2024-03-21T13:57:15.676 INFO:teuthology.orchestra.run.smithi028.stdout:ID="centos"
2024-03-21T13:57:15.676 INFO:teuthology.orchestra.run.smithi028.stdout:ID_LIKE="rhel fedora"
2024-03-21T13:57:15.676 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION_ID="9"
2024-03-21T13:57:15.676 INFO:teuthology.orchestra.run.smithi028.stdout:PLATFORM_ID="platform:el9"
2024-03-21T13:57:15.676 INFO:teuthology.orchestra.run.smithi028.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-21T13:57:15.676 INFO:teuthology.orchestra.run.smithi028.stdout:ANSI_COLOR="0;31"
2024-03-21T13:57:15.676 INFO:teuthology.orchestra.run.smithi028.stdout:LOGO="fedora-logo-icon"
2024-03-21T13:57:15.676 INFO:teuthology.orchestra.run.smithi028.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-21T13:57:15.676 INFO:teuthology.orchestra.run.smithi028.stdout:HOME_URL="https://centos.org/"
2024-03-21T13:57:15.676 INFO:teuthology.orchestra.run.smithi028.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-21T13:57:15.677 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-21T13:57:15.677 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-21T13:57:15.677 INFO:teuthology.lock.ops:Updating smithi028.front.sepia.ceph.com on lock server
2024-03-21T13:57:15.698 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: set os type and version on server
2024-03-21T13:57:15.698 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com'
2024-03-21T13:57:15.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T13:57:15.802 DEBUG:teuthology.orchestra.run.smithi031:> true
2024-03-21T13:57:15.985 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com'
2024-03-21T13:57:15.985 DEBUG:teuthology.orchestra.run.smithi031:> uname -m
2024-03-21T13:57:16.040 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64
2024-03-21T13:57:16.040 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release
2024-03-21T13:57:16.095 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="CentOS Stream"
2024-03-21T13:57:16.095 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="9"
2024-03-21T13:57:16.095 INFO:teuthology.orchestra.run.smithi031.stdout:ID="centos"
2024-03-21T13:57:16.095 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="rhel fedora"
2024-03-21T13:57:16.095 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="9"
2024-03-21T13:57:16.095 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el9"
2024-03-21T13:57:16.095 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-21T13:57:16.095 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31"
2024-03-21T13:57:16.095 INFO:teuthology.orchestra.run.smithi031.stdout:LOGO="fedora-logo-icon"
2024-03-21T13:57:16.095 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-21T13:57:16.095 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://centos.org/"
2024-03-21T13:57:16.095 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-21T13:57:16.096 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-21T13:57:16.096 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-21T13:57:16.096 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server
2024-03-21T13:57:16.123 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: set os type and version on server
2024-03-21T13:57:16.123 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com'
2024-03-21T13:57:16.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-21T13:57:16.213 DEBUG:teuthology.orchestra.run.smithi136:> true
2024-03-21T13:57:16.286 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com'
2024-03-21T13:57:16.286 DEBUG:teuthology.orchestra.run.smithi136:> uname -m
2024-03-21T13:57:16.343 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64
2024-03-21T13:57:16.343 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release
2024-03-21T13:57:16.399 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="CentOS Stream"
2024-03-21T13:57:16.399 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="9"
2024-03-21T13:57:16.399 INFO:teuthology.orchestra.run.smithi136.stdout:ID="centos"
2024-03-21T13:57:16.400 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="rhel fedora"
2024-03-21T13:57:16.400 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="9"
2024-03-21T13:57:16.400 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el9"
2024-03-21T13:57:16.400 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-21T13:57:16.400 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31"
2024-03-21T13:57:16.400 INFO:teuthology.orchestra.run.smithi136.stdout:LOGO="fedora-logo-icon"
2024-03-21T13:57:16.400 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-21T13:57:16.400 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://centos.org/"
2024-03-21T13:57:16.400 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-21T13:57:16.400 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-21T13:57:16.400 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-21T13:57:16.401 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server
2024-03-21T13:57:16.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T13:57:16.525 INFO:teuthology.dispatcher.supervisor:Running job 7613771
2024-03-21T13:57:16.525 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-03-20_21:24:03-fs-squid-distro-default-smithi/7613771 --name teuthology-2024-03-20_21:24:03-fs-squid-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/suites/iogen}} -- /home/teuthworker/archive/teuthology-2024-03-20_21:24:03-fs-squid-distro-default-smithi/7613771/orig.config.yaml
2024-03-21T13:57:16.529 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-03-20_21:24:03-fs-squid-distro-default-smithi/7613771
2024-03-21T13:57:16.530 INFO:teuthology.dispatcher.supervisor:Job PID: 1203635
2024-03-21T13:57:16.530 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-21T13:59:16.631 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T14:01:16.801 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T14:03:16.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T14:05:17.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T14:07:17.320 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T14:09:17.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T14:11:17.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T14:13:17.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T14:15:18.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T14:17:18.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T14:19:18.348 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T14:21:18.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T14:23:18.640 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T14:25:18.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T14:27:18.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T14:29:19.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T14:31:19.314 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T14:33:19.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T14:35:19.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T14:37:19.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T14:39:19.974 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T14:41:20.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T14:43:20.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-21T14:43:20.388 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1