2024-04-10T04:09:57.144 INFO:root:teuthology version: 0.0.1.dev267+g6c63784
2024-04-10T04:09:57.145 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T04:09:57.316 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fe0ac8a8f70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fe0ad908c10>, signals=[15])
2024-04-10T04:09:57.317 INFO:teuthology.lock.ops:Start node 'smithi042.front.sepia.ceph.com' reimaging
2024-04-10T04:09:57.317 INFO:teuthology.lock.ops:Updating [smithi042.front.sepia.ceph.com]: reset os type and version on server
2024-04-10T04:09:57.317 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server
2024-04-10T04:09:57.339 INFO:teuthology.lock.ops:Start node 'smithi149.front.sepia.ceph.com' reimaging
2024-04-10T04:09:57.339 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: reset os type and version on server
2024-04-10T04:09:57.339 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server
2024-04-10T04:09:57.355 INFO:teuthology.lock.ops:Start node 'smithi174.front.sepia.ceph.com' reimaging
2024-04-10T04:09:57.355 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: reset os type and version on server
2024-04-10T04:09:57.355 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server
2024-04-10T04:09:57.456 DEBUG:teuthology.provision.fog.smithi042:Requesting image smithi_centos_9.stream (ID 10)
2024-04-10T04:09:57.471 DEBUG:teuthology.provision.fog.smithi149:Requesting image smithi_centos_9.stream (ID 10)
2024-04-10T04:09:57.483 DEBUG:teuthology.provision.fog.smithi174:Requesting image smithi_centos_9.stream (ID 10)
2024-04-10T04:09:57.506 INFO:teuthology.provision.fog.smithi042:Scheduling deploy of centos 9.stream
2024-04-10T04:09:57.529 INFO:teuthology.provision.fog.smithi149:Scheduling deploy of centos 9.stream
2024-04-10T04:09:57.545 INFO:teuthology.provision.fog.smithi174:Scheduling deploy of centos 9.stream
2024-04-10T04:09:57.764 INFO:teuthology.orchestra.console.smithi042:Power off
2024-04-10T04:09:57.764 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-10T04:09:57.781 INFO:teuthology.orchestra.console.smithi174:Power off
2024-04-10T04:09:57.781 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-10T04:09:57.796 INFO:teuthology.orchestra.console.smithi149:Power off
2024-04-10T04:09:57.796 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-10T04:09:57.806 DEBUG:teuthology.orchestra.console.smithi042:power off output: Chassis Power Control: Down/Off
2024-04-10T04:09:57.807 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T04:09:57.815 DEBUG:teuthology.orchestra.console.smithi174:power off output: Chassis Power Control: Down/Off
2024-04-10T04:09:57.816 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T04:09:57.824 DEBUG:teuthology.orchestra.console.smithi149:power off output: Chassis Power Control: Down/Off
2024-04-10T04:09:57.825 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T04:09:57.833 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is on
2024-04-10T04:09:57.837 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on
2024-04-10T04:09:57.847 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on
2024-04-10T04:10:01.838 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T04:10:01.845 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T04:10:01.852 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T04:10:01.948 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is on
2024-04-10T04:10:01.954 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on
2024-04-10T04:10:01.961 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on
2024-04-10T04:10:05.950 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T04:10:05.957 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T04:10:05.963 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T04:10:06.059 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is off
2024-04-10T04:10:06.065 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on
2024-04-10T04:10:06.071 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on
2024-04-10T04:10:06.160 INFO:teuthology.orchestra.console.smithi042:Power off completed
2024-04-10T04:10:06.261 INFO:teuthology.orchestra.console.smithi042:Power on
2024-04-10T04:10:06.261 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-10T04:10:06.283 DEBUG:teuthology.orchestra.console.smithi042:power on output: Chassis Power Control: Up/On
2024-04-10T04:10:06.284 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T04:10:06.305 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is off
2024-04-10T04:10:10.066 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T04:10:10.073 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T04:10:10.176 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off
2024-04-10T04:10:10.186 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off
2024-04-10T04:10:10.277 INFO:teuthology.orchestra.console.smithi174:Power off completed
2024-04-10T04:10:10.287 INFO:teuthology.orchestra.console.smithi149:Power off completed
2024-04-10T04:10:10.306 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T04:10:10.378 INFO:teuthology.orchestra.console.smithi174:Power on
2024-04-10T04:10:10.378 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-10T04:10:10.388 INFO:teuthology.orchestra.console.smithi149:Power on
2024-04-10T04:10:10.388 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-10T04:10:10.400 DEBUG:teuthology.orchestra.console.smithi174:power on output: Chassis Power Control: Up/On
2024-04-10T04:10:10.401 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T04:10:10.410 DEBUG:teuthology.orchestra.console.smithi149:power on output: Chassis Power Control: Up/On
2024-04-10T04:10:10.411 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T04:10:10.419 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is off
2024-04-10T04:10:10.420 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off
2024-04-10T04:10:10.431 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off
2024-04-10T04:10:14.422 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T04:10:14.429 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T04:10:14.438 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T04:10:14.531 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is on
2024-04-10T04:10:14.539 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on
2024-04-10T04:10:14.547 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off
2024-04-10T04:10:14.632 INFO:teuthology.orchestra.console.smithi042:Power on completed
2024-04-10T04:10:14.640 INFO:teuthology.orchestra.console.smithi174:Power on completed
2024-04-10T04:10:14.733 INFO:teuthology.provision.fog.smithi042:Waiting for deploy to finish
2024-04-10T04:10:14.741 INFO:teuthology.provision.fog.smithi174:Waiting for deploy to finish
2024-04-10T04:10:18.551 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T04:10:18.661 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on
2024-04-10T04:10:18.762 INFO:teuthology.orchestra.console.smithi149:Power on completed
2024-04-10T04:10:18.862 INFO:teuthology.provision.fog.smithi149:Waiting for deploy to finish
2024-04-10T04:12:45.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T04:12:45.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T04:12:48.638 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42
2024-04-10T04:12:48.639 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174
2024-04-10T04:12:54.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T04:12:54.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T04:12:57.694 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42
2024-04-10T04:12:57.726 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174
2024-04-10T04:13:03.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T04:13:03.729 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T04:13:04.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T04:13:06.782 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42
2024-04-10T04:13:06.782 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174
2024-04-10T04:13:07.742 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2024-04-10T04:13:12.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T04:13:12.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T04:13:13.745 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T04:13:15.842 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42
2024-04-10T04:13:15.874 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174
2024-04-10T04:13:16.802 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2024-04-10T04:13:21.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T04:13:21.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T04:13:22.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T04:13:24.926 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42
2024-04-10T04:13:24.927 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174
2024-04-10T04:13:25.886 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2024-04-10T04:13:30.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T04:13:30.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T04:13:31.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T04:13:34.014 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174
2024-04-10T04:13:34.942 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2024-04-10T04:13:40.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T04:13:40.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T04:13:43.998 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2024-04-10T04:13:50.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T04:13:53.090 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2024-04-10T04:13:59.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T04:14:02.178 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2024-04-10T04:14:08.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T04:14:30.955 WARNING:teuthology.provision.fog.smithi042:timed out
2024-04-10T04:14:36.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T04:14:37.218 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-10T04:14:37.219 DEBUG:teuthology.orchestra.run.smithi042:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-10T04:14:37.551 INFO:teuthology.provision.fog.smithi042:Node is ready
2024-04-10T04:14:37.551 DEBUG:teuthology.orchestra.run.smithi042:> hostname
2024-04-10T04:14:37.566 INFO:teuthology.orchestra.run.smithi042.stdout:smithi042.front.sepia.ceph.com
2024-04-10T04:14:37.566 DEBUG:teuthology.orchestra.run.smithi042:> grep smithi042.front.sepia.ceph.com /etc/hosts
2024-04-10T04:14:37.621 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42 smithi042.front.sepia.ceph.com smithi042
2024-04-10T04:14:37.622 DEBUG:teuthology.orchestra.run.smithi042:> sudo hostname smithi042
2024-04-10T04:14:37.733 DEBUG:teuthology.orchestra.run.smithi042:> sudo sed -i -e 's/smithi042.front.sepia.ceph.com/smithi042/g' /etc/hosts
2024-04-10T04:14:37.764 DEBUG:teuthology.orchestra.run.smithi042:> sudo sed -i -e 's/172.21.15.42/172.21.15.42/g' /etc/hosts
2024-04-10T04:14:37.835 DEBUG:teuthology.orchestra.run.smithi042:> sudo sed -i -e 's/smithi042.front.sepia.ceph.com/smithi042/g' /etc/hostname
2024-04-10T04:14:37.906 DEBUG:teuthology.orchestra.run.smithi042:> sudo hostname smithi042
2024-04-10T04:14:37.976 DEBUG:teuthology.orchestra.run.smithi042:> cat /etc/os-release
2024-04-10T04:14:38.031 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="CentOS Stream"
2024-04-10T04:14:38.031 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="9"
2024-04-10T04:14:38.031 INFO:teuthology.orchestra.run.smithi042.stdout:ID="centos"
2024-04-10T04:14:38.031 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE="rhel fedora"
2024-04-10T04:14:38.031 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="9"
2024-04-10T04:14:38.031 INFO:teuthology.orchestra.run.smithi042.stdout:PLATFORM_ID="platform:el9"
2024-04-10T04:14:38.031 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-10T04:14:38.031 INFO:teuthology.orchestra.run.smithi042.stdout:ANSI_COLOR="0;31"
2024-04-10T04:14:38.031 INFO:teuthology.orchestra.run.smithi042.stdout:LOGO="fedora-logo-icon"
2024-04-10T04:14:38.031 INFO:teuthology.orchestra.run.smithi042.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-10T04:14:38.032 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://centos.org/"
2024-04-10T04:14:38.032 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-10T04:14:38.032 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-10T04:14:38.032 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-10T04:14:38.033 INFO:teuthology.provision.fog.smithi042:Deploy complete!
2024-04-10T04:14:38.034 DEBUG:teuthology.parallel:result is None
2024-04-10T04:14:40.022 WARNING:teuthology.provision.fog.smithi174:timed out
2024-04-10T04:14:46.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T04:14:46.269 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-10T04:14:46.270 DEBUG:teuthology.orchestra.run.smithi174:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-10T04:14:46.626 INFO:teuthology.provision.fog.smithi174:Node is ready
2024-04-10T04:14:46.626 DEBUG:teuthology.orchestra.run.smithi174:> hostname
2024-04-10T04:14:46.640 INFO:teuthology.orchestra.run.smithi174.stdout:smithi174.front.sepia.ceph.com
2024-04-10T04:14:46.640 DEBUG:teuthology.orchestra.run.smithi174:> grep smithi174.front.sepia.ceph.com /etc/hosts
2024-04-10T04:14:46.695 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.15.174 smithi174.front.sepia.ceph.com smithi174
2024-04-10T04:14:46.696 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname smithi174
2024-04-10T04:14:46.816 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi174.front.sepia.ceph.com/smithi174/g' /etc/hosts
2024-04-10T04:14:46.844 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/172.21.15.174/172.21.15.174/g' /etc/hosts
2024-04-10T04:14:46.911 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi174.front.sepia.ceph.com/smithi174/g' /etc/hostname
2024-04-10T04:14:46.979 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname smithi174
2024-04-10T04:14:47.045 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release
2024-04-10T04:14:47.100 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="CentOS Stream"
2024-04-10T04:14:47.100 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="9"
2024-04-10T04:14:47.100 INFO:teuthology.orchestra.run.smithi174.stdout:ID="centos"
2024-04-10T04:14:47.101 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="rhel fedora"
2024-04-10T04:14:47.101 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="9"
2024-04-10T04:14:47.101 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el9"
2024-04-10T04:14:47.101 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-10T04:14:47.101 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31"
2024-04-10T04:14:47.101 INFO:teuthology.orchestra.run.smithi174.stdout:LOGO="fedora-logo-icon"
2024-04-10T04:14:47.101 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-10T04:14:47.102 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://centos.org/"
2024-04-10T04:14:47.102 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-10T04:14:47.102 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-10T04:14:47.102 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-10T04:14:47.103 INFO:teuthology.provision.fog.smithi174:Deploy complete!
2024-04-10T04:14:47.103 DEBUG:teuthology.parallel:result is None
2024-04-10T04:15:08.206 WARNING:teuthology.provision.fog.smithi149:timed out
2024-04-10T04:15:14.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T04:15:14.542 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-10T04:15:14.542 DEBUG:teuthology.orchestra.run.smithi149:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-10T04:15:14.888 INFO:teuthology.provision.fog.smithi149:Node is ready
2024-04-10T04:15:14.888 DEBUG:teuthology.orchestra.run.smithi149:> hostname
2024-04-10T04:15:14.904 INFO:teuthology.orchestra.run.smithi149.stdout:smithi149.front.sepia.ceph.com
2024-04-10T04:15:14.904 DEBUG:teuthology.orchestra.run.smithi149:> grep smithi149.front.sepia.ceph.com /etc/hosts
2024-04-10T04:15:14.958 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.15.149 smithi149.front.sepia.ceph.com smithi149
2024-04-10T04:15:14.959 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149
2024-04-10T04:15:15.065 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hosts
2024-04-10T04:15:15.094 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/172.21.15.149/172.21.15.149/g' /etc/hosts
2024-04-10T04:15:15.163 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hostname
2024-04-10T04:15:15.229 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149
2024-04-10T04:15:15.295 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release
2024-04-10T04:15:15.347 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="CentOS Stream"
2024-04-10T04:15:15.347 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="9"
2024-04-10T04:15:15.347 INFO:teuthology.orchestra.run.smithi149.stdout:ID="centos"
2024-04-10T04:15:15.347 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="rhel fedora"
2024-04-10T04:15:15.348 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="9"
2024-04-10T04:15:15.348 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el9"
2024-04-10T04:15:15.348 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-10T04:15:15.348 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31"
2024-04-10T04:15:15.348 INFO:teuthology.orchestra.run.smithi149.stdout:LOGO="fedora-logo-icon"
2024-04-10T04:15:15.348 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-10T04:15:15.348 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://centos.org/"
2024-04-10T04:15:15.348 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-10T04:15:15.348 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-10T04:15:15.348 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-10T04:15:15.348 INFO:teuthology.provision.fog.smithi149:Deploy complete!
2024-04-10T04:15:15.349 DEBUG:teuthology.parallel:result is None
2024-04-10T04:15:15.564 INFO:teuthology.lock.ops:Checking smithi042.front.sepia.ceph.com
2024-04-10T04:15:15.565 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-10T04:15:15.592 INFO:teuthology.lock.ops:Checking smithi149.front.sepia.ceph.com
2024-04-10T04:15:15.592 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-10T04:15:15.608 INFO:teuthology.lock.ops:Checking smithi174.front.sepia.ceph.com
2024-04-10T04:15:15.608 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-10T04:15:15.626 INFO:teuthology.lock.ops:Updating [smithi042.front.sepia.ceph.com]: set os type and version on server
2024-04-10T04:15:15.626 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com'
2024-04-10T04:15:15.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T04:15:15.730 DEBUG:teuthology.orchestra.run.smithi042:> true
2024-04-10T04:15:15.913 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi042.front.sepia.ceph.com'
2024-04-10T04:15:15.913 DEBUG:teuthology.orchestra.run.smithi042:> uname -m
2024-04-10T04:15:15.968 INFO:teuthology.orchestra.run.smithi042.stdout:x86_64
2024-04-10T04:15:15.968 DEBUG:teuthology.orchestra.run.smithi042:> cat /etc/os-release
2024-04-10T04:15:16.023 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="CentOS Stream"
2024-04-10T04:15:16.023 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="9"
2024-04-10T04:15:16.023 INFO:teuthology.orchestra.run.smithi042.stdout:ID="centos"
2024-04-10T04:15:16.023 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE="rhel fedora"
2024-04-10T04:15:16.023 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="9"
2024-04-10T04:15:16.023 INFO:teuthology.orchestra.run.smithi042.stdout:PLATFORM_ID="platform:el9"
2024-04-10T04:15:16.024 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-10T04:15:16.024 INFO:teuthology.orchestra.run.smithi042.stdout:ANSI_COLOR="0;31"
2024-04-10T04:15:16.024 INFO:teuthology.orchestra.run.smithi042.stdout:LOGO="fedora-logo-icon"
2024-04-10T04:15:16.024 INFO:teuthology.orchestra.run.smithi042.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-10T04:15:16.024 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://centos.org/"
2024-04-10T04:15:16.024 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-10T04:15:16.024 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-10T04:15:16.024 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-10T04:15:16.024 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server
2024-04-10T04:15:16.042 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: set os type and version on server
2024-04-10T04:15:16.042 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com'
2024-04-10T04:15:16.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T04:15:16.130 DEBUG:teuthology.orchestra.run.smithi149:> true
2024-04-10T04:15:16.200 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com'
2024-04-10T04:15:16.201 DEBUG:teuthology.orchestra.run.smithi149:> uname -m
2024-04-10T04:15:16.255 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64
2024-04-10T04:15:16.255 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release
2024-04-10T04:15:16.309 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="CentOS Stream"
2024-04-10T04:15:16.309 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="9"
2024-04-10T04:15:16.309 INFO:teuthology.orchestra.run.smithi149.stdout:ID="centos"
2024-04-10T04:15:16.309 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="rhel fedora"
2024-04-10T04:15:16.309 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="9"
2024-04-10T04:15:16.309 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el9"
2024-04-10T04:15:16.309 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-10T04:15:16.309 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31"
2024-04-10T04:15:16.309 INFO:teuthology.orchestra.run.smithi149.stdout:LOGO="fedora-logo-icon"
2024-04-10T04:15:16.310 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-10T04:15:16.310 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://centos.org/"
2024-04-10T04:15:16.310 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-10T04:15:16.310 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-10T04:15:16.310 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-10T04:15:16.310 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server
2024-04-10T04:15:16.334 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: set os type and version on server
2024-04-10T04:15:16.334 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com'
2024-04-10T04:15:16.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T04:15:16.425 DEBUG:teuthology.orchestra.run.smithi174:> true
2024-04-10T04:15:16.592 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi174.front.sepia.ceph.com'
2024-04-10T04:15:16.592 DEBUG:teuthology.orchestra.run.smithi174:> uname -m
2024-04-10T04:15:16.648 INFO:teuthology.orchestra.run.smithi174.stdout:x86_64
2024-04-10T04:15:16.648 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release
2024-04-10T04:15:16.702 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="CentOS Stream"
2024-04-10T04:15:16.702 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="9"
2024-04-10T04:15:16.703 INFO:teuthology.orchestra.run.smithi174.stdout:ID="centos"
2024-04-10T04:15:16.703 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="rhel fedora"
2024-04-10T04:15:16.703 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="9"
2024-04-10T04:15:16.703 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el9"
2024-04-10T04:15:16.703 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-10T04:15:16.703 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31"
2024-04-10T04:15:16.703 INFO:teuthology.orchestra.run.smithi174.stdout:LOGO="fedora-logo-icon"
2024-04-10T04:15:16.703 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-10T04:15:16.703 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://centos.org/"
2024-04-10T04:15:16.703 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-10T04:15:16.703 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-10T04:15:16.703 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-10T04:15:16.704 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server
2024-04-10T04:15:16.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T04:15:16.839 INFO:teuthology.dispatcher.supervisor:Running job 7650419
2024-04-10T04:15:16.839 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-04-10_04:05:43-fs:workload-wip-64730-2-testing-default-smithi/7650419 --name vshankar-2024-04-10_04:05:43-fs:workload-wip-64730-2-testing-default-smithi --description fs:workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/suites/fsx}} -- /home/teuthworker/archive/vshankar-2024-04-10_04:05:43-fs:workload-wip-64730-2-testing-default-smithi/7650419/orig.config.yaml
2024-04-10T04:15:16.842 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-04-10_04:05:43-fs:workload-wip-64730-2-testing-default-smithi/7650419
2024-04-10T04:15:16.842 INFO:teuthology.dispatcher.supervisor:Job PID: 3711189
2024-04-10T04:15:16.842 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-04-10T04:17:16.942 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T04:19:17.115 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T04:21:17.289 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T04:23:17.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T04:25:17.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T04:27:17.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T04:29:17.988 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T04:31:18.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T04:33:18.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T04:35:18.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T04:37:18.708 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T04:39:18.868 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T04:41:19.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T04:43:19.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T04:45:19.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T04:47:19.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T04:49:19.736 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T04:51:19.910 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T04:53:20.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T04:55:20.243 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T04:57:20.398 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T04:59:20.534 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T04:59:20.595 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1