2024-01-24T08:19:47.401 INFO:root:teuthology version: 0.0.1.dev251+gc856e0f
2024-01-24T08:19:47.402 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T08:19:47.555 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fd28e3f9f70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fd28f45fc10>, signals=[15])
2024-01-24T08:19:47.555 INFO:teuthology.lock.ops:Start node 'smithi019.front.sepia.ceph.com' reimaging
2024-01-24T08:19:47.555 INFO:teuthology.lock.ops:Updating [smithi019.front.sepia.ceph.com]: reset os type and version on server
2024-01-24T08:19:47.556 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server
2024-01-24T08:19:47.577 INFO:teuthology.lock.ops:Start node 'smithi173.front.sepia.ceph.com' reimaging
2024-01-24T08:19:47.578 INFO:teuthology.lock.ops:Updating [smithi173.front.sepia.ceph.com]: reset os type and version on server
2024-01-24T08:19:47.578 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server
2024-01-24T08:19:47.707 DEBUG:teuthology.provision.fog.smithi019:Requesting image smithi_centos_8.stream (ID 3)
2024-01-24T08:19:47.721 DEBUG:teuthology.provision.fog.smithi173:Requesting image smithi_centos_8.stream (ID 3)
2024-01-24T08:19:47.749 INFO:teuthology.provision.fog.smithi019:Scheduling deploy of centos 8.stream
2024-01-24T08:19:47.776 INFO:teuthology.provision.fog.smithi173:Scheduling deploy of centos 8.stream
2024-01-24T08:19:48.057 INFO:teuthology.orchestra.console.smithi019:Power off
2024-01-24T08:19:48.057 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-24T08:19:48.071 INFO:teuthology.orchestra.console.smithi173:Power off
2024-01-24T08:19:48.071 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-24T08:19:48.082 DEBUG:teuthology.orchestra.console.smithi019:power off output: Chassis Power Control: Down/Off
2024-01-24T08:19:48.082 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T08:19:48.092 DEBUG:teuthology.orchestra.console.smithi173:power off output: Chassis Power Control: Down/Off
2024-01-24T08:19:48.092 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T08:19:48.104 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on
2024-01-24T08:19:48.112 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on
2024-01-24T08:19:52.109 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T08:19:52.116 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T08:19:52.218 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on
2024-01-24T08:19:52.224 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on
2024-01-24T08:19:56.224 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T08:19:56.230 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T08:19:56.333 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on
2024-01-24T08:19:56.339 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on
2024-01-24T08:20:00.336 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T08:20:00.343 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T08:20:00.445 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off
2024-01-24T08:20:00.451 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off
2024-01-24T08:20:00.547 INFO:teuthology.orchestra.console.smithi019:Power off completed
2024-01-24T08:20:00.552 INFO:teuthology.orchestra.console.smithi173:Power off completed
2024-01-24T08:20:00.648 INFO:teuthology.orchestra.console.smithi019:Power on
2024-01-24T08:20:00.648 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-24T08:20:00.655 INFO:teuthology.orchestra.console.smithi173:Power on
2024-01-24T08:20:00.656 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-24T08:20:00.671 DEBUG:teuthology.orchestra.console.smithi019:power on output: Chassis Power Control: Up/On
2024-01-24T08:20:00.672 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T08:20:00.681 DEBUG:teuthology.orchestra.console.smithi173:power on output: Chassis Power Control: Up/On
2024-01-24T08:20:00.682 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T08:20:00.694 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off
2024-01-24T08:20:00.705 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off
2024-01-24T08:20:04.696 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T08:20:04.706 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T08:20:04.804 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off
2024-01-24T08:20:04.814 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on
2024-01-24T08:20:04.915 INFO:teuthology.orchestra.console.smithi173:Power on completed
2024-01-24T08:20:05.016 INFO:teuthology.provision.fog.smithi173:Waiting for deploy to finish
2024-01-24T08:20:08.808 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T08:20:08.917 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on
2024-01-24T08:20:09.017 INFO:teuthology.orchestra.console.smithi019:Power on completed
2024-01-24T08:20:09.118 INFO:teuthology.provision.fog.smithi019:Waiting for deploy to finish
2024-01-24T08:22:40.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T08:22:40.216 ERROR:teuthology.orchestra.connection:Error authenticating with smithi019.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-01-24T08:22:51.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T08:22:54.172 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173
2024-01-24T08:23:00.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T08:23:03.232 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173
2024-01-24T08:23:09.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T08:23:12.284 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173
2024-01-24T08:23:18.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T08:23:21.340 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173
2024-01-24T08:23:27.341 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T08:23:30.396 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173
2024-01-24T08:23:36.397 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T08:23:39.456 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173
2024-01-24T08:23:44.219 WARNING:teuthology.provision.fog.smithi019:timed out
2024-01-24T08:23:45.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T08:23:48.508 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173
2024-01-24T08:23:50.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T08:23:54.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T08:24:08.764 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19
2024-01-24T08:24:14.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T08:24:17.820 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19
2024-01-24T08:24:23.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T08:24:24.097 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-24T08:24:24.098 DEBUG:teuthology.orchestra.run.smithi019:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-24T08:24:26.175 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-24T08:24:26.175 DEBUG:teuthology.orchestra.run.smithi173:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-24T08:24:34.509 INFO:teuthology.provision.fog.smithi019:Node is ready
2024-01-24T08:24:34.509 DEBUG:teuthology.orchestra.run.smithi019:> hostname
2024-01-24T08:24:34.533 INFO:teuthology.orchestra.run.smithi019.stdout:smithi193
2024-01-24T08:24:34.533 DEBUG:teuthology.orchestra.run.smithi019:> grep smithi193 /etc/hosts
2024-01-24T08:24:34.596 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.193 smithi193.front.sepia.ceph.com smithi193
2024-01-24T08:24:34.596 DEBUG:teuthology.orchestra.run.smithi019:> sudo hostname smithi019
2024-01-24T08:24:34.738 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i -e 's/smithi193/smithi019/g' /etc/hosts
2024-01-24T08:24:34.773 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i -e 's/172.21.15.193/172.21.15.19/g' /etc/hosts
2024-01-24T08:24:34.846 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i -e 's/smithi193/smithi019/g' /etc/hostname
2024-01-24T08:24:34.919 DEBUG:teuthology.orchestra.run.smithi019:> sudo hostname smithi019
2024-01-24T08:24:34.991 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release
2024-01-24T08:24:35.053 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="CentOS Stream"
2024-01-24T08:24:35.053 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="8"
2024-01-24T08:24:35.053 INFO:teuthology.orchestra.run.smithi019.stdout:ID="centos"
2024-01-24T08:24:35.053 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE="rhel fedora"
2024-01-24T08:24:35.054 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="8"
2024-01-24T08:24:35.054 INFO:teuthology.orchestra.run.smithi019.stdout:PLATFORM_ID="platform:el8"
2024-01-24T08:24:35.054 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="CentOS Stream 8"
2024-01-24T08:24:35.054 INFO:teuthology.orchestra.run.smithi019.stdout:ANSI_COLOR="0;31"
2024-01-24T08:24:35.054 INFO:teuthology.orchestra.run.smithi019.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-01-24T08:24:35.054 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://centos.org/"
2024-01-24T08:24:35.054 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-24T08:24:35.054 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-24T08:24:35.054 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-24T08:24:35.055 INFO:teuthology.provision.fog.smithi019:Deploy complete!
2024-01-24T08:24:35.057 DEBUG:teuthology.parallel:result is None
2024-01-24T08:24:51.344 INFO:teuthology.provision.fog.smithi173:Node is ready
2024-01-24T08:24:51.345 DEBUG:teuthology.orchestra.run.smithi173:> hostname
2024-01-24T08:24:51.368 INFO:teuthology.orchestra.run.smithi173.stdout:smithi173.front.sepia.ceph.com
2024-01-24T08:24:51.369 DEBUG:teuthology.orchestra.run.smithi173:> grep smithi173.front.sepia.ceph.com /etc/hosts
2024-01-24T08:24:51.430 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.15.173 smithi173.front.sepia.ceph.com smithi173
2024-01-24T08:24:51.430 DEBUG:teuthology.orchestra.run.smithi173:> sudo hostname smithi173
2024-01-24T08:24:51.552 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/smithi173.front.sepia.ceph.com/smithi173/g' /etc/hosts
2024-01-24T08:24:51.583 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/172.21.15.173/172.21.15.173/g' /etc/hosts
2024-01-24T08:24:51.653 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/smithi173.front.sepia.ceph.com/smithi173/g' /etc/hostname
2024-01-24T08:24:51.723 DEBUG:teuthology.orchestra.run.smithi173:> sudo hostname smithi173
2024-01-24T08:24:51.791 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release
2024-01-24T08:24:51.850 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="CentOS Stream"
2024-01-24T08:24:51.850 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="8"
2024-01-24T08:24:51.850 INFO:teuthology.orchestra.run.smithi173.stdout:ID="centos"
2024-01-24T08:24:51.850 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="rhel fedora"
2024-01-24T08:24:51.850 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="8"
2024-01-24T08:24:51.850 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el8"
2024-01-24T08:24:51.850 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="CentOS Stream 8"
2024-01-24T08:24:51.850 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31"
2024-01-24T08:24:51.850 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-01-24T08:24:51.851 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://centos.org/"
2024-01-24T08:24:51.851 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-24T08:24:51.851 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-24T08:24:51.851 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-24T08:24:51.851 INFO:teuthology.provision.fog.smithi173:Deploy complete!
2024-01-24T08:24:51.852 DEBUG:teuthology.parallel:result is None
2024-01-24T08:24:52.048 INFO:teuthology.lock.ops:Checking smithi019.front.sepia.ceph.com
2024-01-24T08:24:52.048 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-24T08:24:52.090 INFO:teuthology.lock.ops:Checking smithi173.front.sepia.ceph.com
2024-01-24T08:24:52.090 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-24T08:24:52.108 INFO:teuthology.lock.ops:Updating [smithi019.front.sepia.ceph.com]: set os type and version on server
2024-01-24T08:24:52.108 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com'
2024-01-24T08:24:52.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T08:24:52.186 DEBUG:teuthology.orchestra.run.smithi019:> true
2024-01-24T08:24:52.324 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com'
2024-01-24T08:24:52.324 DEBUG:teuthology.orchestra.run.smithi019:> uname -m
2024-01-24T08:24:52.384 INFO:teuthology.orchestra.run.smithi019.stdout:x86_64
2024-01-24T08:24:52.384 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release
2024-01-24T08:24:52.444 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="CentOS Stream"
2024-01-24T08:24:52.444 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="8"
2024-01-24T08:24:52.444 INFO:teuthology.orchestra.run.smithi019.stdout:ID="centos"
2024-01-24T08:24:52.444 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE="rhel fedora"
2024-01-24T08:24:52.444 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="8"
2024-01-24T08:24:52.444 INFO:teuthology.orchestra.run.smithi019.stdout:PLATFORM_ID="platform:el8"
2024-01-24T08:24:52.444 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="CentOS Stream 8"
2024-01-24T08:24:52.444 INFO:teuthology.orchestra.run.smithi019.stdout:ANSI_COLOR="0;31"
2024-01-24T08:24:52.444 INFO:teuthology.orchestra.run.smithi019.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-01-24T08:24:52.444 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://centos.org/"
2024-01-24T08:24:52.444 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-24T08:24:52.444 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-24T08:24:52.445 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-24T08:24:52.445 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server
2024-01-24T08:24:52.465 INFO:teuthology.lock.ops:Updating [smithi173.front.sepia.ceph.com]: set os type and version on server
2024-01-24T08:24:52.465 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com'
2024-01-24T08:24:52.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T08:24:52.545 DEBUG:teuthology.orchestra.run.smithi173:> true
2024-01-24T08:24:52.616 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com'
2024-01-24T08:24:52.616 DEBUG:teuthology.orchestra.run.smithi173:> uname -m
2024-01-24T08:24:52.676 INFO:teuthology.orchestra.run.smithi173.stdout:x86_64
2024-01-24T08:24:52.676 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release
2024-01-24T08:24:52.735 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="CentOS Stream"
2024-01-24T08:24:52.735 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="8"
2024-01-24T08:24:52.735 INFO:teuthology.orchestra.run.smithi173.stdout:ID="centos"
2024-01-24T08:24:52.735 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="rhel fedora"
2024-01-24T08:24:52.735 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="8"
2024-01-24T08:24:52.735 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el8"
2024-01-24T08:24:52.735 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="CentOS Stream 8"
2024-01-24T08:24:52.735 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31"
2024-01-24T08:24:52.735 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-01-24T08:24:52.735 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://centos.org/"
2024-01-24T08:24:52.735 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-24T08:24:52.735 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-24T08:24:52.736 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-24T08:24:52.736 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server
2024-01-24T08:24:52.766 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T08:24:52.888 INFO:teuthology.dispatcher.supervisor:Running job 7528184
2024-01-24T08:24:52.889 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-01-23_14:05:57-fs-wip-vshankar-testing1-reef-2024-01-23-1317-testing-default-smithi/7528184 --name vshankar-2024-01-23_14:05:57-fs-wip-vshankar-testing1-reef-2024-01-23-1317-testing-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mon 2-workunit/suites/iozone}} -- /home/teuthworker/archive/vshankar-2024-01-23_14:05:57-fs-wip-vshankar-testing1-reef-2024-01-23-1317-testing-default-smithi/7528184/orig.config.yaml
2024-01-24T08:24:52.892 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-01-23_14:05:57-fs-wip-vshankar-testing1-reef-2024-01-23-1317-testing-default-smithi/7528184
2024-01-24T08:24:52.893 INFO:teuthology.dispatcher.supervisor:Job PID: 1415394
2024-01-24T08:24:52.893 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-01-24T08:26:52.894 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T08:28:52.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T08:30:53.036 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T08:32:53.116 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T08:34:53.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T08:36:53.265 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T08:38:53.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T08:38:53.414 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-01-24T08:38:53.522 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2024-01-24T08:38:53.522 INFO:teuthology.nuke:Checking targets against current locks
2024-01-24T08:38:53.567 DEBUG:teuthology.nuke:shortname: smithi019
2024-01-24T08:38:53.567 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-24T08:38:53.585 DEBUG:teuthology.nuke:shortname: smithi173
2024-01-24T08:38:53.585 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-24T08:38:53.588 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi019.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-23_14:05:57-fs-wip-vshankar-testing1-reef-2024-01-23-1317-testing-default-smithi/7528184', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-24 08:19:46.381077', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLc5G8jxchvyDphmFlPxeqTwcVjOWBZoOxDJ84kTn1gw5T2hgB+jC1g/qmCpKbij3evAPjHNtwOie1N9OzFZlJY='}
2024-01-24T08:38:53.613 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi173.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-23_14:05:57-fs-wip-vshankar-testing1-reef-2024-01-23-1317-testing-default-smithi/7528184', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-24 08:19:46.382729', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHcY0385SzTmMY99LnbtuUQkvcWjW0twH+naN6yMWrUrlnsUY12VFO1Ca9FrKD1FEK2TwLB7OZs8gdi2ZkwoeEI='}
2024-01-24T08:38:53.632 INFO:teuthology.orchestra.console.smithi019:Power off
2024-01-24T08:38:53.632 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-24T08:38:53.654 DEBUG:teuthology.orchestra.console.smithi019:power off output: Chassis Power Control: Down/Off
2024-01-24T08:38:53.654 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T08:38:53.671 INFO:teuthology.orchestra.console.smithi173:Power off
2024-01-24T08:38:53.672 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-24T08:38:53.680 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off
2024-01-24T08:38:53.693 DEBUG:teuthology.orchestra.console.smithi173:power off output: Chassis Power Control: Down/Off
2024-01-24T08:38:53.693 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T08:38:53.715 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off
2024-01-24T08:38:53.781 INFO:teuthology.orchestra.console.smithi019:Power off completed
2024-01-24T08:38:53.815 INFO:teuthology.orchestra.console.smithi173:Power off completed
2024-01-24T08:38:53.936 INFO:teuthology.lock.ops:unlocked: smithi019.front.sepia.ceph.com
2024-01-24T08:38:53.961 INFO:teuthology.lock.ops:unlocked: smithi173.front.sepia.ceph.com