2023-12-13T14:22:53.204 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e
2023-12-13T14:22:53.204 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-13T14:22:53.386 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fe37b1e5310>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fe37c13f940>, signals=[15])
2023-12-13T14:22:53.387 INFO:teuthology.lock.ops:Start node 'smithi006.front.sepia.ceph.com' reimaging
2023-12-13T14:22:53.387 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: reset os type and version on server
2023-12-13T14:22:53.387 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server
2023-12-13T14:22:53.409 INFO:teuthology.lock.ops:Start node 'smithi132.front.sepia.ceph.com' reimaging
2023-12-13T14:22:53.409 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: reset os type and version on server
2023-12-13T14:22:53.409 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server
2023-12-13T14:22:53.433 INFO:teuthology.lock.ops:Start node 'smithi157.front.sepia.ceph.com' reimaging
2023-12-13T14:22:53.434 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: reset os type and version on server
2023-12-13T14:22:53.434 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server
2023-12-13T14:22:53.540 DEBUG:teuthology.provision.fog.smithi006:Requesting image smithi_rhel_8.4 (ID 7)
2023-12-13T14:22:53.566 DEBUG:teuthology.provision.fog.smithi132:Requesting image smithi_rhel_8.4 (ID 7)
2023-12-13T14:22:53.572 DEBUG:teuthology.provision.fog.smithi157:Requesting image smithi_rhel_8.4 (ID 7)
2023-12-13T14:22:53.584 INFO:teuthology.provision.fog.smithi006:Scheduling deploy of rhel 8.4
2023-12-13T14:22:53.613 INFO:teuthology.provision.fog.smithi157:Scheduling deploy of rhel 8.4
2023-12-13T14:22:53.620 INFO:teuthology.provision.fog.smithi132:Scheduling deploy of rhel 8.4
2023-12-13T14:22:53.806 INFO:teuthology.orchestra.console.smithi006:Power off
2023-12-13T14:22:53.806 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-13T14:22:53.827 DEBUG:teuthology.orchestra.console.smithi006:power off output: Chassis Power Control: Down/Off
2023-12-13T14:22:53.827 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T14:22:53.847 INFO:teuthology.orchestra.console.smithi157:Power off
2023-12-13T14:22:53.847 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-13T14:22:53.860 INFO:teuthology.orchestra.console.smithi132:Power off
2023-12-13T14:22:53.861 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-13T14:22:53.867 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off
2023-12-13T14:22:53.869 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off
2023-12-13T14:22:53.869 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T14:22:53.881 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off
2023-12-13T14:22:53.882 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T14:22:53.893 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on
2023-12-13T14:22:53.905 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on
2023-12-13T14:22:53.969 INFO:teuthology.orchestra.console.smithi006:Power off completed
2023-12-13T14:22:54.069 INFO:teuthology.orchestra.console.smithi006:Power on
2023-12-13T14:22:54.070 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-13T14:22:54.094 DEBUG:teuthology.orchestra.console.smithi006:power on output: Chassis Power Control: Up/On
2023-12-13T14:22:54.095 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T14:22:54.119 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off
2023-12-13T14:22:57.898 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T14:22:57.907 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T14:22:58.008 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on
2023-12-13T14:22:58.017 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on
2023-12-13T14:22:58.120 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T14:22:58.230 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off
2023-12-13T14:23:02.013 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T14:23:02.022 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T14:23:02.124 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off
2023-12-13T14:23:02.133 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on
2023-12-13T14:23:02.226 INFO:teuthology.orchestra.console.smithi157:Power off completed
2023-12-13T14:23:02.231 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T14:23:02.327 INFO:teuthology.orchestra.console.smithi157:Power on
2023-12-13T14:23:02.327 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-13T14:23:02.341 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on
2023-12-13T14:23:02.351 DEBUG:teuthology.orchestra.console.smithi157:power on output: Chassis Power Control: Up/On
2023-12-13T14:23:02.352 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T14:23:02.378 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off
2023-12-13T14:23:02.442 INFO:teuthology.orchestra.console.smithi006:Power on completed
2023-12-13T14:23:02.542 INFO:teuthology.provision.fog.smithi006:Waiting for deploy to finish
2023-12-13T14:23:06.138 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T14:23:06.248 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off
2023-12-13T14:23:06.349 INFO:teuthology.orchestra.console.smithi132:Power off completed
2023-12-13T14:23:06.379 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T14:23:06.450 INFO:teuthology.orchestra.console.smithi132:Power on
2023-12-13T14:23:06.451 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-13T14:23:06.474 DEBUG:teuthology.orchestra.console.smithi132:power on output: Chassis Power Control: Up/On
2023-12-13T14:23:06.474 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T14:23:06.491 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off
2023-12-13T14:23:06.495 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off
2023-12-13T14:23:10.494 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T14:23:10.501 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T14:23:10.603 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on
2023-12-13T14:23:10.609 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off
2023-12-13T14:23:10.705 INFO:teuthology.orchestra.console.smithi157:Power on completed
2023-12-13T14:23:10.806 INFO:teuthology.provision.fog.smithi157:Waiting for deploy to finish
2023-12-13T14:23:14.614 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T14:23:14.723 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on
2023-12-13T14:23:14.824 INFO:teuthology.orchestra.console.smithi132:Power on completed
2023-12-13T14:23:14.924 INFO:teuthology.provision.fog.smithi132:Waiting for deploy to finish
2023-12-13T14:25:33.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T14:25:33.416 ERROR:teuthology.orchestra.connection:Error authenticating with smithi006.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-13T14:25:45.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T14:25:45.744 ERROR:teuthology.orchestra.connection:Error authenticating with smithi132.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-13T14:26:11.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T14:26:37.419 WARNING:teuthology.provision.fog.smithi006:timed out
2023-12-13T14:26:43.420 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T14:26:49.751 WARNING:teuthology.provision.fog.smithi132:timed out
2023-12-13T14:26:55.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T14:26:58.818 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132
2023-12-13T14:27:01.858 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6
2023-12-13T14:27:04.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T14:27:07.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T14:27:07.878 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132
2023-12-13T14:27:10.914 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6
2023-12-13T14:27:13.880 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T14:27:16.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T14:27:16.930 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132
2023-12-13T14:27:17.353 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-13T14:27:17.353 DEBUG:teuthology.orchestra.run.smithi006:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-13T14:27:22.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T14:27:23.931 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-13T14:27:23.932 DEBUG:teuthology.orchestra.run.smithi132:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-13T14:27:32.639 INFO:teuthology.provision.fog.smithi006:Node is ready
2023-12-13T14:27:32.640 DEBUG:teuthology.orchestra.run.smithi006:> hostname
2023-12-13T14:27:32.655 INFO:teuthology.orchestra.run.smithi006.stdout:smithi006.front.sepia.ceph.com
2023-12-13T14:27:32.656 DEBUG:teuthology.orchestra.run.smithi006:> grep smithi006.front.sepia.ceph.com /etc/hosts
2023-12-13T14:27:32.710 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6 smithi006.front.sepia.ceph.com smithi006
2023-12-13T14:27:32.710 DEBUG:teuthology.orchestra.run.smithi006:> sudo hostname smithi006
2023-12-13T14:27:32.867 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/smithi006.front.sepia.ceph.com/smithi006/g' /etc/hosts
2023-12-13T14:27:32.891 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/172.21.15.6/172.21.15.6/g' /etc/hosts
2023-12-13T14:27:32.956 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/smithi006.front.sepia.ceph.com/smithi006/g' /etc/hostname
2023-12-13T14:27:33.020 DEBUG:teuthology.orchestra.run.smithi006:> sudo hostname smithi006
2023-12-13T14:27:33.084 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release
2023-12-13T14:27:33.138 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="Red Hat Enterprise Linux"
2023-12-13T14:27:33.138 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="8.4 (Ootpa)"
2023-12-13T14:27:33.139 INFO:teuthology.orchestra.run.smithi006.stdout:ID="rhel"
2023-12-13T14:27:33.139 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="fedora"
2023-12-13T14:27:33.139 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="8.4"
2023-12-13T14:27:33.139 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el8"
2023-12-13T14:27:33.139 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-12-13T14:27:33.139 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31"
2023-12-13T14:27:33.139 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-12-13T14:27:33.139 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://www.redhat.com/"
2023-12-13T14:27:33.139 INFO:teuthology.orchestra.run.smithi006.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-13T14:27:33.139 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-13T14:27:33.139 INFO:teuthology.orchestra.run.smithi006.stdout:
2023-12-13T14:27:33.139 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-13T14:27:33.140 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-12-13T14:27:33.140 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-13T14:27:33.140 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-12-13T14:27:33.140 INFO:teuthology.provision.fog.smithi006:Deploy complete!
2023-12-13T14:27:33.142 DEBUG:teuthology.parallel:result is None
2023-12-13T14:27:42.083 ERROR:teuthology.orchestra.connection:Error authenticating with smithi157.front.sepia.ceph.com: AuthenticationException('Authentication timeout.')
2023-12-13T14:27:44.177 INFO:teuthology.provision.fog.smithi132:Node is ready
2023-12-13T14:27:44.178 DEBUG:teuthology.orchestra.run.smithi132:> hostname
2023-12-13T14:27:44.194 INFO:teuthology.orchestra.run.smithi132.stdout:smithi132.front.sepia.ceph.com
2023-12-13T14:27:44.195 DEBUG:teuthology.orchestra.run.smithi132:> grep smithi132.front.sepia.ceph.com /etc/hosts
2023-12-13T14:27:44.250 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.15.132 smithi132.front.sepia.ceph.com smithi132
2023-12-13T14:27:44.251 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132
2023-12-13T14:27:44.386 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hosts
2023-12-13T14:27:44.409 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/172.21.15.132/172.21.15.132/g' /etc/hosts
2023-12-13T14:27:44.473 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hostname
2023-12-13T14:27:44.536 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132
2023-12-13T14:27:44.598 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release
2023-12-13T14:27:44.653 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="Red Hat Enterprise Linux"
2023-12-13T14:27:44.653 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8.4 (Ootpa)"
2023-12-13T14:27:44.653 INFO:teuthology.orchestra.run.smithi132.stdout:ID="rhel"
2023-12-13T14:27:44.653 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="fedora"
2023-12-13T14:27:44.654 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8.4"
2023-12-13T14:27:44.654 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8"
2023-12-13T14:27:44.654 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-12-13T14:27:44.654 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31"
2023-12-13T14:27:44.654 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-12-13T14:27:44.654 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://www.redhat.com/"
2023-12-13T14:27:44.657 INFO:teuthology.orchestra.run.smithi132.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-13T14:27:44.657 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-13T14:27:44.657 INFO:teuthology.orchestra.run.smithi132.stdout:
2023-12-13T14:27:44.657 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-13T14:27:44.657 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-12-13T14:27:44.657 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-13T14:27:44.657 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-12-13T14:27:44.658 INFO:teuthology.provision.fog.smithi132:Deploy complete!
2023-12-13T14:27:44.658 DEBUG:teuthology.parallel:result is None
2023-12-13T14:28:17.728 ERROR:teuthology.orchestra.connection:Error authenticating with smithi157.front.sepia.ceph.com: BadHostKeyException('smithi157.front.sepia.ceph.com', <paramiko.ecdsakey.ECDSAKey object at 0x7fe37acd4550>, <paramiko.ed25519key.Ed25519Key object at 0x7fe37acd0b80>) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi157.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC+CQLn9VoSxin4OJ1CCXXpz1gvbjsaYClxk86PxGtXV32IM5cw/GpO2ba/67PtOSpybGV0JZg97DOJMHPOjkWI=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAINk6PKPQhKNaSFnbEOgUPorTIMePnfC/suI0ZtWmsLlp'
2023-12-13T14:28:24.747 ERROR:teuthology.orchestra.connection:Error authenticating with smithi157.front.sepia.ceph.com: BadHostKeyException('smithi157.front.sepia.ceph.com', <paramiko.ecdsakey.ECDSAKey object at 0x7fe37ac813a0>, <paramiko.ed25519key.Ed25519Key object at 0x7fe37acd0b80>) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi157.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC+CQLn9VoSxin4OJ1CCXXpz1gvbjsaYClxk86PxGtXV32IM5cw/GpO2ba/67PtOSpybGV0JZg97DOJMHPOjkWI=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAINk6PKPQhKNaSFnbEOgUPorTIMePnfC/suI0ZtWmsLlp'
2023-12-13T14:28:34.764 ERROR:teuthology.orchestra.connection:Error authenticating with smithi157.front.sepia.ceph.com: BadHostKeyException('smithi157.front.sepia.ceph.com', <paramiko.ecdsakey.ECDSAKey object at 0x7fe37ac81df0>, <paramiko.ed25519key.Ed25519Key object at 0x7fe37acd0b80>) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi157.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC+CQLn9VoSxin4OJ1CCXXpz1gvbjsaYClxk86PxGtXV32IM5cw/GpO2ba/67PtOSpybGV0JZg97DOJMHPOjkWI=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAINk6PKPQhKNaSFnbEOgUPorTIMePnfC/suI0ZtWmsLlp'
2023-12-13T14:28:35.558 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2023-12-13T14:28:47.783 ERROR:teuthology.orchestra.connection:Error authenticating with smithi157.front.sepia.ceph.com: BadHostKeyException('smithi157.front.sepia.ceph.com', <paramiko.ecdsakey.ECDSAKey object at 0x7fe37ac84850>, <paramiko.ed25519key.Ed25519Key object at 0x7fe37acd0b80>) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi157.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC+CQLn9VoSxin4OJ1CCXXpz1gvbjsaYClxk86PxGtXV32IM5cw/GpO2ba/67PtOSpybGV0JZg97DOJMHPOjkWI=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAINk6PKPQhKNaSFnbEOgUPorTIMePnfC/suI0ZtWmsLlp'
2023-12-13T14:29:03.799 ERROR:teuthology.orchestra.connection:Error authenticating with smithi157.front.sepia.ceph.com: BadHostKeyException('smithi157.front.sepia.ceph.com', <paramiko.ecdsakey.ECDSAKey object at 0x7fe37ac8a2e0>, <paramiko.ed25519key.Ed25519Key object at 0x7fe37acd0b80>) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi157.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC+CQLn9VoSxin4OJ1CCXXpz1gvbjsaYClxk86PxGtXV32IM5cw/GpO2ba/67PtOSpybGV0JZg97DOJMHPOjkWI=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAINk6PKPQhKNaSFnbEOgUPorTIMePnfC/suI0ZtWmsLlp'
2023-12-13T14:29:22.816 ERROR:teuthology.orchestra.connection:Error authenticating with smithi157.front.sepia.ceph.com: BadHostKeyException('smithi157.front.sepia.ceph.com', <paramiko.ecdsakey.ECDSAKey object at 0x7fe37ac8a9d0>, <paramiko.ed25519key.Ed25519Key object at 0x7fe37acd0b80>) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi157.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC+CQLn9VoSxin4OJ1CCXXpz1gvbjsaYClxk86PxGtXV32IM5cw/GpO2ba/67PtOSpybGV0JZg97DOJMHPOjkWI=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAINk6PKPQhKNaSFnbEOgUPorTIMePnfC/suI0ZtWmsLlp'
2023-12-13T14:29:44.832 ERROR:teuthology.orchestra.connection:Error authenticating with smithi157.front.sepia.ceph.com: BadHostKeyException('smithi157.front.sepia.ceph.com', <paramiko.ecdsakey.ECDSAKey object at 0x7fe37ac8e460>, <paramiko.ed25519key.Ed25519Key object at 0x7fe37acd0b80>) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi157.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC+CQLn9VoSxin4OJ1CCXXpz1gvbjsaYClxk86PxGtXV32IM5cw/GpO2ba/67PtOSpybGV0JZg97DOJMHPOjkWI=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAINk6PKPQhKNaSFnbEOgUPorTIMePnfC/suI0ZtWmsLlp'
2023-12-13T14:30:09.850 ERROR:teuthology.orchestra.connection:Error authenticating with smithi157.front.sepia.ceph.com: BadHostKeyException('smithi157.front.sepia.ceph.com', <paramiko.ecdsakey.ECDSAKey object at 0x7fe37ac8eeb0>, <paramiko.ed25519key.Ed25519Key object at 0x7fe37acd0b80>) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi157.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC+CQLn9VoSxin4OJ1CCXXpz1gvbjsaYClxk86PxGtXV32IM5cw/GpO2ba/67PtOSpybGV0JZg97DOJMHPOjkWI=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAINk6PKPQhKNaSFnbEOgUPorTIMePnfC/suI0ZtWmsLlp'
2023-12-13T14:30:37.867 ERROR:teuthology.orchestra.connection:Error authenticating with smithi157.front.sepia.ceph.com: BadHostKeyException('smithi157.front.sepia.ceph.com', <paramiko.ecdsakey.ECDSAKey object at 0x7fe37ac928e0>, <paramiko.ed25519key.Ed25519Key object at 0x7fe37acd0b80>) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi157.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC+CQLn9VoSxin4OJ1CCXXpz1gvbjsaYClxk86PxGtXV32IM5cw/GpO2ba/67PtOSpybGV0JZg97DOJMHPOjkWI=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAINk6PKPQhKNaSFnbEOgUPorTIMePnfC/suI0ZtWmsLlp'
2023-12-13T14:30:37.868 WARNING:teuthology.provision.fog.smithi157:'connect to smithi157.front.sepia.ceph.com' reached maximum tries (11) after waiting for 145 seconds
2023-12-13T14:30:43.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T14:30:44.139 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-13T14:30:44.139 DEBUG:teuthology.orchestra.run.smithi157:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-13T14:30:44.438 INFO:teuthology.provision.fog.smithi157:Node is ready
2023-12-13T14:30:44.438 DEBUG:teuthology.orchestra.run.smithi157:> hostname
2023-12-13T14:30:44.453 INFO:teuthology.orchestra.run.smithi157.stdout:smithi157.front.sepia.ceph.com
2023-12-13T14:30:44.453 DEBUG:teuthology.orchestra.run.smithi157:> grep smithi157.front.sepia.ceph.com /etc/hosts
2023-12-13T14:30:44.508 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.15.157 smithi157.front.sepia.ceph.com smithi157
2023-12-13T14:30:44.508 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157
2023-12-13T14:30:44.611 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157.front.sepia.ceph.com/smithi157/g' /etc/hosts
2023-12-13T14:30:44.637 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/172.21.15.157/172.21.15.157/g' /etc/hosts
2023-12-13T14:30:44.701 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157.front.sepia.ceph.com/smithi157/g' /etc/hostname
2023-12-13T14:30:44.764 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157
2023-12-13T14:30:44.827 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release
2023-12-13T14:30:44.881 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Red Hat Enterprise Linux"
2023-12-13T14:30:44.881 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8.4 (Ootpa)"
2023-12-13T14:30:44.882 INFO:teuthology.orchestra.run.smithi157.stdout:ID="rhel"
2023-12-13T14:30:44.882 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="fedora"
2023-12-13T14:30:44.882 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8.4"
2023-12-13T14:30:44.882 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8"
2023-12-13T14:30:44.882 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-12-13T14:30:44.882 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31"
2023-12-13T14:30:44.882 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-12-13T14:30:44.882 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.redhat.com/"
2023-12-13T14:30:44.882 INFO:teuthology.orchestra.run.smithi157.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-13T14:30:44.882 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-13T14:30:44.882 INFO:teuthology.orchestra.run.smithi157.stdout:
2023-12-13T14:30:44.882 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-13T14:30:44.883 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-12-13T14:30:44.883 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-13T14:30:44.883 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-12-13T14:30:44.883 INFO:teuthology.provision.fog.smithi157:Deploy complete!
2023-12-13T14:30:44.884 DEBUG:teuthology.parallel:result is None
2023-12-13T14:30:45.109 INFO:teuthology.lock.ops:Checking smithi006.front.sepia.ceph.com
2023-12-13T14:30:45.109 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-13T14:30:45.134 INFO:teuthology.lock.ops:Checking smithi132.front.sepia.ceph.com
2023-12-13T14:30:45.134 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-13T14:30:45.150 INFO:teuthology.lock.ops:Checking smithi157.front.sepia.ceph.com
2023-12-13T14:30:45.150 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-13T14:30:45.168 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: set os type and version on server
2023-12-13T14:30:45.168 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com'
2023-12-13T14:30:45.169 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T14:30:45.238 DEBUG:teuthology.orchestra.run.smithi006:> true
2023-12-13T14:30:45.362 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com'
2023-12-13T14:30:45.363 DEBUG:teuthology.orchestra.run.smithi006:> uname -m
2023-12-13T14:30:45.417 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64
2023-12-13T14:30:45.417 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release
2023-12-13T14:30:45.474 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="Red Hat Enterprise Linux"
2023-12-13T14:30:45.474 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="8.4 (Ootpa)"
2023-12-13T14:30:45.474 INFO:teuthology.orchestra.run.smithi006.stdout:ID="rhel"
2023-12-13T14:30:45.475 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="fedora"
2023-12-13T14:30:45.475 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="8.4"
2023-12-13T14:30:45.475 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el8"
2023-12-13T14:30:45.475 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-12-13T14:30:45.475 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31"
2023-12-13T14:30:45.475 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-12-13T14:30:45.475 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://www.redhat.com/"
2023-12-13T14:30:45.475 INFO:teuthology.orchestra.run.smithi006.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-13T14:30:45.476 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-13T14:30:45.476 INFO:teuthology.orchestra.run.smithi006.stdout:
2023-12-13T14:30:45.476 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-13T14:30:45.476 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-12-13T14:30:45.476 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-13T14:30:45.476 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-12-13T14:30:45.477 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server
2023-12-13T14:30:45.501 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: set os type and version on server
2023-12-13T14:30:45.501 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com'
2023-12-13T14:30:45.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T14:30:45.568 DEBUG:teuthology.orchestra.run.smithi132:> true
2023-12-13T14:30:45.689 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com'
2023-12-13T14:30:45.690 DEBUG:teuthology.orchestra.run.smithi132:> uname -m
2023-12-13T14:30:45.744 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64
2023-12-13T14:30:45.744 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release
2023-12-13T14:30:45.799 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="Red Hat Enterprise Linux"
2023-12-13T14:30:45.799 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8.4 (Ootpa)"
2023-12-13T14:30:45.799 INFO:teuthology.orchestra.run.smithi132.stdout:ID="rhel"
2023-12-13T14:30:45.800 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="fedora"
2023-12-13T14:30:45.800 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8.4"
2023-12-13T14:30:45.800 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8"
2023-12-13T14:30:45.800 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-12-13T14:30:45.800 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31"
2023-12-13T14:30:45.800 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-12-13T14:30:45.800 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://www.redhat.com/"
2023-12-13T14:30:45.800 INFO:teuthology.orchestra.run.smithi132.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-13T14:30:45.800 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-13T14:30:45.800 INFO:teuthology.orchestra.run.smithi132.stdout:
2023-12-13T14:30:45.800 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-13T14:30:45.800 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-12-13T14:30:45.800 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-13T14:30:45.801 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-12-13T14:30:45.801 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server
2023-12-13T14:30:45.825 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: set os type and version on server
2023-12-13T14:30:45.825 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com'
2023-12-13T14:30:45.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T14:30:45.893 DEBUG:teuthology.orchestra.run.smithi157:> true
2023-12-13T14:30:45.913 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com'
2023-12-13T14:30:45.913 DEBUG:teuthology.orchestra.run.smithi157:> uname -m
2023-12-13T14:30:45.967 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64
2023-12-13T14:30:45.967 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release
2023-12-13T14:30:46.021 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Red Hat Enterprise Linux"
2023-12-13T14:30:46.021 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8.4 (Ootpa)"
2023-12-13T14:30:46.021 INFO:teuthology.orchestra.run.smithi157.stdout:ID="rhel"
2023-12-13T14:30:46.021 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="fedora"
2023-12-13T14:30:46.021 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8.4"
2023-12-13T14:30:46.021 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8"
2023-12-13T14:30:46.021 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-12-13T14:30:46.021 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31"
2023-12-13T14:30:46.021 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-12-13T14:30:46.022 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.redhat.com/"
2023-12-13T14:30:46.022 INFO:teuthology.orchestra.run.smithi157.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-13T14:30:46.022 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-13T14:30:46.022 INFO:teuthology.orchestra.run.smithi157.stdout:
2023-12-13T14:30:46.022 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-13T14:30:46.022 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-12-13T14:30:46.022 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-13T14:30:46.022 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-12-13T14:30:46.023 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server
2023-12-13T14:30:46.042 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-13T14:30:46.129 INFO:teuthology.dispatcher.supervisor:Running job 7489753
2023-12-13T14:30:46.129 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-12-13_09:42:45-fs-wip-vshankar-testing3-2023-12-13-1225-quincy-testing-default-smithi/7489753 --name vshankar-2023-12-13_09:42:45-fs-wip-vshankar-testing3-2023-12-13-1225-quincy-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/dbench} wsync/{no}} -- /home/teuthworker/archive/vshankar-2023-12-13_09:42:45-fs-wip-vshankar-testing3-2023-12-13-1225-quincy-testing-default-smithi/7489753/orig.config.yaml
2023-12-13T14:30:46.136 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-12-13_09:42:45-fs-wip-vshankar-testing3-2023-12-13-1225-quincy-testing-default-smithi/7489753
2023-12-13T14:30:46.137 INFO:teuthology.dispatcher.supervisor:Job PID: 2851687
2023-12-13T14:30:46.137 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-12-13T14:32:46.138 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-13T14:34:46.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-13T14:36:46.284 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-13T14:38:46.348 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-13T14:38:46.410 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-12-13T14:38:46.555 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-12-13T14:38:46.555 INFO:teuthology.nuke:Checking targets against current locks
2023-12-13T14:38:46.606 DEBUG:teuthology.nuke:shortname: smithi006
2023-12-13T14:38:46.607 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-13T14:38:46.635 DEBUG:teuthology.nuke:shortname: smithi132
2023-12-13T14:38:46.635 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-13T14:38:46.641 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi006.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-13_09:42:45-fs-wip-vshankar-testing3-2023-12-13-1225-quincy-testing-default-smithi/7489753', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-13 14:22:52.350502', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNsqAQ3aSpqCK05YWiQkcG3XeVrcsGd9gPsqKRj0rri+YmeLJunf1N/MfiT/62rSFruGrKf0Cq7bLc3riexSEYU='}
2023-12-13T14:38:46.658 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi132.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-13_09:42:45-fs-wip-vshankar-testing3-2023-12-13-1225-quincy-testing-default-smithi/7489753', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-13 14:22:52.353037', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMC5uOdc8dR7Ni9B/VHGBr3dKIFqFMyT6xvLghGWicQvHNm2r9eR8bpSR1PFmu4AJUo3lP+rk1+HpfvvsiZodAw='}
2023-12-13T14:38:46.663 DEBUG:teuthology.nuke:shortname: smithi157
2023-12-13T14:38:46.663 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-13T14:38:46.686 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-13_09:42:45-fs-wip-vshankar-testing3-2023-12-13-1225-quincy-testing-default-smithi/7489753', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-13 14:22:52.354773', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC+CQLn9VoSxin4OJ1CCXXpz1gvbjsaYClxk86PxGtXV32IM5cw/GpO2ba/67PtOSpybGV0JZg97DOJMHPOjkWI='}
2023-12-13T14:38:46.694 INFO:teuthology.orchestra.console.smithi006:Power off
2023-12-13T14:38:46.694 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-13T14:38:46.710 INFO:teuthology.orchestra.console.smithi132:Power off
2023-12-13T14:38:46.710 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-13T14:38:46.719 DEBUG:teuthology.orchestra.console.smithi006:power off output: Chassis Power Control: Down/Off
2023-12-13T14:38:46.719 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T14:38:46.732 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off
2023-12-13T14:38:46.732 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T14:38:46.752 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off
2023-12-13T14:38:46.753 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off
2023-12-13T14:38:46.759 INFO:teuthology.orchestra.console.smithi157:Power off
2023-12-13T14:38:46.760 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-13T14:38:46.780 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off
2023-12-13T14:38:46.781 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T14:38:46.805 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off
2023-12-13T14:38:46.853 INFO:teuthology.orchestra.console.smithi006:Power off completed
2023-12-13T14:38:46.853 INFO:teuthology.orchestra.console.smithi132:Power off completed
2023-12-13T14:38:46.906 INFO:teuthology.orchestra.console.smithi157:Power off completed
2023-12-13T14:38:47.004 INFO:teuthology.lock.ops:unlocked: smithi006.front.sepia.ceph.com
2023-12-13T14:38:47.011 INFO:teuthology.lock.ops:unlocked: smithi132.front.sepia.ceph.com
2023-12-13T14:38:47.054 INFO:teuthology.lock.ops:unlocked: smithi157.front.sepia.ceph.com