2024-02-28T11:04:55.972 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55
2024-02-28T11:04:55.972 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T11:04:56.134 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f35d570af70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f35d676ac10>, signals=[15])
2024-02-28T11:04:56.134 INFO:teuthology.lock.ops:Start node 'smithi029.front.sepia.ceph.com' reimaging
2024-02-28T11:04:56.134 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: reset os type and version on server
2024-02-28T11:04:56.134 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server
2024-02-28T11:04:56.153 INFO:teuthology.lock.ops:Start node 'smithi170.front.sepia.ceph.com' reimaging
2024-02-28T11:04:56.153 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: reset os type and version on server
2024-02-28T11:04:56.154 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server
2024-02-28T11:04:56.177 INFO:teuthology.lock.ops:Start node 'smithi186.front.sepia.ceph.com' reimaging
2024-02-28T11:04:56.178 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: reset os type and version on server
2024-02-28T11:04:56.178 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server
2024-02-28T11:04:56.271 DEBUG:teuthology.provision.fog.smithi029:Requesting image smithi_rhel_8.6 (ID 5)
2024-02-28T11:04:56.296 DEBUG:teuthology.provision.fog.smithi186:Requesting image smithi_rhel_8.6 (ID 5)
2024-02-28T11:04:56.299 DEBUG:teuthology.provision.fog.smithi170:Requesting image smithi_rhel_8.6 (ID 5)
2024-02-28T11:04:56.311 INFO:teuthology.provision.fog.smithi029:Scheduling deploy of rhel 8.6
2024-02-28T11:04:56.340 INFO:teuthology.provision.fog.smithi170:Scheduling deploy of rhel 8.6
2024-02-28T11:04:56.356 INFO:teuthology.provision.fog.smithi186:Scheduling deploy of rhel 8.6
2024-02-28T11:04:56.602 INFO:teuthology.orchestra.console.smithi029:Power off
2024-02-28T11:04:56.602 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-28T11:04:56.621 INFO:teuthology.orchestra.console.smithi186:Power off
2024-02-28T11:04:56.621 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-28T11:04:56.629 DEBUG:teuthology.orchestra.console.smithi029:power off output: Chassis Power Control: Down/Off
2024-02-28T11:04:56.629 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T11:04:56.644 INFO:teuthology.orchestra.console.smithi170:Power off
2024-02-28T11:04:56.644 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-28T11:04:56.651 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off
2024-02-28T11:04:56.652 DEBUG:teuthology.orchestra.console.smithi186:power off output: Chassis Power Control: Down/Off
2024-02-28T11:04:56.652 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T11:04:56.667 DEBUG:teuthology.orchestra.console.smithi170:power off output: Chassis Power Control: Down/Off
2024-02-28T11:04:56.667 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T11:04:56.676 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off
2024-02-28T11:04:56.689 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off
2024-02-28T11:04:56.752 INFO:teuthology.orchestra.console.smithi029:Power off completed
2024-02-28T11:04:56.777 INFO:teuthology.orchestra.console.smithi186:Power off completed
2024-02-28T11:04:56.790 INFO:teuthology.orchestra.console.smithi170:Power off completed
2024-02-28T11:04:56.854 INFO:teuthology.orchestra.console.smithi029:Power on
2024-02-28T11:04:56.854 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-28T11:04:56.876 DEBUG:teuthology.orchestra.console.smithi029:power on output: Chassis Power Control: Up/On
2024-02-28T11:04:56.876 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T11:04:56.884 INFO:teuthology.orchestra.console.smithi186:Power on
2024-02-28T11:04:56.884 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-28T11:04:56.891 INFO:teuthology.orchestra.console.smithi170:Power on
2024-02-28T11:04:56.891 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-28T11:04:56.904 DEBUG:teuthology.orchestra.console.smithi186:power on output: Chassis Power Control: Up/On
2024-02-28T11:04:56.904 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T11:04:56.912 DEBUG:teuthology.orchestra.console.smithi170:power on output: Chassis Power Control: Up/On
2024-02-28T11:04:56.912 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T11:04:56.919 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off
2024-02-28T11:04:56.926 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off
2024-02-28T11:04:56.932 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off
2024-02-28T11:05:00.924 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T11:05:00.931 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T11:05:00.937 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T11:05:01.033 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off
2024-02-28T11:05:01.039 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off
2024-02-28T11:05:01.046 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off
2024-02-28T11:05:05.038 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T11:05:05.045 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T11:05:05.052 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T11:05:05.148 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on
2024-02-28T11:05:05.157 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on
2024-02-28T11:05:05.161 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on
2024-02-28T11:05:05.250 INFO:teuthology.orchestra.console.smithi029:Power on completed
2024-02-28T11:05:05.258 INFO:teuthology.orchestra.console.smithi186:Power on completed
2024-02-28T11:05:05.262 INFO:teuthology.orchestra.console.smithi170:Power on completed
2024-02-28T11:05:05.351 INFO:teuthology.provision.fog.smithi029:Waiting for deploy to finish
2024-02-28T11:05:05.359 INFO:teuthology.provision.fog.smithi186:Waiting for deploy to finish
2024-02-28T11:05:05.363 INFO:teuthology.provision.fog.smithi170:Waiting for deploy to finish
2024-02-28T11:07:51.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T11:07:51.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T11:07:54.623 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170
2024-02-28T11:08:00.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T11:08:03.676 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170
2024-02-28T11:08:09.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T11:08:12.739 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170
2024-02-28T11:08:18.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T11:08:21.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T11:08:21.820 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170
2024-02-28T11:08:24.732 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29
2024-02-28T11:08:27.821 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T11:08:30.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T11:08:30.880 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170
2024-02-28T11:08:33.788 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29
2024-02-28T11:08:36.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T11:08:39.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T11:08:42.844 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29
2024-02-28T11:08:48.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T11:08:51.599 ERROR:teuthology.orchestra.connection:Error authenticating with smithi186.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 457, in connect
    server_key = t.get_remote_server_key()
  File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 918, in get_remote_server_key
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2024-02-28T11:08:51.900 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29
2024-02-28T11:08:55.484 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170
2024-02-28T11:08:57.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T11:08:58.652 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186
2024-02-28T11:09:00.956 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29
2024-02-28T11:09:01.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T11:09:04.540 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170
2024-02-28T11:09:04.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T11:09:06.957 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T11:09:10.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T11:09:13.596 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170
2024-02-28T11:09:19.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T11:09:19.972 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-28T11:09:19.973 DEBUG:teuthology.orchestra.run.smithi170:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-28T11:09:35.453 INFO:teuthology.provision.fog.smithi170:Node is ready
2024-02-28T11:09:35.453 DEBUG:teuthology.orchestra.run.smithi170:> hostname
2024-02-28T11:09:35.516 INFO:teuthology.orchestra.run.smithi170.stdout:smithi045
2024-02-28T11:09:35.516 DEBUG:teuthology.orchestra.run.smithi170:> grep smithi045 /etc/hosts
2024-02-28T11:09:35.575 DEBUG:teuthology.orchestra.run:got remote process result: 1
2024-02-28T11:09:35.575 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/smithi045/smithi170/g' /etc/hostname
2024-02-28T11:09:35.721 DEBUG:teuthology.orchestra.run.smithi170:> sudo hostname smithi170
2024-02-28T11:09:35.750 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release
2024-02-28T11:09:35.808 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="Red Hat Enterprise Linux"
2024-02-28T11:09:35.809 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="8.6 (Ootpa)"
2024-02-28T11:09:35.809 INFO:teuthology.orchestra.run.smithi170.stdout:ID="rhel"
2024-02-28T11:09:35.809 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="fedora"
2024-02-28T11:09:35.809 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="8.6"
2024-02-28T11:09:35.809 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el8"
2024-02-28T11:09:35.809 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-02-28T11:09:35.809 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31"
2024-02-28T11:09:35.809 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-02-28T11:09:35.809 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://www.redhat.com/"
2024-02-28T11:09:35.809 INFO:teuthology.orchestra.run.smithi170.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-02-28T11:09:35.809 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-28T11:09:35.809 INFO:teuthology.orchestra.run.smithi170.stdout:
2024-02-28T11:09:35.809 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-28T11:09:35.810 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-02-28T11:09:35.810 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-02-28T11:09:35.810 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-02-28T11:09:35.810 INFO:teuthology.provision.fog.smithi170:Deploy complete!
2024-02-28T11:09:35.811 DEBUG:teuthology.parallel:result is None
2024-02-28T11:10:04.656 WARNING:teuthology.provision.fog.smithi186:timed out
2024-02-28T11:10:06.960 WARNING:teuthology.provision.fog.smithi029:timed out
2024-02-28T11:10:10.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T11:10:10.883 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-28T11:10:10.884 DEBUG:teuthology.orchestra.run.smithi186:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-28T11:10:11.142 INFO:teuthology.provision.fog.smithi186:Node is ready
2024-02-28T11:10:11.143 DEBUG:teuthology.orchestra.run.smithi186:> hostname
2024-02-28T11:10:11.202 INFO:teuthology.orchestra.run.smithi186.stdout:smithi186.front.sepia.ceph.com
2024-02-28T11:10:11.202 DEBUG:teuthology.orchestra.run.smithi186:> grep smithi186.front.sepia.ceph.com /etc/hosts
2024-02-28T11:10:11.262 INFO:teuthology.orchestra.run.smithi186.stdout:172.21.15.186 smithi186.front.sepia.ceph.com smithi186
2024-02-28T11:10:11.263 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname smithi186
2024-02-28T11:10:11.379 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi186.front.sepia.ceph.com/smithi186/g' /etc/hosts
2024-02-28T11:10:11.409 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/172.21.15.186/172.21.15.186/g' /etc/hosts
2024-02-28T11:10:11.480 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi186.front.sepia.ceph.com/smithi186/g' /etc/hostname
2024-02-28T11:10:11.549 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname smithi186
2024-02-28T11:10:11.617 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release
2024-02-28T11:10:11.674 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="Red Hat Enterprise Linux"
2024-02-28T11:10:11.675 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="8.6 (Ootpa)"
2024-02-28T11:10:11.675 INFO:teuthology.orchestra.run.smithi186.stdout:ID="rhel"
2024-02-28T11:10:11.675 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="fedora"
2024-02-28T11:10:11.675 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="8.6"
2024-02-28T11:10:11.675 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el8"
2024-02-28T11:10:11.675 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-02-28T11:10:11.675 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31"
2024-02-28T11:10:11.675 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-02-28T11:10:11.675 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://www.redhat.com/"
2024-02-28T11:10:11.675 INFO:teuthology.orchestra.run.smithi186.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-02-28T11:10:11.675 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-28T11:10:11.675 INFO:teuthology.orchestra.run.smithi186.stdout:
2024-02-28T11:10:11.675 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-28T11:10:11.676 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-02-28T11:10:11.676 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-02-28T11:10:11.676 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-02-28T11:10:11.676 INFO:teuthology.provision.fog.smithi186:Deploy complete!
2024-02-28T11:10:11.677 DEBUG:teuthology.parallel:result is None
2024-02-28T11:10:12.961 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T11:10:13.247 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-28T11:10:13.247 DEBUG:teuthology.orchestra.run.smithi029:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-28T11:10:13.529 INFO:teuthology.provision.fog.smithi029:Node is ready
2024-02-28T11:10:13.529 DEBUG:teuthology.orchestra.run.smithi029:> hostname
2024-02-28T11:10:13.551 INFO:teuthology.orchestra.run.smithi029.stdout:smithi029.front.sepia.ceph.com
2024-02-28T11:10:13.551 DEBUG:teuthology.orchestra.run.smithi029:> grep smithi029.front.sepia.ceph.com /etc/hosts
2024-02-28T11:10:13.612 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29 smithi029.front.sepia.ceph.com smithi029
2024-02-28T11:10:13.612 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname smithi029
2024-02-28T11:10:13.735 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/smithi029.front.sepia.ceph.com/smithi029/g' /etc/hosts
2024-02-28T11:10:13.769 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/172.21.15.29/172.21.15.29/g' /etc/hosts
2024-02-28T11:10:13.845 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/smithi029.front.sepia.ceph.com/smithi029/g' /etc/hostname
2024-02-28T11:10:13.920 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname smithi029
2024-02-28T11:10:13.995 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release
2024-02-28T11:10:14.057 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="Red Hat Enterprise Linux"
2024-02-28T11:10:14.057 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="8.6 (Ootpa)"
2024-02-28T11:10:14.057 INFO:teuthology.orchestra.run.smithi029.stdout:ID="rhel"
2024-02-28T11:10:14.057 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="fedora"
2024-02-28T11:10:14.057 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="8.6"
2024-02-28T11:10:14.057 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el8"
2024-02-28T11:10:14.057 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-02-28T11:10:14.057 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31"
2024-02-28T11:10:14.057 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-02-28T11:10:14.057 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://www.redhat.com/"
2024-02-28T11:10:14.057 INFO:teuthology.orchestra.run.smithi029.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-02-28T11:10:14.057 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-28T11:10:14.057 INFO:teuthology.orchestra.run.smithi029.stdout:
2024-02-28T11:10:14.058 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-28T11:10:14.058 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-02-28T11:10:14.058 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-02-28T11:10:14.058 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-02-28T11:10:14.058 INFO:teuthology.provision.fog.smithi029:Deploy complete!
2024-02-28T11:10:14.059 DEBUG:teuthology.parallel:result is None
2024-02-28T11:10:14.252 INFO:teuthology.lock.ops:Checking smithi029.front.sepia.ceph.com
2024-02-28T11:10:14.253 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-28T11:10:14.271 INFO:teuthology.lock.ops:Checking smithi170.front.sepia.ceph.com
2024-02-28T11:10:14.272 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-28T11:10:14.296 INFO:teuthology.lock.ops:Checking smithi186.front.sepia.ceph.com
2024-02-28T11:10:14.296 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-28T11:10:14.314 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: set os type and version on server
2024-02-28T11:10:14.314 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com'
2024-02-28T11:10:14.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T11:10:14.391 DEBUG:teuthology.orchestra.run.smithi029:> true
2024-02-28T11:10:14.466 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com'
2024-02-28T11:10:14.466 DEBUG:teuthology.orchestra.run.smithi029:> uname -m
2024-02-28T11:10:14.527 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64
2024-02-28T11:10:14.528 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release
2024-02-28T11:10:14.588 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="Red Hat Enterprise Linux"
2024-02-28T11:10:14.589 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="8.6 (Ootpa)"
2024-02-28T11:10:14.589 INFO:teuthology.orchestra.run.smithi029.stdout:ID="rhel"
2024-02-28T11:10:14.589 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="fedora"
2024-02-28T11:10:14.589 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="8.6"
2024-02-28T11:10:14.589 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el8"
2024-02-28T11:10:14.589 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-02-28T11:10:14.589 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31"
2024-02-28T11:10:14.589 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-02-28T11:10:14.589 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://www.redhat.com/"
2024-02-28T11:10:14.589 INFO:teuthology.orchestra.run.smithi029.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-02-28T11:10:14.589 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-28T11:10:14.589 INFO:teuthology.orchestra.run.smithi029.stdout:
2024-02-28T11:10:14.590 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-28T11:10:14.590 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-02-28T11:10:14.590 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-02-28T11:10:14.590 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-02-28T11:10:14.590 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server
2024-02-28T11:10:14.613 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: set os type and version on server
2024-02-28T11:10:14.613 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com'
2024-02-28T11:10:14.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T11:10:14.685 DEBUG:teuthology.orchestra.run.smithi170:> true
2024-02-28T11:10:14.762 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi170.front.sepia.ceph.com'
2024-02-28T11:10:14.762 DEBUG:teuthology.orchestra.run.smithi170:> uname -m
2024-02-28T11:10:14.822 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64
2024-02-28T11:10:14.822 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release
2024-02-28T11:10:14.882 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="Red Hat Enterprise Linux"
2024-02-28T11:10:14.883 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="8.6 (Ootpa)"
2024-02-28T11:10:14.883 INFO:teuthology.orchestra.run.smithi170.stdout:ID="rhel"
2024-02-28T11:10:14.883 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="fedora"
2024-02-28T11:10:14.883 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="8.6"
2024-02-28T11:10:14.883 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el8"
2024-02-28T11:10:14.883 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-02-28T11:10:14.883 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31"
2024-02-28T11:10:14.883 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-02-28T11:10:14.883 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://www.redhat.com/"
2024-02-28T11:10:14.883 INFO:teuthology.orchestra.run.smithi170.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-02-28T11:10:14.883 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-28T11:10:14.883 INFO:teuthology.orchestra.run.smithi170.stdout:
2024-02-28T11:10:14.883 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-28T11:10:14.883 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-02-28T11:10:14.884 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-02-28T11:10:14.884 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-02-28T11:10:14.884 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server
2024-02-28T11:10:14.904 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: set os type and version on server
2024-02-28T11:10:14.905 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com'
2024-02-28T11:10:14.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T11:10:14.977 DEBUG:teuthology.orchestra.run.smithi186:> true
2024-02-28T11:10:15.049 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi186.front.sepia.ceph.com'
2024-02-28T11:10:15.049 DEBUG:teuthology.orchestra.run.smithi186:> uname -m
2024-02-28T11:10:15.108 INFO:teuthology.orchestra.run.smithi186.stdout:x86_64
2024-02-28T11:10:15.109 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release
2024-02-28T11:10:15.167 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="Red Hat Enterprise Linux"
2024-02-28T11:10:15.167 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="8.6 (Ootpa)"
2024-02-28T11:10:15.167 INFO:teuthology.orchestra.run.smithi186.stdout:ID="rhel"
2024-02-28T11:10:15.167 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="fedora"
2024-02-28T11:10:15.167 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="8.6"
2024-02-28T11:10:15.167 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el8"
2024-02-28T11:10:15.167 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-02-28T11:10:15.167 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31"
2024-02-28T11:10:15.167 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-02-28T11:10:15.167 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://www.redhat.com/"
2024-02-28T11:10:15.168 INFO:teuthology.orchestra.run.smithi186.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-02-28T11:10:15.168 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-28T11:10:15.168 INFO:teuthology.orchestra.run.smithi186.stdout:
2024-02-28T11:10:15.168 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-28T11:10:15.168 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-02-28T11:10:15.168 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-02-28T11:10:15.168 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-02-28T11:10:15.169 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server
2024-02-28T11:10:15.196 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T11:10:15.293 INFO:teuthology.dispatcher.supervisor:Running job 7575317
2024-02-28T11:10:15.294 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-02-28_09:32:44-fs-wip-vshankar-testing1-reef-2024-02-28-1133-testing-default-smithi/7575317 --name vshankar-2024-02-28_09:32:44-fs-wip-vshankar-testing1-reef-2024-02-28-1133-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/direct_io}} -- /home/teuthworker/archive/vshankar-2024-02-28_09:32:44-fs-wip-vshankar-testing1-reef-2024-02-28-1133-testing-default-smithi/7575317/orig.config.yaml
2024-02-28T11:10:15.297 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-02-28_09:32:44-fs-wip-vshankar-testing1-reef-2024-02-28-1133-testing-default-smithi/7575317
2024-02-28T11:10:15.297 INFO:teuthology.dispatcher.supervisor:Job PID: 1416752
2024-02-28T11:10:15.297 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-02-28T11:11:24.733 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2024-02-28T11:12:15.349 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T11:14:15.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T11:16:15.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T11:18:15.873 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T11:20:16.044 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T11:22:16.206 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T11:24:16.372 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T11:26:16.530 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T11:28:16.688 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T11:30:16.861 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T11:32:17.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T11:34:17.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T11:36:17.392 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T11:38:17.778 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T11:40:17.941 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T11:42:18.117 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T11:44:18.293 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T11:44:18.367 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1