2022-04-25T04:11:09.980 INFO:root:teuthology version: 1.1.1.dev313+g1b11219b
2022-04-25T04:11:10.098 INFO:teuthology.lock.ops:Start node 'smithi142.front.sepia.ceph.com' reimaging
2022-04-25T04:11:10.099 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: reset os type and version on server
2022-04-25T04:11:10.099 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server
2022-04-25T04:11:10.116 INFO:teuthology.lock.ops:Node 'smithi142.front.sepia.ceph.com' reimaging is complete
2022-04-25T04:11:10.117 INFO:teuthology.lock.ops:Start node 'smithi178.front.sepia.ceph.com' reimaging
2022-04-25T04:11:10.117 INFO:teuthology.lock.ops:Updating [smithi178.front.sepia.ceph.com]: reset os type and version on server
2022-04-25T04:11:10.117 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server
2022-04-25T04:11:10.135 INFO:teuthology.lock.ops:Node 'smithi178.front.sepia.ceph.com' reimaging is complete
2022-04-25T04:11:10.326 INFO:teuthology.provision.fog.smithi142:Scheduling deploy of rhel 8.5
2022-04-25T04:11:10.339 INFO:teuthology.provision.fog.smithi178:Scheduling deploy of rhel 8.5
2022-04-25T04:11:10.621 INFO:teuthology.orchestra.console:Power off smithi178
2022-04-25T04:11:10.633 INFO:teuthology.orchestra.console:Power off smithi142
2022-04-25T04:11:18.984 INFO:teuthology.orchestra.console:Power off for smithi178 completed
2022-04-25T04:11:18.986 INFO:teuthology.orchestra.console:Power off for smithi142 completed
2022-04-25T04:11:19.085 INFO:teuthology.orchestra.console:Power on smithi178
2022-04-25T04:11:19.090 INFO:teuthology.orchestra.console:Power on smithi142
2022-04-25T04:11:27.451 INFO:teuthology.orchestra.console:Power on for smithi178 completed
2022-04-25T04:11:27.457 INFO:teuthology.orchestra.console:Power on for smithi142 completed
2022-04-25T04:11:27.552 INFO:teuthology.provision.fog.smithi178:Waiting for deploy to finish
2022-04-25T04:11:27.558 INFO:teuthology.provision.fog.smithi142:Waiting for deploy to finish
2022-04-25T04:15:31.152 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-04-25T04:15:56.512 INFO:teuthology.provision.fog.smithi142:Node is ready
2022-04-25T04:15:56.532 INFO:teuthology.orchestra.run.smithi142.stdout:smithi142.front.sepia.ceph.com
2022-04-25T04:15:56.592 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142 smithi142.front.sepia.ceph.com smithi142
2022-04-25T04:15:56.970 INFO:teuthology.provision.fog.smithi142:Deploy complete!
2022-04-25T04:16:29.718 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-04-25T04:16:29.963 INFO:teuthology.provision.fog.smithi178:Node is ready
2022-04-25T04:16:29.979 INFO:teuthology.orchestra.run.smithi178.stdout:smithi178.front.sepia.ceph.com
2022-04-25T04:16:30.035 INFO:teuthology.orchestra.run.smithi178.stdout:172.21.15.178 smithi178.front.sepia.ceph.com smithi178
2022-04-25T04:16:30.356 INFO:teuthology.provision.fog.smithi178:Deploy complete!
2022-04-25T04:16:30.497 INFO:teuthology.lock.ops:Checking smithi142.front.sepia.ceph.com
2022-04-25T04:16:30.497 INFO:teuthology.lock.ops:New key found. Updating...
2022-04-25T04:16:30.516 INFO:teuthology.lock.ops:Checking smithi178.front.sepia.ceph.com
2022-04-25T04:16:30.516 INFO:teuthology.lock.ops:New key found. Updating...
2022-04-25T04:16:30.532 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: set os type and version on server
2022-04-25T04:16:30.532 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com'
2022-04-25T04:16:30.774 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64
2022-04-25T04:16:30.831 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="Red Hat Enterprise Linux"
2022-04-25T04:16:30.831 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="8.5 (Ootpa)"
2022-04-25T04:16:30.831 INFO:teuthology.orchestra.run.smithi142.stdout:ID="rhel"
2022-04-25T04:16:30.831 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="fedora"
2022-04-25T04:16:30.831 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="8.5"
2022-04-25T04:16:30.831 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el8"
2022-04-25T04:16:30.831 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.5 (Ootpa)"
2022-04-25T04:16:30.831 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31"
2022-04-25T04:16:30.831 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2022-04-25T04:16:30.832 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://www.redhat.com/"
2022-04-25T04:16:30.832 INFO:teuthology.orchestra.run.smithi142.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-04-25T04:16:30.832 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-04-25T04:16:30.832 INFO:teuthology.orchestra.run.smithi142.stdout:
2022-04-25T04:16:30.832 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-04-25T04:16:30.832 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.5
2022-04-25T04:16:30.832 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-04-25T04:16:30.832 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.5"
2022-04-25T04:16:30.833 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server
2022-04-25T04:16:30.850 INFO:teuthology.lock.ops:Updating [smithi178.front.sepia.ceph.com]: set os type and version on server
2022-04-25T04:16:30.850 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com'
2022-04-25T04:16:31.033 INFO:teuthology.orchestra.run.smithi178.stdout:x86_64
2022-04-25T04:16:31.089 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="Red Hat Enterprise Linux"
2022-04-25T04:16:31.090 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="8.5 (Ootpa)"
2022-04-25T04:16:31.090 INFO:teuthology.orchestra.run.smithi178.stdout:ID="rhel"
2022-04-25T04:16:31.090 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE="fedora"
2022-04-25T04:16:31.090 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="8.5"
2022-04-25T04:16:31.090 INFO:teuthology.orchestra.run.smithi178.stdout:PLATFORM_ID="platform:el8"
2022-04-25T04:16:31.090 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.5 (Ootpa)"
2022-04-25T04:16:31.090 INFO:teuthology.orchestra.run.smithi178.stdout:ANSI_COLOR="0;31"
2022-04-25T04:16:31.091 INFO:teuthology.orchestra.run.smithi178.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2022-04-25T04:16:31.091 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://www.redhat.com/"
2022-04-25T04:16:31.091 INFO:teuthology.orchestra.run.smithi178.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-04-25T04:16:31.091 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-04-25T04:16:31.091 INFO:teuthology.orchestra.run.smithi178.stdout:
2022-04-25T04:16:31.091 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-04-25T04:16:31.091 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.5
2022-04-25T04:16:31.091 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-04-25T04:16:31.091 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.5"
2022-04-25T04:16:31.092 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server
2022-04-25T04:16:31.189 INFO:teuthology.dispatcher.supervisor:Running job 6804360
2022-04-25T04:16:31.190 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_1b11219b9af33884aae5eb66700541df4b9620ed/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2022-04-25_04:05:41-fs-wip-vshankar-testing-20220420-113951-testing-default-smithi/6804360 --name vshankar-2022-04-25_04:05:41-fs-wip-vshankar-testing-20220420-113951-testing-default-smithi --description fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/fsstress validater/lockdep} -- /home/teuthworker/archive/vshankar-2022-04-25_04:05:41-fs-wip-vshankar-testing-20220420-113951-testing-default-smithi/6804360/orig.config.yaml
2022-04-25T04:16:31.193 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2022-04-25_04:05:41-fs-wip-vshankar-testing-20220420-113951-testing-default-smithi/6804360
2022-04-25T04:16:31.193 INFO:teuthology.dispatcher.supervisor:Job PID: 14940
2022-04-25T04:16:31.194 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-04-25T10:46:59.164 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-04-25T10:46:59.345 INFO:teuthology.kill:Killing Pids: {14940}
2022-04-25T10:47:00.846 INFO:teuthology.task.internal:roles: ubuntu@smithi142.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-04-25T10:47:00.847 INFO:teuthology.task.internal:roles: ubuntu@smithi178.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-04-25T10:47:00.847 INFO:teuthology.misc:Compressing logs...
2022-04-25T10:47:00.847 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com'
2022-04-25T10:47:11.051 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_1b11219b9af33884aae5eb66700541df4b9620ed/teuthology/dispatcher/supervisor.py", line 288, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_1b11219b9af33884aae5eb66700541df4b9620ed/teuthology/dispatcher/supervisor.py", line 346, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_1b11219b9af33884aae5eb66700541df4b9620ed/teuthology/misc.py", line 1378, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_1b11219b9af33884aae5eb66700541df4b9620ed/teuthology/orchestra/cluster.py", line 85, in run
    procs = [remote.run(**kwargs, wait=_wait) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_1b11219b9af33884aae5eb66700541df4b9620ed/teuthology/orchestra/cluster.py", line 85, in <listcomp>
    procs = [remote.run(**kwargs, wait=_wait) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_1b11219b9af33884aae5eb66700541df4b9620ed/teuthology/orchestra/remote.py", line 509, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_1b11219b9af33884aae5eb66700541df4b9620ed/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2022-04-25T10:47:11.113 INFO:teuthology.kill:No teuthology processes running
2022-04-25T10:47:12.442 INFO:teuthology.kill:Nuking machines: ['smithi142', 'smithi178']
2022-04-25T10:47:13.670 INFO:teuthology.kill:2022-04-25 10:47:13,669.669 INFO:teuthology.nuke:targets:
2022-04-25T10:47:13.670 INFO:teuthology.kill:  smithi142.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCWtjqJXRz3HeA0OqJOi+273j3y0akU1qWgjsNo5pvbNmFZ08HEZRrdmAm/nUbD6Nk708LNxygfJ7Tlpi7AEtb4GVRAdW93Ci4B/ZYIFU7lPlOOimNkIhTdP3nICmbmn7gb18ZHVj2K8zjN+w0ItVz3DZoXYr1GYOFioRnUgk6JztzOjHncpHni06KW8Rkp3cgzKsfNVglH8Yd6UhDqwqgbo8uM7r6CERzlMAUN/gRhVDYdKXpZd1YA7TnJ7Q7P1Rdpgee4VbLrTwNO75u7wcxC7FAD/SiKzi2ukwrJGqEbg8E3HTmWz+evoj7U3JXOT0KkDEjv45p5+NAOPoK8zP3rPlXRFuA9fNClMfgyRSyirSxKxoatQKXk6vwWf3kej7W8niMFbXWh470Al1YjkVpZ+YuSAsNAAR/BpyPBfUPml+WIkulJfW0muAoJEpzwYol+Y9HRktD89hI4WyjVg6FvkE9bnLC1Q1Lo/UZCvDmER9kiKXTe3M0XVEIIZkgGAWs=
2022-04-25T10:47:13.670 INFO:teuthology.kill:  smithi178.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD8AXYtn2c1mfdM9oF+hcuelOc7PDVFEtBhHKFKLSHMebePYw3ZwAAb5b5vsdd0pFpi1hovl9sf5bZiDcjKnvy93s7Gsm05qK+nmdxWEXvK/Dao4cIe4LYZTrSBK3grfQV6rfjbmiGOnPQibPGdn3spqejVhaIrXpEck9UpzKtfnjhSyi0j1KTMH2VJZ/7NpDsB6Bbo+xvHg2XWpj6JvY0r0rYR+BWAkmxL8jCRObudCcIwVd+n8QbyYAY6H7RoSmeBNwQs2jaToN/x49HJBA4OpRE/jseE+Wjgi7QepSnE2OhoyL+epTVx/4PWWVWYJsuMHLUe+elHxYAXOqV/XBO7149T/cgN2b58TgYDBb1WanIsRlX3j487aqmxoYuWv06EvWRm7we7wy+Eo6mKi5x+LnPdlVjtTqYALFJgPS+Zu5zHnc2v8xQM8g5DD69moGXtIZR+bPhdg3a3cX4ZC06N8gm0BphmA3Yic0MrzeHrqvN8v7QS9chTBDVrAyYbnv8=
2022-04-25T10:47:13.697 INFO:teuthology.kill:2022-04-25 10:47:13,697.697 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-04-25T10:47:13.700 INFO:teuthology.kill:2022-04-25 10:47:13,700.700 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-04-25T10:47:13.777 INFO:teuthology.kill:2022-04-25 10:47:13,776.776 INFO:teuthology.orchestra.console:Power off smithi178
2022-04-25T10:47:13.790 INFO:teuthology.kill:2022-04-25 10:47:13,790.790 INFO:teuthology.orchestra.console:Power off smithi142
2022-04-25T10:47:22.143 INFO:teuthology.kill:2022-04-25 10:47:22,142.142 INFO:teuthology.orchestra.console:Power off for smithi178 completed
2022-04-25T10:47:22.151 INFO:teuthology.kill:2022-04-25 10:47:22,151.151 INFO:teuthology.orchestra.console:Power off for smithi142 completed
2022-04-25T10:47:22.285 INFO:teuthology.kill:2022-04-25 10:47:22,284.284 INFO:teuthology.lock.ops:unlocked: smithi178.front.sepia.ceph.com
2022-04-25T10:47:22.292 INFO:teuthology.kill:2022-04-25 10:47:22,292.292 INFO:teuthology.lock.ops:unlocked: smithi142.front.sepia.ceph.com
2022-04-25T10:49:22.498 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-04-25T10:49:22.609 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi142 but it was locked by another job: /home/teuthworker/archive/vshankar-2022-04-25_07:47:28-fs-wip-vshankar-testing1-20220425-093759-testing-default-smithi/6804850
2022-04-25T10:49:22.609 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi178 but it was locked by another job: /home/teuthworker/archive/vshankar-2022-04-25_07:47:28-fs-wip-vshankar-testing1-20220425-093759-testing-default-smithi/6804850