2022-03-20T10:30:30.384 INFO:root:teuthology version: 1.1.0-a4e18662
2022-03-20T10:30:30.506 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi027.front.sepia.ceph.com' reimaging
2022-03-20T10:30:30.507 INFO:teuthology.lock.ops:Updating [ubuntu@smithi027.front.sepia.ceph.com]: reset os type and version on server
2022-03-20T10:30:30.507 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server
2022-03-20T10:30:30.525 INFO:teuthology.lock.ops:Node 'ubuntu@smithi027.front.sepia.ceph.com' reimaging is complete
2022-03-20T10:30:30.525 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi059.front.sepia.ceph.com' reimaging
2022-03-20T10:30:30.526 INFO:teuthology.lock.ops:Updating [ubuntu@smithi059.front.sepia.ceph.com]: reset os type and version on server
2022-03-20T10:30:30.526 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server
2022-03-20T10:30:30.546 INFO:teuthology.lock.ops:Node 'ubuntu@smithi059.front.sepia.ceph.com' reimaging is complete
2022-03-20T10:30:30.754 INFO:teuthology.provision.fog.smithi027:Scheduling deploy of rhel 8.4
2022-03-20T10:30:30.770 INFO:teuthology.provision.fog.smithi059:Scheduling deploy of rhel 8.4
2022-03-20T10:30:31.085 INFO:teuthology.orchestra.console:Power off smithi027
2022-03-20T10:30:31.099 INFO:teuthology.orchestra.console:Power off smithi059
2022-03-20T10:30:31.226 INFO:teuthology.orchestra.console:Power off for smithi027 completed
2022-03-20T10:30:31.238 INFO:teuthology.orchestra.console:Power off for smithi059 completed
2022-03-20T10:30:31.328 INFO:teuthology.orchestra.console:Power on smithi027
2022-03-20T10:30:31.339 INFO:teuthology.orchestra.console:Power on smithi059
2022-03-20T10:30:35.583 INFO:teuthology.orchestra.console:Power on for smithi027 completed
2022-03-20T10:30:35.684 INFO:teuthology.provision.fog.smithi027:Waiting for deploy to finish
2022-03-20T10:30:39.700 INFO:teuthology.orchestra.console:Power on for smithi059 completed
2022-03-20T10:30:39.801 INFO:teuthology.provision.fog.smithi059:Waiting for deploy to finish
2022-03-20T10:34:47.111 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-20T10:34:47.378 INFO:teuthology.provision.fog.smithi059:Node is ready
2022-03-20T10:34:47.394 INFO:teuthology.orchestra.run.smithi059.stdout:smithi059.front.sepia.ceph.com
2022-03-20T10:34:47.450 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59 smithi059.front.sepia.ceph.com smithi059
2022-03-20T10:34:47.785 INFO:teuthology.provision.fog.smithi059:Deploy complete!
2022-03-20T10:35:23.119 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-20T10:35:38.466 INFO:teuthology.provision.fog.smithi027:Node is ready
2022-03-20T10:35:38.526 INFO:teuthology.orchestra.run.smithi027.stdout:smithi027.front.sepia.ceph.com
2022-03-20T10:35:38.583 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27 smithi027.front.sepia.ceph.com smithi027
2022-03-20T10:35:38.935 INFO:teuthology.provision.fog.smithi027:Deploy complete!
2022-03-20T10:35:39.109 INFO:teuthology.lock.ops:Checking smithi027.front.sepia.ceph.com
2022-03-20T10:35:39.110 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-20T10:35:39.128 INFO:teuthology.lock.ops:Checking smithi059.front.sepia.ceph.com
2022-03-20T10:35:39.128 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-20T10:35:39.148 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: set os type and version on server
2022-03-20T10:35:39.148 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com'
2022-03-20T10:35:39.378 INFO:teuthology.orchestra.run.smithi027.stdout:x86_64
2022-03-20T10:35:39.432 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="Red Hat Enterprise Linux"
2022-03-20T10:35:39.432 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="8.4 (Ootpa)"
2022-03-20T10:35:39.433 INFO:teuthology.orchestra.run.smithi027.stdout:ID="rhel"
2022-03-20T10:35:39.433 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="fedora"
2022-03-20T10:35:39.433 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="8.4"
2022-03-20T10:35:39.433 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el8"
2022-03-20T10:35:39.434 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-03-20T10:35:39.434 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31"
2022-03-20T10:35:39.434 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-03-20T10:35:39.434 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://www.redhat.com/"
2022-03-20T10:35:39.435 INFO:teuthology.orchestra.run.smithi027.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-03-20T10:35:39.435 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-20T10:35:39.435 INFO:teuthology.orchestra.run.smithi027.stdout:
2022-03-20T10:35:39.435 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-20T10:35:39.435 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-03-20T10:35:39.436 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-03-20T10:35:39.436 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-03-20T10:35:39.437 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server
2022-03-20T10:35:39.455 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: set os type and version on server
2022-03-20T10:35:39.455 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com'
2022-03-20T10:35:39.693 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64
2022-03-20T10:35:39.748 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="Red Hat Enterprise Linux"
2022-03-20T10:35:39.749 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="8.4 (Ootpa)"
2022-03-20T10:35:39.749 INFO:teuthology.orchestra.run.smithi059.stdout:ID="rhel"
2022-03-20T10:35:39.749 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="fedora"
2022-03-20T10:35:39.750 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="8.4"
2022-03-20T10:35:39.750 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el8"
2022-03-20T10:35:39.750 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-03-20T10:35:39.750 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31"
2022-03-20T10:35:39.751 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-03-20T10:35:39.751 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://www.redhat.com/"
2022-03-20T10:35:39.751 INFO:teuthology.orchestra.run.smithi059.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-03-20T10:35:39.751 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-20T10:35:39.752 INFO:teuthology.orchestra.run.smithi059.stdout:
2022-03-20T10:35:39.752 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-20T10:35:39.752 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-03-20T10:35:39.752 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-03-20T10:35:39.753 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-03-20T10:35:39.753 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server
2022-03-20T10:35:39.847 INFO:teuthology.dispatcher.supervisor:Running job 6747741
2022-03-20T10:35:39.848 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_a4e18662e5de936eb0ac089e531b933ecbcadb0a/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2022-03-20_02:16:37-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi/6747741 --name vshankar-2022-03-20_02:16:37-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/osd 2-workunit/fs/snaps}} -- /home/teuthworker/archive/vshankar-2022-03-20_02:16:37-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi/6747741/orig.config.yaml
2022-03-20T10:35:39.851 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2022-03-20_02:16:37-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi/6747741
2022-03-20T10:35:39.852 INFO:teuthology.dispatcher.supervisor:Job PID: 15840
2022-03-20T10:35:39.852 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-03-20T17:06:07.426 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-03-20T17:06:07.656 INFO:teuthology.kill:Killing Pids: {15840}
2022-03-20T17:06:08.759 INFO:teuthology.task.internal:roles: ubuntu@smithi027.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-03-20T17:06:08.760 INFO:teuthology.task.internal:roles: ubuntu@smithi059.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-03-20T17:06:08.760 INFO:teuthology.misc:Compressing logs...
2022-03-20T17:06:08.761 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com'
2022-03-20T17:06:08.940 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com'
2022-03-20T17:06:09.279 INFO:teuthology.misc:Compressing logs...
2022-03-20T17:06:09.433 INFO:teuthology.misc:Compressing logs...
2022-03-20T17:08:36.535 INFO:teuthology.kill:No teuthology processes running
2022-03-20T17:08:37.650 INFO:teuthology.kill:Nuking machines: ['smithi027', 'smithi059']
2022-03-20T17:08:38.610 INFO:teuthology.kill:2022-03-20 17:08:38,610.610 INFO:teuthology.nuke:targets:
2022-03-20T17:08:38.611 INFO:teuthology.kill:  smithi027.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLPS+Wg1Oo2tnnpD/1vlt9wjq6g7wDf+q4pWkOEB+/8C04f6G/U2hK3N1qlIeG3dnlApX23R+KjaxjQaPb+bCtxup5B3JqTNXyItPgWw9essENGh48Zvhb849JNNF+jvDIJ61uX5I1TVO0qOL8N5NCO4xbIULrGT8Rx0qIKmU0tAp/YI61AGWWnW+k/130Mm+tH1SR1F8Uwkh4tR5hANM9Gxg3AZJ/m63LHJ9tWaIDD2b1sCGhqZ2CNFUlw9M7ZlWiWcDOULjyU3SY7EA+33gW+rWHC/BLOdLrXXsxYeNaUxw6Y/5QcrWrYJuErMB63w2Lz+aDmSGrj6mkDQWzaF3YAbYYukaflBHD+IYwUb523BgCxMy8fxGPrje2vuYdnXsFuH6Vhh7lWdaOEJdnhbYa5gqpp56y59CTF7oLCphqZoKlEas9/HfJ46NoMhPJadKgDJCYO9gV3lep7gRigZepzNkgQ5ozw+TRUpIATG7RUanvG6Ooiddzskibf4c0Xnk=
2022-03-20T17:08:38.612 INFO:teuthology.kill:  smithi059.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDErZRQYO3uMNVSCg30oRyLzEqjzNJrLBCtUAZeyZLc+WhVhlOgB5Ri+N4aMd8ADFehdquJZyfJHeCqdJhDueypsz1dvIQSjGz3+bPnDDdoct91MHZagzss+WBeB+FvubyYj/aiNMI9CRxsvzTvY9o/7az0crCrmfJmOUc9Ku2aKtW4pf1tcicHg6lVnidAwC5vBShOD5Ue9n98anfCT6fCpVch5QP8//aHGWRsn/q2mzpvExhYZ2c6SVgL3UTtRdfgqhetz6YYcmIPXGaK26hD2dMAZHMg31MhoPipZ4FMBFmVxl1IASQ5hygrD/Ozew1+8YEHqlyx859TYpJ0oHbFI0SGhTVu20fSnGn7L8nBTiARtZzKiI3jJhEg34OBzfxoWI6eGA/pvjCtQPn15C+1jR7ZHL1B+Rynlwi5zPRyjNeUyNI4gtuoOEVu4gkEOq2Xkthg0gSV4194lsvnmVbCEfNankOsx7O5qudjYqHJzfxfgiWvzhP+yHc+bYSi3k=
2022-03-20T17:08:38.636 INFO:teuthology.kill:2022-03-20 17:08:38,636.636 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-20T17:08:38.639 INFO:teuthology.kill:2022-03-20 17:08:38,639.639 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-20T17:08:38.714 INFO:teuthology.kill:2022-03-20 17:08:38,714.714 INFO:teuthology.orchestra.console:Power off smithi059
2022-03-20T17:08:38.728 INFO:teuthology.kill:2022-03-20 17:08:38,727.727 INFO:teuthology.orchestra.console:Power off smithi027
2022-03-20T17:08:47.091 INFO:teuthology.kill:2022-03-20 17:08:47,090.090 INFO:teuthology.orchestra.console:Power off for smithi027 completed
2022-03-20T17:08:47.238 INFO:teuthology.kill:2022-03-20 17:08:47,238.238 INFO:teuthology.lock.ops:unlocked: smithi027.front.sepia.ceph.com
2022-03-20T17:08:51.197 INFO:teuthology.kill:2022-03-20 17:08:51,197.197 INFO:teuthology.orchestra.console:Power off for smithi059 completed
2022-03-20T17:08:51.339 INFO:teuthology.kill:2022-03-20 17:08:51,339.339 INFO:teuthology.lock.ops:unlocked: smithi059.front.sepia.ceph.com
2022-03-20T17:10:51.628 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-03-20T17:10:51.741 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi027 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-03-20_14:30:27-orch-quincy-distro-default-smithi/6749031
2022-03-20T17:10:51.741 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi059 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-03-20_14:30:27-orch-quincy-distro-default-smithi/6749031