2022-03-19T12:14:28.265 INFO:root:teuthology version: 1.1.0-aa078dbe
2022-03-19T12:14:28.392 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi025.front.sepia.ceph.com' reimaging
2022-03-19T12:14:28.394 INFO:teuthology.lock.ops:Updating [ubuntu@smithi025.front.sepia.ceph.com]: reset os type and version on server
2022-03-19T12:14:28.394 INFO:teuthology.lock.ops:Updating smithi025.front.sepia.ceph.com on lock server
2022-03-19T12:14:28.412 INFO:teuthology.lock.ops:Node 'ubuntu@smithi025.front.sepia.ceph.com' reimaging is complete
2022-03-19T12:14:28.413 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi036.front.sepia.ceph.com' reimaging
2022-03-19T12:14:28.413 INFO:teuthology.lock.ops:Updating [ubuntu@smithi036.front.sepia.ceph.com]: reset os type and version on server
2022-03-19T12:14:28.413 INFO:teuthology.lock.ops:Updating smithi036.front.sepia.ceph.com on lock server
2022-03-19T12:14:28.430 INFO:teuthology.lock.ops:Node 'ubuntu@smithi036.front.sepia.ceph.com' reimaging is complete
2022-03-19T12:14:28.626 INFO:teuthology.provision.fog.smithi025:Scheduling deploy of rhel 8.4
2022-03-19T12:14:28.642 INFO:teuthology.provision.fog.smithi036:Scheduling deploy of rhel 8.4
2022-03-19T12:14:28.949 INFO:teuthology.orchestra.console:Power off smithi025
2022-03-19T12:14:28.988 INFO:teuthology.orchestra.console:Power off smithi036
2022-03-19T12:14:29.098 INFO:teuthology.orchestra.console:Power off for smithi025 completed
2022-03-19T12:14:29.131 INFO:teuthology.orchestra.console:Power off for smithi036 completed
2022-03-19T12:14:29.199 INFO:teuthology.orchestra.console:Power on smithi025
2022-03-19T12:14:29.232 INFO:teuthology.orchestra.console:Power on smithi036
2022-03-19T12:14:37.588 INFO:teuthology.orchestra.console:Power on for smithi025 completed
2022-03-19T12:14:37.596 INFO:teuthology.orchestra.console:Power on for smithi036 completed
2022-03-19T12:14:37.690 INFO:teuthology.provision.fog.smithi025:Waiting for deploy to finish
2022-03-19T12:14:37.697 INFO:teuthology.provision.fog.smithi036:Waiting for deploy to finish
2022-03-19T12:18:42.540 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-19T12:18:42.782 INFO:teuthology.provision.fog.smithi036:Node is ready
2022-03-19T12:18:42.799 INFO:teuthology.orchestra.run.smithi036.stdout:smithi036.front.sepia.ceph.com
2022-03-19T12:18:42.858 INFO:teuthology.orchestra.run.smithi036.stdout:172.21.15.36 smithi036.front.sepia.ceph.com smithi036
2022-03-19T12:18:43.200 INFO:teuthology.provision.fog.smithi036:Deploy complete!
2022-03-19T12:19:54.851 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-19T12:19:55.065 INFO:teuthology.provision.fog.smithi025:Node is ready
2022-03-19T12:19:55.081 INFO:teuthology.orchestra.run.smithi025.stdout:smithi025.front.sepia.ceph.com
2022-03-19T12:19:55.137 INFO:teuthology.orchestra.run.smithi025.stdout:172.21.15.25 smithi025.front.sepia.ceph.com smithi025
2022-03-19T12:19:55.466 INFO:teuthology.provision.fog.smithi025:Deploy complete!
2022-03-19T12:19:55.627 INFO:teuthology.lock.ops:Checking smithi025.front.sepia.ceph.com
2022-03-19T12:19:55.628 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-19T12:19:55.648 INFO:teuthology.lock.ops:Checking smithi036.front.sepia.ceph.com
2022-03-19T12:19:55.648 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-19T12:19:55.666 INFO:teuthology.lock.ops:Updating [smithi025.front.sepia.ceph.com]: set os type and version on server
2022-03-19T12:19:55.666 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi025.front.sepia.ceph.com'
2022-03-19T12:19:55.890 INFO:teuthology.orchestra.run.smithi025.stdout:x86_64
2022-03-19T12:19:55.944 INFO:teuthology.orchestra.run.smithi025.stdout:NAME="Red Hat Enterprise Linux"
2022-03-19T12:19:55.945 INFO:teuthology.orchestra.run.smithi025.stdout:VERSION="8.4 (Ootpa)"
2022-03-19T12:19:55.945 INFO:teuthology.orchestra.run.smithi025.stdout:ID="rhel"
2022-03-19T12:19:55.945 INFO:teuthology.orchestra.run.smithi025.stdout:ID_LIKE="fedora"
2022-03-19T12:19:55.945 INFO:teuthology.orchestra.run.smithi025.stdout:VERSION_ID="8.4"
2022-03-19T12:19:55.946 INFO:teuthology.orchestra.run.smithi025.stdout:PLATFORM_ID="platform:el8"
2022-03-19T12:19:55.946 INFO:teuthology.orchestra.run.smithi025.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-03-19T12:19:55.946 INFO:teuthology.orchestra.run.smithi025.stdout:ANSI_COLOR="0;31"
2022-03-19T12:19:55.946 INFO:teuthology.orchestra.run.smithi025.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-03-19T12:19:55.946 INFO:teuthology.orchestra.run.smithi025.stdout:HOME_URL="https://www.redhat.com/"
2022-03-19T12:19:55.947 INFO:teuthology.orchestra.run.smithi025.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-03-19T12:19:55.947 INFO:teuthology.orchestra.run.smithi025.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-19T12:19:55.947 INFO:teuthology.orchestra.run.smithi025.stdout:
2022-03-19T12:19:55.947 INFO:teuthology.orchestra.run.smithi025.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-19T12:19:55.948 INFO:teuthology.orchestra.run.smithi025.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-03-19T12:19:55.948 INFO:teuthology.orchestra.run.smithi025.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-03-19T12:19:55.948 INFO:teuthology.orchestra.run.smithi025.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-03-19T12:19:55.949 INFO:teuthology.lock.ops:Updating smithi025.front.sepia.ceph.com on lock server
2022-03-19T12:19:55.968 INFO:teuthology.lock.ops:Updating [smithi036.front.sepia.ceph.com]: set os type and version on server
2022-03-19T12:19:55.968 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi036.front.sepia.ceph.com'
2022-03-19T12:19:56.210 INFO:teuthology.orchestra.run.smithi036.stdout:x86_64
2022-03-19T12:19:56.266 INFO:teuthology.orchestra.run.smithi036.stdout:NAME="Red Hat Enterprise Linux"
2022-03-19T12:19:56.267 INFO:teuthology.orchestra.run.smithi036.stdout:VERSION="8.4 (Ootpa)"
2022-03-19T12:19:56.267 INFO:teuthology.orchestra.run.smithi036.stdout:ID="rhel"
2022-03-19T12:19:56.267 INFO:teuthology.orchestra.run.smithi036.stdout:ID_LIKE="fedora"
2022-03-19T12:19:56.267 INFO:teuthology.orchestra.run.smithi036.stdout:VERSION_ID="8.4"
2022-03-19T12:19:56.268 INFO:teuthology.orchestra.run.smithi036.stdout:PLATFORM_ID="platform:el8"
2022-03-19T12:19:56.268 INFO:teuthology.orchestra.run.smithi036.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-03-19T12:19:56.268 INFO:teuthology.orchestra.run.smithi036.stdout:ANSI_COLOR="0;31"
2022-03-19T12:19:56.268 INFO:teuthology.orchestra.run.smithi036.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-03-19T12:19:56.268 INFO:teuthology.orchestra.run.smithi036.stdout:HOME_URL="https://www.redhat.com/"
2022-03-19T12:19:56.269 INFO:teuthology.orchestra.run.smithi036.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-03-19T12:19:56.269 INFO:teuthology.orchestra.run.smithi036.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-19T12:19:56.269 INFO:teuthology.orchestra.run.smithi036.stdout:
2022-03-19T12:19:56.269 INFO:teuthology.orchestra.run.smithi036.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-19T12:19:56.269 INFO:teuthology.orchestra.run.smithi036.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-03-19T12:19:56.270 INFO:teuthology.orchestra.run.smithi036.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-03-19T12:19:56.270 INFO:teuthology.orchestra.run.smithi036.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-03-19T12:19:56.270 INFO:teuthology.lock.ops:Updating smithi036.front.sepia.ceph.com on lock server
2022-03-19T12:19:56.367 INFO:teuthology.dispatcher.supervisor:Running job 6744938
2022-03-19T12:19:56.367 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_aa078dbed6d14c1ad98beb5a02b956bbe0a741c8/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2022-03-18_07:57:03-fs-wip-vshankar-testing1-20220317-183011-testing-default-smithi/6744938 --name vshankar-2022-03-18_07:57:03-fs-wip-vshankar-testing1-20220317-183011-testing-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/suites/pjd}} -- /home/teuthworker/archive/vshankar-2022-03-18_07:57:03-fs-wip-vshankar-testing1-20220317-183011-testing-default-smithi/6744938/orig.config.yaml
2022-03-19T12:19:56.371 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2022-03-18_07:57:03-fs-wip-vshankar-testing1-20220317-183011-testing-default-smithi/6744938
2022-03-19T12:19:56.371 INFO:teuthology.dispatcher.supervisor:Job PID: 19812
2022-03-19T12:19:56.372 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-03-19T18:50:24.563 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-03-19T18:50:24.755 INFO:teuthology.kill:Killing Pids: {19812}
2022-03-19T18:50:25.921 INFO:teuthology.task.internal:roles: ubuntu@smithi025.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-03-19T18:50:25.922 INFO:teuthology.task.internal:roles: ubuntu@smithi036.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-03-19T18:50:25.923 INFO:teuthology.misc:Compressing logs...
2022-03-19T18:50:25.923 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi025.front.sepia.ceph.com'
2022-03-19T18:50:26.107 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi036.front.sepia.ceph.com'
2022-03-19T18:50:26.578 INFO:teuthology.misc:Compressing logs...
2022-03-19T18:50:26.724 INFO:teuthology.misc:Compressing logs...
2022-03-19T19:01:20.290 INFO:teuthology.kill:No teuthology processes running
2022-03-19T19:01:21.501 INFO:teuthology.kill:Nuking machines: ['smithi025', 'smithi036']
2022-03-19T19:01:22.412 INFO:teuthology.kill:2022-03-19 19:01:22,412.412 INFO:teuthology.nuke:targets:
2022-03-19T19:01:22.413 INFO:teuthology.kill:  smithi025.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDdsZ9O9D9fRCjKlYwupEbmpbHf+801eOCOrQPzHV4GFi7VTOpuTKZrEL43rLJ0w0CddETJdTDb/NOjlJhA09vLNQ/TK5YbvLaMD5lRYUaiWQLy/B3gZbG0b2M0zdzFTlv4YAca2OdiQ241h2YFPZk639LimA4/ZdczqNaulq3V+DHKaUT1otQvsb/7XuXr7fw/DvzHp6Y1Yxq89T9w+FuH4pJA/0dBZwZo7u6FcPXN/qp51GGP+Uq1psIqqI9lTSSbR4y32jv9kHRob+Cv3mqZJnDUR41UU9cb9nxs/BRBqytMXDrElOoxme8H2MsDBMuXFJi2yS5G1HQtd/owVNujvuF2RrhqcqRZ3NYbn+DIck+aaeKa4/2Am7O62nKp7wreottShZ5u/rAbzEZdCgj9VdaCMH22shshD/JoDQbjWKTjwk9IXXLSAP1Fq8qkiQPx6suXxlts3UzO7veTlj+JjquInDqQXLbU9m7Xqlz5aD7LAlqHLMF2kOLuNaW+NpE=
2022-03-19T19:01:22.413 INFO:teuthology.kill:  smithi036.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDWPwQ3jepksPFc4MmtmmO6kTjupql2yoiXo6KwJmo7ATu0zQT/GuwB5QnbQViHytPPxNXEYGs0zXfttY7eo4FvTgTdTPbwE/pFJ9e/aBY8cWaAvczvmPhVx4l0uP8mUgWbu+/lq6r4IVZU16raewAkZqe5UIRsWj3p9Gioaftx/79Wr260ZU0kIhF4Vjkv6CoW54FUTxxbftoGN0CCGsskXjivkaCXFrBqfaIQZF0ovtdwhapCbtJOe/JhWbkEd70z4D5g0XGRW2VTKhcRhboispUXJghXmLqDcSpNdr0YHoxqTX9QMS7HKZyCakJHNYZIOKXokgxBXlXbka11zfeTc16D/ZW39zIruvMabZ98N+3G4Uu0V6pn5a3+fUBvXCUDpHfaECdU1G43SlN/sMkFiGI07isoUGu9+/KRQrmOqhKUTk3+8C4ExTs7MQtQamUrBoFvZtZf7rIc/K25y8/L8+matZ4RuE3oqG3xjXj7IqoYVFqE3fJDRSoA/psbWpU=
2022-03-19T19:01:22.439 INFO:teuthology.kill:2022-03-19 19:01:22,438.438 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-19T19:01:22.440 INFO:teuthology.kill:2022-03-19 19:01:22,440.440 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-19T19:01:22.518 INFO:teuthology.kill:2022-03-19 19:01:22,517.517 INFO:teuthology.orchestra.console:Power off smithi036
2022-03-19T19:01:22.530 INFO:teuthology.kill:2022-03-19 19:01:22,530.530 INFO:teuthology.orchestra.console:Power off smithi025
2022-03-19T19:01:30.892 INFO:teuthology.kill:2022-03-19 19:01:30,892.892 INFO:teuthology.orchestra.console:Power off for smithi036 completed
2022-03-19T19:01:30.899 INFO:teuthology.kill:2022-03-19 19:01:30,898.898 INFO:teuthology.orchestra.console:Power off for smithi025 completed
2022-03-19T19:01:31.051 INFO:teuthology.kill:2022-03-19 19:01:31,051.051 INFO:teuthology.lock.ops:unlocked: smithi036.front.sepia.ceph.com
2022-03-19T19:01:31.056 INFO:teuthology.kill:2022-03-19 19:01:31,056.056 INFO:teuthology.lock.ops:unlocked: smithi025.front.sepia.ceph.com
2022-03-19T19:03:31.359 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-03-19T19:03:31.473 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi025 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-03-19_14:37:23-rados-wip-yuri6-testing-2022-03-18-1104-distro-default-smithi/6747122
2022-03-19T19:03:31.473 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi036 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-03-19_14:37:23-rados-wip-yuri6-testing-2022-03-18-1104-distro-default-smithi/6747122