2022-03-23T10:58:34.882 INFO:root:teuthology version: 1.1.0-a4e18662
2022-03-23T10:58:34.999 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi002.front.sepia.ceph.com' reimaging
2022-03-23T10:58:35.000 INFO:teuthology.lock.ops:Updating [ubuntu@smithi002.front.sepia.ceph.com]: reset os type and version on server
2022-03-23T10:58:35.001 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server
2022-03-23T10:58:35.018 INFO:teuthology.lock.ops:Node 'ubuntu@smithi002.front.sepia.ceph.com' reimaging is complete
2022-03-23T10:58:35.018 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi100.front.sepia.ceph.com' reimaging
2022-03-23T10:58:35.018 INFO:teuthology.lock.ops:Updating [ubuntu@smithi100.front.sepia.ceph.com]: reset os type and version on server
2022-03-23T10:58:35.019 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server
2022-03-23T10:58:35.036 INFO:teuthology.lock.ops:Node 'ubuntu@smithi100.front.sepia.ceph.com' reimaging is complete
2022-03-23T10:58:35.223 INFO:teuthology.provision.fog.smithi002:Scheduling deploy of rhel 8.4
2022-03-23T10:58:35.228 INFO:teuthology.provision.fog.smithi100:Scheduling deploy of rhel 8.4
2022-03-23T10:58:35.513 INFO:teuthology.orchestra.console:Power off smithi002
2022-03-23T10:58:35.527 INFO:teuthology.orchestra.console:Power off smithi100
2022-03-23T10:58:43.886 INFO:teuthology.orchestra.console:Power off for smithi002 completed
2022-03-23T10:58:43.987 INFO:teuthology.orchestra.console:Power on smithi002
2022-03-23T10:58:48.004 INFO:teuthology.orchestra.console:Power off for smithi100 completed
2022-03-23T10:58:48.106 INFO:teuthology.orchestra.console:Power on smithi100
2022-03-23T10:58:52.402 INFO:teuthology.orchestra.console:Power on for smithi002 completed
2022-03-23T10:58:52.503 INFO:teuthology.provision.fog.smithi002:Waiting for deploy to finish
2022-03-23T10:58:56.468 INFO:teuthology.orchestra.console:Power on for smithi100 completed
2022-03-23T10:58:56.569 INFO:teuthology.provision.fog.smithi100:Waiting for deploy to finish
2022-03-23T11:02:59.983 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-23T11:03:00.225 INFO:teuthology.provision.fog.smithi002:Node is ready
2022-03-23T11:03:00.240 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002.front.sepia.ceph.com
2022-03-23T11:03:00.297 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2 smithi002.front.sepia.ceph.com smithi002
2022-03-23T11:03:00.628 INFO:teuthology.provision.fog.smithi002:Deploy complete!
2022-03-23T11:03:02.753 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-23T11:03:23.429 INFO:teuthology.provision.fog.smithi100:Node is ready
2022-03-23T11:03:23.448 INFO:teuthology.orchestra.run.smithi100.stdout:smithi100.front.sepia.ceph.com
2022-03-23T11:03:23.504 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100 smithi100.front.sepia.ceph.com smithi100
2022-03-23T11:03:23.852 INFO:teuthology.provision.fog.smithi100:Deploy complete!
2022-03-23T11:03:23.997 INFO:teuthology.lock.ops:Checking smithi002.front.sepia.ceph.com
2022-03-23T11:03:23.997 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-23T11:03:24.023 INFO:teuthology.lock.ops:Checking smithi100.front.sepia.ceph.com
2022-03-23T11:03:24.023 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-23T11:03:24.039 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: set os type and version on server
2022-03-23T11:03:24.040 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com'
2022-03-23T11:03:24.276 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64
2022-03-23T11:03:24.331 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="Red Hat Enterprise Linux"
2022-03-23T11:03:24.332 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="8.4 (Ootpa)"
2022-03-23T11:03:24.332 INFO:teuthology.orchestra.run.smithi002.stdout:ID="rhel"
2022-03-23T11:03:24.332 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="fedora"
2022-03-23T11:03:24.332 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="8.4"
2022-03-23T11:03:24.333 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el8"
2022-03-23T11:03:24.333 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-03-23T11:03:24.333 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31"
2022-03-23T11:03:24.333 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-03-23T11:03:24.333 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://www.redhat.com/"
2022-03-23T11:03:24.334 INFO:teuthology.orchestra.run.smithi002.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-03-23T11:03:24.334 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-23T11:03:24.334 INFO:teuthology.orchestra.run.smithi002.stdout:
2022-03-23T11:03:24.334 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-23T11:03:24.335 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-03-23T11:03:24.335 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-03-23T11:03:24.335 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-03-23T11:03:24.336 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server
2022-03-23T11:03:24.352 INFO:teuthology.lock.ops:Updating [smithi100.front.sepia.ceph.com]: set os type and version on server
2022-03-23T11:03:24.352 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com'
2022-03-23T11:03:24.573 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64
2022-03-23T11:03:24.627 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="Red Hat Enterprise Linux"
2022-03-23T11:03:24.627 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="8.4 (Ootpa)"
2022-03-23T11:03:24.628 INFO:teuthology.orchestra.run.smithi100.stdout:ID="rhel"
2022-03-23T11:03:24.628 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="fedora"
2022-03-23T11:03:24.628 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="8.4"
2022-03-23T11:03:24.628 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el8"
2022-03-23T11:03:24.628 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-03-23T11:03:24.629 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31"
2022-03-23T11:03:24.629 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-03-23T11:03:24.629 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://www.redhat.com/"
2022-03-23T11:03:24.629 INFO:teuthology.orchestra.run.smithi100.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-03-23T11:03:24.629 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-23T11:03:24.630 INFO:teuthology.orchestra.run.smithi100.stdout:
2022-03-23T11:03:24.630 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-23T11:03:24.630 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-03-23T11:03:24.630 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-03-23T11:03:24.631 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-03-23T11:03:24.631 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server
2022-03-23T11:03:24.723 INFO:teuthology.dispatcher.supervisor:Running job 6754966
2022-03-23T11:03:24.724 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_a4e18662e5de936eb0ac089e531b933ecbcadb0a/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2022-03-23_03:55:41-fs-wip-vshankar-fscrypt-20220322-143626-testing-default-smithi/6754966 --name vshankar-2022-03-23_03:55:41-fs-wip-vshankar-fscrypt-20220322-143626-testing-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/fs/snaps}} -- /home/teuthworker/archive/vshankar-2022-03-23_03:55:41-fs-wip-vshankar-fscrypt-20220322-143626-testing-default-smithi/6754966/orig.config.yaml
2022-03-23T11:03:24.728 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2022-03-23_03:55:41-fs-wip-vshankar-fscrypt-20220322-143626-testing-default-smithi/6754966
2022-03-23T11:03:24.728 INFO:teuthology.dispatcher.supervisor:Job PID: 1100
2022-03-23T11:03:24.728 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-03-23T17:33:52.031 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-03-23T17:33:52.290 INFO:teuthology.kill:Killing Pids: {1100}
2022-03-23T17:33:53.476 INFO:teuthology.task.internal:roles: ubuntu@smithi002.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-03-23T17:33:53.476 INFO:teuthology.task.internal:roles: ubuntu@smithi100.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-03-23T17:33:53.477 INFO:teuthology.misc:Compressing logs...
2022-03-23T17:33:53.477 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com'
2022-03-23T17:33:53.667 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com'
2022-03-23T17:33:54.010 INFO:teuthology.misc:Compressing logs...
2022-03-23T17:33:54.159 INFO:teuthology.misc:Compressing logs...
2022-03-23T17:35:52.506 INFO:teuthology.kill:No teuthology processes running
2022-03-23T17:35:53.617 INFO:teuthology.kill:Nuking machines: ['smithi002', 'smithi100']
2022-03-23T17:35:54.540 INFO:teuthology.kill:2022-03-23 17:35:54,540.540 INFO:teuthology.nuke:targets:
2022-03-23T17:35:54.541 INFO:teuthology.kill:  smithi002.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2+2qI573/AduBjhg7jucF/pevYMnqyExEJKl79MplfbXMN9XLb3KZSfyG4YAc6veATbl9eLoI5L9tO0otGFrWGFONPI2X4TvY9HqHLwYkFXGQh308YRbA6SI3+lMnZVos8k+YmP5iSULhnX3ukM7xLT+Hz3EGKhUZ5aXCk90zNhDRp/Z0YoNLEtqYWAr9Evwd8qTJejV2+6+UQ9Y1LMQESy5N4RrlNOEDObtL7M9cmwyS0QyPtnsmfEJwD46gIdk88jUrlxJswmewtLUaYj0Qinm1B99gv3NFk6UIJ207G6W5QkquEyD2qGjs4rS52nVcCaZJI/d9Zntwb3nAxvLe+wkCDlJPTeseZi+VxrxmPG7mq/25Ge1nkZBWhRhoFH1+r3+iY32ZO4uw/GVz63b0jkmYGqjZNmf5wtVVvYd1ZGDRS7qneAOM6EQHSAafjB77V7UoC7KrzZJoKiLoabENn4VTmtrxyE58JKB8tFP3w3CCrWyWCBOGas7S5KlLG90=
2022-03-23T17:35:54.541 INFO:teuthology.kill:  smithi100.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQClpdoRH/Vi73WB0tIfUHXPe+crRT1JCB6OtSBCYM11lXApy7IoZvDsQeMxekCWguuSXrs10tnbzVs1U1CdBffeja3DNzYGv7luZ3afGIoNm0fzRey2eNZJ5AE6Y+EU/JZButXR4TPzTv5dAN6o+o71AeSav76JQrGVanI/uvw2JE2Ohj7TXXnOt5ypftt3zMa7EI+gLtjr9brU4ajGtonHGG/8dzua9GD0ScQGlzjP0gx4hibd6jS3EyCWvvf/urXsz66ZZymr4HE8gJzL4hwgAUeNRgcksaQawjFy4y3dcQ/wqOwX0e7g8rgIHYd/Eo8ynP7052+FmsEERLD4D7srsgSpQvnNXNjfMkGbxdRNB3cev2RJ532izN1hLkZMAQt3+G+hYs9Xg5us5c10PPnnRhIJyTu3U1qn9Rbn2FV5dIjkkZvlOqAmYvZyfKTii+DXrJqZSLTeqbzYPc1Gr310UxL7cmD4Sodg/uGtfiuN7FBi1XRafCq0H37k6E4RwQc=
2022-03-23T17:35:54.565 INFO:teuthology.kill:2022-03-23 17:35:54,565.565 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-23T17:35:54.568 INFO:teuthology.kill:2022-03-23 17:35:54,568.568 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-23T17:35:54.642 INFO:teuthology.kill:2022-03-23 17:35:54,642.642 INFO:teuthology.orchestra.console:Power off smithi100
2022-03-23T17:35:54.657 INFO:teuthology.kill:2022-03-23 17:35:54,657.657 INFO:teuthology.orchestra.console:Power off smithi002
2022-03-23T17:36:07.127 INFO:teuthology.kill:2022-03-23 17:36:07,127.127 INFO:teuthology.orchestra.console:Power off for smithi100 completed
2022-03-23T17:36:07.131 INFO:teuthology.kill:2022-03-23 17:36:07,131.131 INFO:teuthology.orchestra.console:Power off for smithi002 completed
2022-03-23T17:36:07.279 INFO:teuthology.kill:2022-03-23 17:36:07,278.278 INFO:teuthology.lock.ops:unlocked: smithi002.front.sepia.ceph.com
2022-03-23T17:36:07.283 INFO:teuthology.kill:2022-03-23 17:36:07,282.282 INFO:teuthology.lock.ops:unlocked: smithi100.front.sepia.ceph.com
2022-03-23T17:38:07.603 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-03-23T17:38:07.711 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi002 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-03-23_14:53:43-fs-wip-yuri4-testing-2022-03-21-1648-pacific-distro-default-smithi/6756032
2022-03-23T17:38:07.711 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi100 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-03-23_14:53:43-fs-wip-yuri4-testing-2022-03-21-1648-pacific-distro-default-smithi/6756032