2022-03-25T14:12:11.368 INFO:root:teuthology version: 1.1.0-a4e18662
2022-03-25T14:12:11.484 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi142.front.sepia.ceph.com' reimaging
2022-03-25T14:12:11.485 INFO:teuthology.lock.ops:Updating [ubuntu@smithi142.front.sepia.ceph.com]: reset os type and version on server
2022-03-25T14:12:11.485 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server
2022-03-25T14:12:11.503 INFO:teuthology.lock.ops:Node 'ubuntu@smithi142.front.sepia.ceph.com' reimaging is complete
2022-03-25T14:12:11.503 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi183.front.sepia.ceph.com' reimaging
2022-03-25T14:12:11.504 INFO:teuthology.lock.ops:Updating [ubuntu@smithi183.front.sepia.ceph.com]: reset os type and version on server
2022-03-25T14:12:11.504 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server
2022-03-25T14:12:11.522 INFO:teuthology.lock.ops:Node 'ubuntu@smithi183.front.sepia.ceph.com' reimaging is complete
2022-03-25T14:12:11.710 INFO:teuthology.provision.fog.smithi142:Scheduling deploy of rhel 8.4
2022-03-25T14:12:11.723 INFO:teuthology.provision.fog.smithi183:Scheduling deploy of rhel 8.4
2022-03-25T14:12:12.019 INFO:teuthology.orchestra.console:Power off smithi142
2022-03-25T14:12:12.037 INFO:teuthology.orchestra.console:Power off smithi183
2022-03-25T14:12:20.393 INFO:teuthology.orchestra.console:Power off for smithi142 completed
2022-03-25T14:12:20.494 INFO:teuthology.orchestra.console:Power on smithi142
2022-03-25T14:12:24.510 INFO:teuthology.orchestra.console:Power off for smithi183 completed
2022-03-25T14:12:24.612 INFO:teuthology.orchestra.console:Power on smithi183
2022-03-25T14:12:24.742 INFO:teuthology.orchestra.console:Power on for smithi142 completed
2022-03-25T14:12:24.843 INFO:teuthology.provision.fog.smithi142:Waiting for deploy to finish
2022-03-25T14:12:32.984 INFO:teuthology.orchestra.console:Power on for smithi183 completed
2022-03-25T14:12:33.085 INFO:teuthology.provision.fog.smithi183:Waiting for deploy to finish
2022-03-25T14:14:55.969 ERROR:teuthology.orchestra.connection:Error authenticating with smithi142.front.sepia.ceph.com: Authentication failed.
2022-03-25T14:16:31.416 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-25T14:16:51.423 INFO:teuthology.provision.fog.smithi142:Node is ready
2022-03-25T14:16:51.450 INFO:teuthology.orchestra.run.smithi142.stdout:smithi142.front.sepia.ceph.com
2022-03-25T14:16:51.515 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142 smithi142.front.sepia.ceph.com smithi142
2022-03-25T14:16:51.877 INFO:teuthology.provision.fog.smithi142:Deploy complete!
2022-03-25T14:17:11.107 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-25T14:17:11.350 INFO:teuthology.provision.fog.smithi183:Node is ready
2022-03-25T14:17:11.366 INFO:teuthology.orchestra.run.smithi183.stdout:smithi183.front.sepia.ceph.com
2022-03-25T14:17:11.422 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.15.183 smithi183.front.sepia.ceph.com smithi183
2022-03-25T14:17:11.760 INFO:teuthology.provision.fog.smithi183:Deploy complete!
2022-03-25T14:17:11.919 INFO:teuthology.lock.ops:Checking smithi142.front.sepia.ceph.com
2022-03-25T14:17:11.920 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-25T14:17:11.943 INFO:teuthology.lock.ops:Checking smithi183.front.sepia.ceph.com
2022-03-25T14:17:11.944 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-25T14:17:11.961 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: set os type and version on server
2022-03-25T14:17:11.962 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com'
2022-03-25T14:17:12.196 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64
2022-03-25T14:17:12.251 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="Red Hat Enterprise Linux"
2022-03-25T14:17:12.251 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="8.4 (Ootpa)"
2022-03-25T14:17:12.252 INFO:teuthology.orchestra.run.smithi142.stdout:ID="rhel"
2022-03-25T14:17:12.252 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="fedora"
2022-03-25T14:17:12.252 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="8.4"
2022-03-25T14:17:12.252 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el8"
2022-03-25T14:17:12.253 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-03-25T14:17:12.253 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31"
2022-03-25T14:17:12.253 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-03-25T14:17:12.253 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://www.redhat.com/"
2022-03-25T14:17:12.254 INFO:teuthology.orchestra.run.smithi142.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-03-25T14:17:12.254 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-25T14:17:12.254 INFO:teuthology.orchestra.run.smithi142.stdout:
2022-03-25T14:17:12.254 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-25T14:17:12.255 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-03-25T14:17:12.255 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-03-25T14:17:12.255 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-03-25T14:17:12.256 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server
2022-03-25T14:17:12.275 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: set os type and version on server
2022-03-25T14:17:12.275 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com'
2022-03-25T14:17:12.498 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64
2022-03-25T14:17:12.552 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="Red Hat Enterprise Linux"
2022-03-25T14:17:12.553 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="8.4 (Ootpa)"
2022-03-25T14:17:12.553 INFO:teuthology.orchestra.run.smithi183.stdout:ID="rhel"
2022-03-25T14:17:12.553 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="fedora"
2022-03-25T14:17:12.553 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="8.4"
2022-03-25T14:17:12.554 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el8"
2022-03-25T14:17:12.554 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-03-25T14:17:12.554 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31"
2022-03-25T14:17:12.554 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-03-25T14:17:12.555 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://www.redhat.com/"
2022-03-25T14:17:12.555 INFO:teuthology.orchestra.run.smithi183.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-03-25T14:17:12.555 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-25T14:17:12.555 INFO:teuthology.orchestra.run.smithi183.stdout:
2022-03-25T14:17:12.555 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-25T14:17:12.556 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-03-25T14:17:12.556 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-03-25T14:17:12.556 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-03-25T14:17:12.557 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server
2022-03-25T14:17:12.654 INFO:teuthology.dispatcher.supervisor:Running job 6757367
2022-03-25T14:17:12.655 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_a4e18662e5de936eb0ac089e531b933ecbcadb0a/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2022-03-24_09:22:49-fs-wip-vshankar-fscrypt-20220324-121321-testing-default-smithi/6757367 --name vshankar-2022-03-24_09:22:49-fs-wip-vshankar-fscrypt-20220324-121321-testing-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}} -- /home/teuthworker/archive/vshankar-2022-03-24_09:22:49-fs-wip-vshankar-fscrypt-20220324-121321-testing-default-smithi/6757367/orig.config.yaml
2022-03-25T14:17:12.658 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2022-03-24_09:22:49-fs-wip-vshankar-fscrypt-20220324-121321-testing-default-smithi/6757367
2022-03-25T14:17:12.658 INFO:teuthology.dispatcher.supervisor:Job PID: 28710
2022-03-25T14:17:12.659 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-03-25T20:47:23.849 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-03-25T20:47:24.030 INFO:teuthology.kill:Killing Pids: {28710}
2022-03-25T20:47:25.289 INFO:teuthology.task.internal:roles: ubuntu@smithi142.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-03-25T20:47:25.290 INFO:teuthology.task.internal:roles: ubuntu@smithi183.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-03-25T20:47:25.291 INFO:teuthology.misc:Compressing logs...
2022-03-25T20:47:25.291 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com'
2022-03-25T20:47:25.472 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com'
2022-03-25T20:47:25.808 INFO:teuthology.misc:Compressing logs...
2022-03-25T20:47:25.962 INFO:teuthology.misc:Compressing logs...
2022-03-25T20:49:28.063 INFO:teuthology.kill:No teuthology processes running
2022-03-25T20:49:29.246 INFO:teuthology.kill:Nuking machines: ['smithi142', 'smithi183']
2022-03-25T20:49:30.294 INFO:teuthology.kill:2022-03-25 20:49:30,294.294 INFO:teuthology.nuke:targets:
2022-03-25T20:49:30.295 INFO:teuthology.kill:  smithi142.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDfnheHL84k5jIPHDwk1hH1hFHgniyaopUKjSJhDqfnt+J0EvX3NkYwxc6PPhaIA3CWc2iTNOhpFoQLnHCXchnSzjPGfVPQDENEqe5xGrd2X97t6p7Yvf73a39EttqfW2ZYSnzU+qpCd1NS5CvyOANQxPI51BA+s+CnF+FMQ+fP9JMfc5pQ5qu64HYLyqEnoOipBVeZpMEkhb/Y8Qx4e6jPuSMfM64RYjo13P90qCMZBF8JNCCFi51d3HvVgulBE38EBOBmh8UDH8M155YBeqtTkT9ZNc4jtGaC1XsG1pMgZ1pOtSEu9jUg+rkTRd5FOYLYRwgw4tusQ/Zd1HWaCKK+3bgWjtWgVtDA5jNJQ/RdQ0SgsUUwHss8JtcGBNx666iAKzR2c9y8BZtFFoeIeGWn9BXZoF6npaeAUMvL8PT2LMXnTqWMmzvE8fbmD6XgnX6FIrgI+cU3yQeajg2HQggco6mBzyac3fsu7gGO2KwFAaNovZmG/Gyf6NNH/D4tbrU=
2022-03-25T20:49:30.296 INFO:teuthology.kill:  smithi183.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDh+VubBL0GeZTaBa1zY3PpRbppqlUOON+i3cMqv96Y6TKFePw8CveL4cScEavuRHKLjYF2QrwFxdHwrOR56HQGil9mLjmv+3lPdnI3epaKVsc8Vyffg0dbDM4lR7bsNDaGsD7BHOHLDCVcCJYePVUQG5zZsMXp2PCOm9r/GTiOTdcgzLtUr8yWvI6AvCDyZZxxPuwQ3C63USINFhnFHtpShzKx+beRneL7zJEi28vgur7CSkVwa4oxjfFuyJXgErt+VQEEmUGVRXmGesP/SKABnpxc/WTuMWxuQg96CmPAAT1dosFFfmUSOwKCNgxQT7dWSBWCCzFiZ6yy36hCkTGwJgxGIOgzOcXWRGV3OZi+GOQJ8tdQQlnXKaumxBJezu9MiHOQPFBu4u+UqxoTWuVAmWdtcgreIqHBlv37IzVZKyUVbVFeFPaJ/J3MxEUNDDZCvyms0wLyz8jvWh2uTH47CKtOOtS9zmev210MQq58bhhtoMb1idU7E0CW1s9EchM=
2022-03-25T20:49:30.326 INFO:teuthology.kill:2022-03-25 20:49:30,326.326 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-25T20:49:30.329 INFO:teuthology.kill:2022-03-25 20:49:30,329.329 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-25T20:49:30.407 INFO:teuthology.kill:2022-03-25 20:49:30,407.407 INFO:teuthology.orchestra.console:Power off smithi142
2022-03-25T20:49:30.424 INFO:teuthology.kill:2022-03-25 20:49:30,423.423 INFO:teuthology.orchestra.console:Power off smithi183
2022-03-25T20:49:38.781 INFO:teuthology.kill:2022-03-25 20:49:38,781.781 INFO:teuthology.orchestra.console:Power off for smithi142 completed
2022-03-25T20:49:38.788 INFO:teuthology.kill:2022-03-25 20:49:38,787.787 INFO:teuthology.orchestra.console:Power off for smithi183 completed
2022-03-25T20:49:38.927 INFO:teuthology.kill:2022-03-25 20:49:38,926.926 INFO:teuthology.lock.ops:unlocked: smithi142.front.sepia.ceph.com
2022-03-25T20:49:38.931 INFO:teuthology.kill:2022-03-25 20:49:38,931.931 INFO:teuthology.lock.ops:unlocked: smithi183.front.sepia.ceph.com
2022-03-25T20:51:39.162 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-03-25T20:51:39.289 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi142 but it was locked by another job: /home/teuthworker/archive/nojha-2022-03-25_19:43:39-rados-wip-quincy-fast-shutdown-backports-distro-basic-smithi/6761958
2022-03-25T20:51:39.289 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi183 but it was locked by another job: /home/teuthworker/archive/nojha-2022-03-25_19:43:39-rados-wip-quincy-fast-shutdown-backports-distro-basic-smithi/6761957