2022-02-17T14:13:00.525 INFO:root:teuthology version: 1.1.0-c6442aa9
2022-02-17T14:13:00.655 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi006.front.sepia.ceph.com' reimaging
2022-02-17T14:13:00.657 INFO:teuthology.lock.ops:Updating [ubuntu@smithi006.front.sepia.ceph.com]: reset os type and version on server
2022-02-17T14:13:00.657 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server
2022-02-17T14:13:00.676 INFO:teuthology.lock.ops:Node 'ubuntu@smithi006.front.sepia.ceph.com' reimaging is complete
2022-02-17T14:13:00.676 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi025.front.sepia.ceph.com' reimaging
2022-02-17T14:13:00.677 INFO:teuthology.lock.ops:Updating [ubuntu@smithi025.front.sepia.ceph.com]: reset os type and version on server
2022-02-17T14:13:00.677 INFO:teuthology.lock.ops:Updating smithi025.front.sepia.ceph.com on lock server
2022-02-17T14:13:00.695 INFO:teuthology.lock.ops:Node 'ubuntu@smithi025.front.sepia.ceph.com' reimaging is complete
2022-02-17T14:13:00.890 INFO:teuthology.provision.fog.smithi006:Scheduling deploy of rhel 8.4
2022-02-17T14:13:00.899 INFO:teuthology.provision.fog.smithi025:Scheduling deploy of rhel 8.4
2022-02-17T14:13:01.209 INFO:teuthology.orchestra.console:Power off smithi025
2022-02-17T14:13:01.225 INFO:teuthology.orchestra.console:Power off smithi006
2022-02-17T14:13:01.356 INFO:teuthology.orchestra.console:Power off for smithi025 completed
2022-02-17T14:13:01.365 INFO:teuthology.orchestra.console:Power off for smithi006 completed
2022-02-17T14:13:01.458 INFO:teuthology.orchestra.console:Power on smithi025
2022-02-17T14:13:01.467 INFO:teuthology.orchestra.console:Power on smithi006
2022-02-17T14:13:05.717 INFO:teuthology.orchestra.console:Power on for smithi025 completed
2022-02-17T14:13:05.819 INFO:teuthology.provision.fog.smithi025:Waiting for deploy to finish
2022-02-17T14:13:09.837 INFO:teuthology.orchestra.console:Power on for smithi006 completed
2022-02-17T14:13:09.939 INFO:teuthology.provision.fog.smithi006:Waiting for deploy to finish
2022-02-17T14:17:26.404 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-02-17T14:17:26.660 INFO:teuthology.provision.fog.smithi006:Node is ready
2022-02-17T14:17:26.676 INFO:teuthology.orchestra.run.smithi006.stdout:smithi006.front.sepia.ceph.com
2022-02-17T14:17:26.732 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6 smithi006.front.sepia.ceph.com smithi006
2022-02-17T14:17:27.064 INFO:teuthology.provision.fog.smithi006:Deploy complete!
2022-02-17T14:18:34.840 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-02-17T14:18:35.067 INFO:teuthology.provision.fog.smithi025:Node is ready
2022-02-17T14:18:35.084 INFO:teuthology.orchestra.run.smithi025.stdout:smithi025.front.sepia.ceph.com
2022-02-17T14:18:35.140 INFO:teuthology.orchestra.run.smithi025.stdout:172.21.15.25 smithi025.front.sepia.ceph.com smithi025
2022-02-17T14:18:35.472 INFO:teuthology.provision.fog.smithi025:Deploy complete!
2022-02-17T14:18:35.627 INFO:teuthology.lock.ops:Checking smithi006.front.sepia.ceph.com
2022-02-17T14:18:35.628 INFO:teuthology.lock.ops:New key found. Updating...
2022-02-17T14:18:35.648 INFO:teuthology.lock.ops:Checking smithi025.front.sepia.ceph.com
2022-02-17T14:18:35.649 INFO:teuthology.lock.ops:New key found. Updating...
2022-02-17T14:18:35.667 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: set os type and version on server
2022-02-17T14:18:35.668 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com'
2022-02-17T14:18:35.906 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64
2022-02-17T14:18:35.962 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="Red Hat Enterprise Linux"
2022-02-17T14:18:35.962 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="8.4 (Ootpa)"
2022-02-17T14:18:35.963 INFO:teuthology.orchestra.run.smithi006.stdout:ID="rhel"
2022-02-17T14:18:35.963 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="fedora"
2022-02-17T14:18:35.963 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="8.4"
2022-02-17T14:18:35.963 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el8"
2022-02-17T14:18:35.964 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-02-17T14:18:35.964 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31"
2022-02-17T14:18:35.964 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-02-17T14:18:35.964 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://www.redhat.com/"
2022-02-17T14:18:35.965 INFO:teuthology.orchestra.run.smithi006.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-02-17T14:18:35.965 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-02-17T14:18:35.965 INFO:teuthology.orchestra.run.smithi006.stdout:
2022-02-17T14:18:35.965 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-02-17T14:18:35.966 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-02-17T14:18:35.966 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-02-17T14:18:35.966 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-02-17T14:18:35.967 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server
2022-02-17T14:18:35.986 INFO:teuthology.lock.ops:Updating [smithi025.front.sepia.ceph.com]: set os type and version on server
2022-02-17T14:18:35.986 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi025.front.sepia.ceph.com'
2022-02-17T14:18:36.206 INFO:teuthology.orchestra.run.smithi025.stdout:x86_64
2022-02-17T14:18:36.260 INFO:teuthology.orchestra.run.smithi025.stdout:NAME="Red Hat Enterprise Linux"
2022-02-17T14:18:36.260 INFO:teuthology.orchestra.run.smithi025.stdout:VERSION="8.4 (Ootpa)"
2022-02-17T14:18:36.261 INFO:teuthology.orchestra.run.smithi025.stdout:ID="rhel"
2022-02-17T14:18:36.261 INFO:teuthology.orchestra.run.smithi025.stdout:ID_LIKE="fedora"
2022-02-17T14:18:36.261 INFO:teuthology.orchestra.run.smithi025.stdout:VERSION_ID="8.4"
2022-02-17T14:18:36.261 INFO:teuthology.orchestra.run.smithi025.stdout:PLATFORM_ID="platform:el8"
2022-02-17T14:18:36.262 INFO:teuthology.orchestra.run.smithi025.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-02-17T14:18:36.262 INFO:teuthology.orchestra.run.smithi025.stdout:ANSI_COLOR="0;31"
2022-02-17T14:18:36.262 INFO:teuthology.orchestra.run.smithi025.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-02-17T14:18:36.262 INFO:teuthology.orchestra.run.smithi025.stdout:HOME_URL="https://www.redhat.com/"
2022-02-17T14:18:36.263 INFO:teuthology.orchestra.run.smithi025.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-02-17T14:18:36.263 INFO:teuthology.orchestra.run.smithi025.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-02-17T14:18:36.263 INFO:teuthology.orchestra.run.smithi025.stdout:
2022-02-17T14:18:36.263 INFO:teuthology.orchestra.run.smithi025.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-02-17T14:18:36.263 INFO:teuthology.orchestra.run.smithi025.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-02-17T14:18:36.264 INFO:teuthology.orchestra.run.smithi025.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-02-17T14:18:36.264 INFO:teuthology.orchestra.run.smithi025.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-02-17T14:18:36.264 INFO:teuthology.lock.ops:Updating smithi025.front.sepia.ceph.com on lock server
2022-02-17T14:18:36.360 INFO:teuthology.dispatcher.supervisor:Running job 6690271
2022-02-17T14:18:36.361 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_c6442aa9e509aace1201390ea4c2d6a80e3d0800/virtualenv/bin/teuthology -v --owner scheduled_nojha@teuthology --archive /home/teuthworker/archive/nojha-2022-02-16_23:40:43-rados:thrash-GBH_scrub_allocation_file_on_mount-distro-basic-smithi/6690271 --name nojha-2022-02-16_23:40:43-rados:thrash-GBH_scrub_allocation_file_on_mount-distro-basic-smithi --description rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-agent-big} -- /home/teuthworker/archive/nojha-2022-02-16_23:40:43-rados:thrash-GBH_scrub_allocation_file_on_mount-distro-basic-smithi/6690271/orig.config.yaml
2022-02-17T14:18:36.364 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/nojha-2022-02-16_23:40:43-rados:thrash-GBH_scrub_allocation_file_on_mount-distro-basic-smithi/6690271
2022-02-17T14:18:36.365 INFO:teuthology.dispatcher.supervisor:Job PID: 28086
2022-02-17T14:18:36.366 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-02-17T20:49:05.941 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-02-17T20:49:06.176 INFO:teuthology.kill:Killing Pids: {28086}
2022-02-17T20:49:07.274 INFO:teuthology.task.internal:roles: ubuntu@smithi006.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2022-02-17T20:49:07.275 INFO:teuthology.task.internal:roles: ubuntu@smithi025.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2022-02-17T20:49:07.275 INFO:teuthology.misc:Compressing logs...
2022-02-17T20:49:07.276 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com'
2022-02-17T20:49:07.466 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi025.front.sepia.ceph.com'
2022-02-17T20:49:07.825 INFO:teuthology.misc:Compressing logs...
2022-02-17T20:49:08.374 INFO:teuthology.orchestra.run.smithi006.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-02-17T20:49:08.527 INFO:teuthology.orchestra.run.smithi025.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-02-17T20:49:12.435 INFO:teuthology.misc:Compressing logs...
2022-02-17T20:49:50.462 INFO:teuthology.kill:No teuthology processes running
2022-02-17T20:49:51.594 INFO:teuthology.kill:Nuking machines: ['smithi006', 'smithi025']
2022-02-17T20:49:52.539 INFO:teuthology.kill:2022-02-17 20:49:52,538.538 INFO:teuthology.nuke:targets:
2022-02-17T20:49:52.541 INFO:teuthology.kill:  smithi006.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6H2Q1RD3p1bWBJZm3vctjYlnLeyl9H/6QEv9q7ghvnCHjvPTkwriEaXJlvwGSRdoUzQr/jT/xjb5AXyao7T3xWpeHjWNxPGeSb95OeEyqlfrkBz8e6pLBzEtxuDNDaogYoHS0DsC5JWqzudcU/c7jXe2jW0sGpJ+SCgR1Pj+chf/Psin4e6AhBaHT2eJw3db35q/M8OJiJKQPBstg9kRWfubgFkbXwJ9IzWrdjqRMoxuNEtTxXR6xS+Zz2CDYP1In/BX/cAE0CkeaXO6BhcABkCQ7JSQOvGRJSaUHzwWR09Jyql5jziTVbFTe+VFMNmdejdvpkxqC+4Jzqr2v5R/ARgdeCxVTKSUf70SXsu/6Z+DcvYja3eOiDMWq8xJM3mIDGe2Ga2TUQJgSI2ovumfvaDxjxpmJLWO0IMbAWy3uBGvc57HckZXrgzyJ4+h3n/TaWo3+PYBLerdGmBp7aG2NKCbcHK437y9Rw5UKBJ9QZg+G5srvp55TQ0TDIVr7e/E=
2022-02-17T20:49:52.542 INFO:teuthology.kill:  smithi025.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDRvEeFotLMfkZ1JDBxTY3V9+2LwP41BNzToF+fa4V7ECE72v306DjNLCZfhLHBrV/o4SuIsiL6PF/+Mn3ojZgLadMw+65Ir4HeWKFEappNwpbgte4zjdFJh6U3Ug6PKJco5uKOkyJGi7bqGx0q3xYz/7FOLmTH7ERzSqTRrvcaMeoay8Y3cV0QnZvZVy3DhrVHY/A8+6aGBkCpbAp/CSMT/qUdcH+PWmoR39IDT0aeV5C8kaY++L7FJWj8W0rZIQjLAFMasFnYMW11bFtRlwskxEvknhVwZGopces7h1wpQYSiw2wIcpdnQzGjrxeIGsyb9yLuit5uWPQJQM3gn17Uy9K0GipaNz4fiSdz5hLsUrE0llAvzaJvQUnHj49qFhl26wZ11JfyCnvYFKP2mFw1Pb3rk/QYYYuSaAQR5gLY5mZ3GaLXVyPtDMhLwVEc1We09fb+QyBAtfa8FJsmtaMj7bo110MeFpm1BRixYkSaRyt6NusDlbKzauLSgFNihdk=
2022-02-17T20:49:52.571 INFO:teuthology.kill:2022-02-17 20:49:52,571.571 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-02-17T20:49:52.574 INFO:teuthology.kill:2022-02-17 20:49:52,574.574 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-02-17T20:49:52.677 INFO:teuthology.kill:2022-02-17 20:49:52,677.677 INFO:teuthology.orchestra.console:Power off smithi025
2022-02-17T20:49:52.690 INFO:teuthology.kill:2022-02-17 20:49:52,689.689 INFO:teuthology.orchestra.console:Power off smithi006
2022-02-17T20:50:05.178 INFO:teuthology.kill:2022-02-17 20:50:05,177.177 INFO:teuthology.orchestra.console:Power off for smithi025 completed
2022-02-17T20:50:05.183 INFO:teuthology.kill:2022-02-17 20:50:05,183.183 INFO:teuthology.orchestra.console:Power off for smithi006 completed
2022-02-17T20:50:05.325 INFO:teuthology.kill:2022-02-17 20:50:05,325.325 INFO:teuthology.lock.ops:unlocked: smithi006.front.sepia.ceph.com
2022-02-17T20:50:05.334 INFO:teuthology.kill:2022-02-17 20:50:05,334.334 INFO:teuthology.lock.ops:unlocked: smithi025.front.sepia.ceph.com
2022-02-17T20:52:05.520 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15