2022-02-17T05:26:44.380 INFO:root:teuthology version: 1.1.0-c6442aa9
2022-02-17T05:26:44.505 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi073.front.sepia.ceph.com' reimaging
2022-02-17T05:26:44.507 INFO:teuthology.lock.ops:Updating [ubuntu@smithi073.front.sepia.ceph.com]: reset os type and version on server
2022-02-17T05:26:44.507 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server
2022-02-17T05:26:44.527 INFO:teuthology.lock.ops:Node 'ubuntu@smithi073.front.sepia.ceph.com' reimaging is complete
2022-02-17T05:26:44.527 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi122.front.sepia.ceph.com' reimaging
2022-02-17T05:26:44.528 INFO:teuthology.lock.ops:Updating [ubuntu@smithi122.front.sepia.ceph.com]: reset os type and version on server
2022-02-17T05:26:44.528 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server
2022-02-17T05:26:44.546 INFO:teuthology.lock.ops:Node 'ubuntu@smithi122.front.sepia.ceph.com' reimaging is complete
2022-02-17T05:26:44.733 INFO:teuthology.provision.fog.smithi073:Scheduling deploy of rhel 8.4
2022-02-17T05:26:44.801 INFO:teuthology.provision.fog.smithi122:Scheduling deploy of rhel 8.4
2022-02-17T05:26:45.040 INFO:teuthology.orchestra.console:Power off smithi073
2022-02-17T05:26:45.110 INFO:teuthology.orchestra.console:Power off smithi122
2022-02-17T05:26:45.190 INFO:teuthology.orchestra.console:Power off for smithi073 completed
2022-02-17T05:26:45.252 INFO:teuthology.orchestra.console:Power off for smithi122 completed
2022-02-17T05:26:45.292 INFO:teuthology.orchestra.console:Power on smithi073
2022-02-17T05:26:45.353 INFO:teuthology.orchestra.console:Power on smithi122
2022-02-17T05:26:49.553 INFO:teuthology.orchestra.console:Power on for smithi073 completed
2022-02-17T05:26:49.603 INFO:teuthology.orchestra.console:Power on for smithi122 completed
2022-02-17T05:26:49.655 INFO:teuthology.provision.fog.smithi073:Waiting for deploy to finish
2022-02-17T05:26:49.705 INFO:teuthology.provision.fog.smithi122:Waiting for deploy to finish
2022-02-17T05:31:21.600 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-02-17T05:31:21.826 INFO:teuthology.provision.fog.smithi073:Node is ready
2022-02-17T05:31:21.841 INFO:teuthology.orchestra.run.smithi073.stdout:smithi073.front.sepia.ceph.com
2022-02-17T05:31:21.897 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73 smithi073.front.sepia.ceph.com smithi073
2022-02-17T05:31:22.216 INFO:teuthology.provision.fog.smithi073:Deploy complete!
2022-02-17T05:31:36.584 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-02-17T05:31:36.808 INFO:teuthology.provision.fog.smithi122:Node is ready
2022-02-17T05:31:36.824 INFO:teuthology.orchestra.run.smithi122.stdout:smithi122.front.sepia.ceph.com
2022-02-17T05:31:36.881 INFO:teuthology.orchestra.run.smithi122.stdout:172.21.15.122 smithi122.front.sepia.ceph.com smithi122
2022-02-17T05:31:37.211 INFO:teuthology.provision.fog.smithi122:Deploy complete!
2022-02-17T05:31:37.367 INFO:teuthology.lock.ops:Checking smithi073.front.sepia.ceph.com
2022-02-17T05:31:37.368 INFO:teuthology.lock.ops:New key found. Updating...
2022-02-17T05:31:37.388 INFO:teuthology.lock.ops:Checking smithi122.front.sepia.ceph.com
2022-02-17T05:31:37.389 INFO:teuthology.lock.ops:New key found. Updating...
2022-02-17T05:31:37.409 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: set os type and version on server
2022-02-17T05:31:37.410 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com'
2022-02-17T05:31:37.641 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64
2022-02-17T05:31:37.696 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="Red Hat Enterprise Linux"
2022-02-17T05:31:37.697 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="8.4 (Ootpa)"
2022-02-17T05:31:37.697 INFO:teuthology.orchestra.run.smithi073.stdout:ID="rhel"
2022-02-17T05:31:37.697 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="fedora"
2022-02-17T05:31:37.697 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="8.4"
2022-02-17T05:31:37.698 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el8"
2022-02-17T05:31:37.698 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-02-17T05:31:37.698 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31"
2022-02-17T05:31:37.699 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-02-17T05:31:37.699 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://www.redhat.com/"
2022-02-17T05:31:37.699 INFO:teuthology.orchestra.run.smithi073.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-02-17T05:31:37.699 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-02-17T05:31:37.700 INFO:teuthology.orchestra.run.smithi073.stdout:
2022-02-17T05:31:37.700 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-02-17T05:31:37.700 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-02-17T05:31:37.700 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-02-17T05:31:37.701 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-02-17T05:31:37.702 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server
2022-02-17T05:31:37.720 INFO:teuthology.lock.ops:Updating [smithi122.front.sepia.ceph.com]: set os type and version on server
2022-02-17T05:31:37.721 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com'
2022-02-17T05:31:37.947 INFO:teuthology.orchestra.run.smithi122.stdout:x86_64
2022-02-17T05:31:38.001 INFO:teuthology.orchestra.run.smithi122.stdout:NAME="Red Hat Enterprise Linux"
2022-02-17T05:31:38.002 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION="8.4 (Ootpa)"
2022-02-17T05:31:38.002 INFO:teuthology.orchestra.run.smithi122.stdout:ID="rhel"
2022-02-17T05:31:38.003 INFO:teuthology.orchestra.run.smithi122.stdout:ID_LIKE="fedora"
2022-02-17T05:31:38.003 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_ID="8.4"
2022-02-17T05:31:38.003 INFO:teuthology.orchestra.run.smithi122.stdout:PLATFORM_ID="platform:el8"
2022-02-17T05:31:38.004 INFO:teuthology.orchestra.run.smithi122.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-02-17T05:31:38.004 INFO:teuthology.orchestra.run.smithi122.stdout:ANSI_COLOR="0;31"
2022-02-17T05:31:38.005 INFO:teuthology.orchestra.run.smithi122.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-02-17T05:31:38.005 INFO:teuthology.orchestra.run.smithi122.stdout:HOME_URL="https://www.redhat.com/"
2022-02-17T05:31:38.006 INFO:teuthology.orchestra.run.smithi122.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-02-17T05:31:38.006 INFO:teuthology.orchestra.run.smithi122.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-02-17T05:31:38.007 INFO:teuthology.orchestra.run.smithi122.stdout:
2022-02-17T05:31:38.007 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-02-17T05:31:38.007 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-02-17T05:31:38.008 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-02-17T05:31:38.008 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-02-17T05:31:38.009 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server
2022-02-17T05:31:38.109 INFO:teuthology.dispatcher.supervisor:Running job 6690424
2022-02-17T05:31:38.110 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_c6442aa9e509aace1201390ea4c2d6a80e3d0800/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2022-02-17_04:56:06-rados-GBH_TEST_scrub_allocation_file_on_mount-distro-basic-smithi/6690424 --name benhanokh-2022-02-17_04:56:06-rados-GBH_TEST_scrub_allocation_file_on_mount-distro-basic-smithi --description rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} -- /home/teuthworker/archive/benhanokh-2022-02-17_04:56:06-rados-GBH_TEST_scrub_allocation_file_on_mount-distro-basic-smithi/6690424/orig.config.yaml
2022-02-17T05:31:38.113 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2022-02-17_04:56:06-rados-GBH_TEST_scrub_allocation_file_on_mount-distro-basic-smithi/6690424
2022-02-17T05:31:38.114 INFO:teuthology.dispatcher.supervisor:Job PID: 3184
2022-02-17T05:31:38.114 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-02-17T12:02:07.496 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-02-17T12:02:07.669 INFO:teuthology.kill:Killing Pids: {3184}
2022-02-17T12:02:08.931 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2022-02-17T12:02:08.932 INFO:teuthology.task.internal:roles: ubuntu@smithi122.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2022-02-17T12:02:08.933 INFO:teuthology.misc:Compressing logs...
2022-02-17T12:02:08.933 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com'
2022-02-17T12:02:09.121 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com'
2022-02-17T12:02:09.459 INFO:teuthology.misc:Compressing logs...
2022-02-17T12:02:09.995 INFO:teuthology.orchestra.run.smithi073.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-02-17T12:02:10.179 INFO:teuthology.orchestra.run.smithi122.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-02-17T12:02:10.560 INFO:teuthology.misc:Compressing logs...
2022-02-17T12:02:16.422 INFO:teuthology.kill:No teuthology processes running
2022-02-17T12:02:17.610 INFO:teuthology.kill:Nuking machines: ['smithi073', 'smithi122']
2022-02-17T12:02:18.605 INFO:teuthology.kill:2022-02-17 12:02:18,605.605 INFO:teuthology.nuke:targets:
2022-02-17T12:02:18.607 INFO:teuthology.kill:  smithi073.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC7H+vS4QiRlUMSX3Ij4LP4v8uMH1+mv278Rq/s7BZieG+5++bYvGbQgob1R3/vqbFrEa8ShN9yamIX8Jl27vwHkDBqD0ixwF11FE1Uef3Ei8FF4Aw5xC7cG7Qfoi6pt9WwJldPjo58nPG0JX2ZvQm8NkwPsz9g9w4pY8lrPrhkEzgVW8U8AU79PmXOA86zAPF0L3YObR0fQdteFEggyPFNT7QePZsNewtYnZtbNlmXttA1J1lmtQNwgXUJcT+/Va+z9353EhmSMKp/eep/Sshm1wGR5gXFSaInOTN29JFtPLn7uVeQI+Yo9PDdenVeg4f1pV0NOChK6cOPPvEbRRJrRL4qce2EBu559TqTNsSTv8z1fE+2xXPgUG6sJvUh9zWFCfYdkFHB9iFXUh4Hyi9fiPF1KdX8+lvKZ7zVs3o2tgKVLNp5Q0umuaE3ndJK9TfHA+8hXlw0AVXKIZcaOpeozxXoUtozUKsW1IXjRzl1VdBm1M44NdgwkIRs6q3gET8=
2022-02-17T12:02:18.607 INFO:teuthology.kill:  smithi122.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDKn7OlPL2J9xl77Zh2SMM89EypZbd0FuodaTE3BGjlOlNUXgwoAT6a0zLCp2yH36eosTsxd11r90gqHlmEL+c8kl0GRjuScoIMJN85ErAJqt2EH+rPbsd7kKRB7ZQLxyIDOXX0xMWaHudSWd53Ft81sNC32OMU0Ce2HqEoV9N4JF+z/wOpWRg3mk60EcnxqTmbiMPHur83ZrAdWQktnX8V/uRWIWGG5HGg7j3uVl7UVsnrldpV4PjWlLoNPPDODTt4dxXCxy9fS3h2LlLIEERS7CmBDk4+MU2mL8l8dVc64O71Bqt+VIdj3SpFn6kR4Mswu781CoT227qjvmRBKzj2REaQ50KvYQUOim0nubmbXD8oCKlUIUuQjtx9v21dXwADrytG6Eq2c9wYA1/ZJjycCeXkRkIo1XAvzNczAJGNGNE3l/WZMTeRigA/Wii/5pnTBMBCLKuxqRAq6PVGS6+YfiLEyWecAlQesZj08c/qdiUAfQfiDUqKpgjygIgenQ8=
2022-02-17T12:02:18.632 INFO:teuthology.kill:2022-02-17 12:02:18,632.632 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-02-17T12:02:18.635 INFO:teuthology.kill:2022-02-17 12:02:18,635.635 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-02-17T12:02:18.707 INFO:teuthology.kill:2022-02-17 12:02:18,707.707 INFO:teuthology.orchestra.console:Power off smithi073
2022-02-17T12:02:18.719 INFO:teuthology.kill:2022-02-17 12:02:18,719.719 INFO:teuthology.orchestra.console:Power off smithi122
2022-02-17T12:02:27.092 INFO:teuthology.kill:2022-02-17 12:02:27,092.092 INFO:teuthology.orchestra.console:Power off for smithi122 completed
2022-02-17T12:02:27.240 INFO:teuthology.kill:2022-02-17 12:02:27,239.239 INFO:teuthology.lock.ops:unlocked: smithi122.front.sepia.ceph.com
2022-02-17T12:02:31.207 INFO:teuthology.kill:2022-02-17 12:02:31,207.207 INFO:teuthology.orchestra.console:Power off for smithi073 completed
2022-02-17T12:02:31.353 INFO:teuthology.kill:2022-02-17 12:02:31,353.353 INFO:teuthology.lock.ops:unlocked: smithi073.front.sepia.ceph.com
2022-02-17T12:04:31.672 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-02-17T12:04:31.799 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi073 but it was locked by another job: /home/teuthworker/archive/benhanokh-2022-02-17_11:32:42-rados-safe_shutdown_v2_compact_log_async-distro-basic-smithi/6690974