2022-02-17T02:59:00.650 INFO:root:teuthology version: 1.1.0-c6442aa9
2022-02-17T02:59:00.781 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi085.front.sepia.ceph.com' reimaging
2022-02-17T02:59:00.783 INFO:teuthology.lock.ops:Updating [ubuntu@smithi085.front.sepia.ceph.com]: reset os type and version on server
2022-02-17T02:59:00.783 INFO:teuthology.lock.ops:Updating smithi085.front.sepia.ceph.com on lock server
2022-02-17T02:59:00.802 INFO:teuthology.lock.ops:Node 'ubuntu@smithi085.front.sepia.ceph.com' reimaging is complete
2022-02-17T02:59:00.803 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi114.front.sepia.ceph.com' reimaging
2022-02-17T02:59:00.803 INFO:teuthology.lock.ops:Updating [ubuntu@smithi114.front.sepia.ceph.com]: reset os type and version on server
2022-02-17T02:59:00.804 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server
2022-02-17T02:59:00.823 INFO:teuthology.lock.ops:Node 'ubuntu@smithi114.front.sepia.ceph.com' reimaging is complete
2022-02-17T02:59:01.017 INFO:teuthology.provision.fog.smithi085:Scheduling deploy of centos 8.stream
2022-02-17T02:59:01.028 INFO:teuthology.provision.fog.smithi114:Scheduling deploy of centos 8.stream
2022-02-17T02:59:01.321 INFO:teuthology.orchestra.console:Power off smithi114
2022-02-17T02:59:01.336 INFO:teuthology.orchestra.console:Power off smithi085
2022-02-17T02:59:09.694 INFO:teuthology.orchestra.console:Power off for smithi114 completed
2022-02-17T02:59:09.795 INFO:teuthology.orchestra.console:Power on smithi114
2022-02-17T02:59:13.811 INFO:teuthology.orchestra.console:Power off for smithi085 completed
2022-02-17T02:59:13.913 INFO:teuthology.orchestra.console:Power on smithi085
2022-02-17T02:59:18.160 INFO:teuthology.orchestra.console:Power on for smithi114 completed
2022-02-17T02:59:18.262 INFO:teuthology.provision.fog.smithi114:Waiting for deploy to finish
2022-02-17T02:59:22.276 INFO:teuthology.orchestra.console:Power on for smithi085 completed
2022-02-17T02:59:22.377 INFO:teuthology.provision.fog.smithi085:Waiting for deploy to finish
2022-02-17T03:03:49.850 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-02-17T03:03:50.093 INFO:teuthology.provision.fog.smithi114:Node is ready
2022-02-17T03:03:50.111 INFO:teuthology.orchestra.run.smithi114.stdout:smithi114.front.sepia.ceph.com
2022-02-17T03:03:50.168 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114 smithi114.front.sepia.ceph.com smithi114
2022-02-17T03:03:50.520 INFO:teuthology.provision.fog.smithi114:Deploy complete!
2022-02-17T03:03:53.888 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-02-17T03:03:54.129 INFO:teuthology.provision.fog.smithi085:Node is ready
2022-02-17T03:03:54.147 INFO:teuthology.orchestra.run.smithi085.stdout:smithi085.front.sepia.ceph.com
2022-02-17T03:03:54.204 INFO:teuthology.orchestra.run.smithi085.stdout:172.21.15.85 smithi085.front.sepia.ceph.com smithi085
2022-02-17T03:03:54.534 INFO:teuthology.provision.fog.smithi085:Deploy complete!
2022-02-17T03:03:54.691 INFO:teuthology.lock.ops:Checking smithi085.front.sepia.ceph.com
2022-02-17T03:03:54.692 INFO:teuthology.lock.ops:New key found. Updating...
2022-02-17T03:03:54.719 INFO:teuthology.lock.ops:Checking smithi114.front.sepia.ceph.com
2022-02-17T03:03:54.719 INFO:teuthology.lock.ops:New key found. Updating...
2022-02-17T03:03:54.737 INFO:teuthology.lock.ops:Updating [smithi085.front.sepia.ceph.com]: set os type and version on server
2022-02-17T03:03:54.737 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi085.front.sepia.ceph.com'
2022-02-17T03:03:54.926 INFO:teuthology.orchestra.run.smithi085.stdout:x86_64
2022-02-17T03:03:54.982 INFO:teuthology.orchestra.run.smithi085.stdout:NAME="CentOS Stream"
2022-02-17T03:03:54.982 INFO:teuthology.orchestra.run.smithi085.stdout:VERSION="8"
2022-02-17T03:03:54.983 INFO:teuthology.orchestra.run.smithi085.stdout:ID="centos"
2022-02-17T03:03:54.983 INFO:teuthology.orchestra.run.smithi085.stdout:ID_LIKE="rhel fedora"
2022-02-17T03:03:54.983 INFO:teuthology.orchestra.run.smithi085.stdout:VERSION_ID="8"
2022-02-17T03:03:54.983 INFO:teuthology.orchestra.run.smithi085.stdout:PLATFORM_ID="platform:el8"
2022-02-17T03:03:54.984 INFO:teuthology.orchestra.run.smithi085.stdout:PRETTY_NAME="CentOS Stream 8"
2022-02-17T03:03:54.984 INFO:teuthology.orchestra.run.smithi085.stdout:ANSI_COLOR="0;31"
2022-02-17T03:03:54.984 INFO:teuthology.orchestra.run.smithi085.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-02-17T03:03:54.984 INFO:teuthology.orchestra.run.smithi085.stdout:HOME_URL="https://centos.org/"
2022-02-17T03:03:54.985 INFO:teuthology.orchestra.run.smithi085.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-02-17T03:03:54.985 INFO:teuthology.orchestra.run.smithi085.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-02-17T03:03:54.985 INFO:teuthology.orchestra.run.smithi085.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-02-17T03:03:54.986 INFO:teuthology.lock.ops:Updating smithi085.front.sepia.ceph.com on lock server
2022-02-17T03:03:55.005 INFO:teuthology.lock.ops:Updating [smithi114.front.sepia.ceph.com]: set os type and version on server
2022-02-17T03:03:55.005 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com'
2022-02-17T03:03:55.203 INFO:teuthology.orchestra.run.smithi114.stdout:x86_64
2022-02-17T03:03:55.262 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="CentOS Stream"
2022-02-17T03:03:55.262 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="8"
2022-02-17T03:03:55.262 INFO:teuthology.orchestra.run.smithi114.stdout:ID="centos"
2022-02-17T03:03:55.262 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="rhel fedora"
2022-02-17T03:03:55.263 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="8"
2022-02-17T03:03:55.263 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el8"
2022-02-17T03:03:55.263 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="CentOS Stream 8"
2022-02-17T03:03:55.263 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31"
2022-02-17T03:03:55.264 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-02-17T03:03:55.264 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://centos.org/"
2022-02-17T03:03:55.264 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-02-17T03:03:55.264 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-02-17T03:03:55.264 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-02-17T03:03:55.265 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server
2022-02-17T03:03:55.359 INFO:teuthology.dispatcher.supervisor:Running job 6690185
2022-02-17T03:03:55.359 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_c6442aa9e509aace1201390ea4c2d6a80e3d0800/virtualenv/bin/teuthology -v --owner scheduled_nojha@teuthology --archive /home/teuthworker/archive/nojha-2022-02-16_23:40:43-rados:thrash-GBH_scrub_allocation_file_on_mount-distro-basic-smithi/6690185 --name nojha-2022-02-16_23:40:43-rados:thrash-GBH_scrub_allocation_file_on_mount-distro-basic-smithi --description rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/redirect} -- /home/teuthworker/archive/nojha-2022-02-16_23:40:43-rados:thrash-GBH_scrub_allocation_file_on_mount-distro-basic-smithi/6690185/orig.config.yaml
2022-02-17T03:03:55.363 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/nojha-2022-02-16_23:40:43-rados:thrash-GBH_scrub_allocation_file_on_mount-distro-basic-smithi/6690185
2022-02-17T03:03:55.363 INFO:teuthology.dispatcher.supervisor:Job PID: 11871
2022-02-17T03:03:55.364 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-02-17T09:34:25.228 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-02-17T09:34:25.420 INFO:teuthology.kill:Killing Pids: {11871}
2022-02-17T09:34:26.630 INFO:teuthology.task.internal:roles: ubuntu@smithi085.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2022-02-17T09:34:26.631 INFO:teuthology.task.internal:roles: ubuntu@smithi114.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2022-02-17T09:34:26.631 INFO:teuthology.misc:Compressing logs...
2022-02-17T09:34:26.632 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi085.front.sepia.ceph.com'
2022-02-17T09:34:26.820 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com'
2022-02-17T09:34:27.317 INFO:teuthology.misc:Compressing logs...
2022-02-17T09:34:27.857 INFO:teuthology.orchestra.run.smithi085.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-02-17T09:34:28.035 INFO:teuthology.orchestra.run.smithi114.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-02-17T09:34:28.421 INFO:teuthology.misc:Compressing logs...
2022-02-17T09:34:39.522 INFO:teuthology.kill:No teuthology processes running
2022-02-17T09:34:40.625 INFO:teuthology.kill:Nuking machines: ['smithi085', 'smithi114']
2022-02-17T09:34:41.602 INFO:teuthology.kill:2022-02-17 09:34:41,601.601 INFO:teuthology.nuke:targets:
2022-02-17T09:34:41.603 INFO:teuthology.kill:  smithi085.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNpMXGR/PPCGy+1VZvwOrdlg1Zr3gOzYmXLt+jeCALV7m+qx1vUkEC6aV9T4lmuSw3E51xgQ6SEr740jlWWbKVnHjb5J2D20IuVBOFGkv5hV2Qqk+Vet5mOwlrXMK8PRWr3qFPBQK9Fb+RHgVI6xyReFhgBHYGEIr3dTIyHqrLaexWZaMipvuYOXi6JI+WUHDKewdpWsFhVfl9I3xiqWBp36DvOC0zkHYG0DCiWC1adhLYFYRcusb4fbPKKzHTYFb3A0gE/P9gj2snlBP3wJdthYj2Oj9aBGt0C2BkdvO3YarnSrwYw2FMzGJ/Mm/1QHDAkUIPFluB+nSWoMdg80I9sisDPDg6DrU41XSs+MM2tPGD/G/ftBVKeEn1lYngsZNNbYRUXZM/54e0HMvD7/dMI7eYqSZYdwYqv8ZNYI2z9H+W2ohbd2UVSMITep0wl50ZbVdFgJtpHzlLTwI/zbXYERttipcj963iRkhntVxIPqo/+AK4V8UzbiBdsI5Ofa8=
2022-02-17T09:34:41.603 INFO:teuthology.kill:  smithi114.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBfT2NW44OgUEYiWRy1uZl/3Qqicz4Q82qP0QIwSRhjpUHW3ks84UYnZ8Og6dyRsruGCvjszUl7OqsOsL6fS8slzF60tGjbeO2DyL2cVgAh4v3yH91pXy5l32OWW/9W1JI65PBn67BY+xaZAnEAtUeY7BgGynEikx8ftZhd7RCosBprXpkkesqwu6O0ZR+AKfizRn/2dG2mvtuhUfnK2iwrQeq8PKfFUfEnAPVx9HVyxnB5dN7AeCJ4RuStsrLv8ytdHvEeiu1SljC0lL7YXKj5XwDgXuD5Of5bw/DEGyp6FzctX4zSsrnhGlHrnmgV4DhJe+77HBwUL/Oi7nv0VDZVd8oxp24S+BvPuW9nz213+aua6b5paKqbjzwiULZe3KpXTDjYKihiEH6d/B/2dW4bWcTsXe0410RTQgXobgL6p8luL4hqfg6z7prVN/O9ZrETSgzAUTgO44DHOUMSY9kB4DCEbf/ONjWei7C94/x4YzV+WscU1c5SKLZltHzfMM=
2022-02-17T09:34:41.629 INFO:teuthology.kill:2022-02-17 09:34:41,629.629 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-02-17T09:34:41.633 INFO:teuthology.kill:2022-02-17 09:34:41,633.633 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-02-17T09:34:41.713 INFO:teuthology.kill:2022-02-17 09:34:41,713.713 INFO:teuthology.orchestra.console:Power off smithi114
2022-02-17T09:34:41.729 INFO:teuthology.kill:2022-02-17 09:34:41,729.729 INFO:teuthology.orchestra.console:Power off smithi085
2022-02-17T09:34:54.197 INFO:teuthology.kill:2022-02-17 09:34:54,197.197 INFO:teuthology.orchestra.console:Power off for smithi114 completed
2022-02-17T09:34:54.202 INFO:teuthology.kill:2022-02-17 09:34:54,202.202 INFO:teuthology.orchestra.console:Power off for smithi085 completed
2022-02-17T09:34:54.350 INFO:teuthology.kill:2022-02-17 09:34:54,350.350 INFO:teuthology.lock.ops:unlocked: smithi114.front.sepia.ceph.com
2022-02-17T09:34:54.353 INFO:teuthology.kill:2022-02-17 09:34:54,353.353 INFO:teuthology.lock.ops:unlocked: smithi085.front.sepia.ceph.com
2022-02-17T09:36:54.662 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-02-17T09:36:54.776 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi085 but it was locked by another job: /home/teuthworker/archive/nojha-2022-02-16_23:40:43-rados:thrash-GBH_scrub_allocation_file_on_mount-distro-basic-smithi/6690210
2022-02-17T09:36:54.776 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi114 but it was locked by another job: /home/teuthworker/archive/nojha-2022-02-16_23:40:43-rados:thrash-GBH_scrub_allocation_file_on_mount-distro-basic-smithi/6690210