2022-02-17T14:01:14.271 INFO:root:teuthology version: 1.1.0-c6442aa9
2022-02-17T14:01:14.399 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi111.front.sepia.ceph.com' reimaging
2022-02-17T14:01:14.400 INFO:teuthology.lock.ops:Updating [ubuntu@smithi111.front.sepia.ceph.com]: reset os type and version on server
2022-02-17T14:01:14.401 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server
2022-02-17T14:01:14.420 INFO:teuthology.lock.ops:Node 'ubuntu@smithi111.front.sepia.ceph.com' reimaging is complete
2022-02-17T14:01:14.420 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi162.front.sepia.ceph.com' reimaging
2022-02-17T14:01:14.421 INFO:teuthology.lock.ops:Updating [ubuntu@smithi162.front.sepia.ceph.com]: reset os type and version on server
2022-02-17T14:01:14.421 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server
2022-02-17T14:01:14.441 INFO:teuthology.lock.ops:Node 'ubuntu@smithi162.front.sepia.ceph.com' reimaging is complete
2022-02-17T14:01:14.633 INFO:teuthology.provision.fog.smithi111:Scheduling deploy of centos 8.stream
2022-02-17T14:01:14.646 INFO:teuthology.provision.fog.smithi162:Scheduling deploy of centos 8.stream
2022-02-17T14:01:14.939 INFO:teuthology.orchestra.console:Power off smithi111
2022-02-17T14:01:14.953 INFO:teuthology.orchestra.console:Power off smithi162
2022-02-17T14:01:23.312 INFO:teuthology.orchestra.console:Power off for smithi111 completed
2022-02-17T14:01:23.322 INFO:teuthology.orchestra.console:Power off for smithi162 completed
2022-02-17T14:01:23.414 INFO:teuthology.orchestra.console:Power on smithi111
2022-02-17T14:01:23.424 INFO:teuthology.orchestra.console:Power on smithi162
2022-02-17T14:01:31.783 INFO:teuthology.orchestra.console:Power on for smithi111 completed
2022-02-17T14:01:31.789 INFO:teuthology.orchestra.console:Power on for smithi162 completed
2022-02-17T14:01:31.885 INFO:teuthology.provision.fog.smithi111:Waiting for deploy to finish
2022-02-17T14:01:31.891 INFO:teuthology.provision.fog.smithi162:Waiting for deploy to finish
2022-02-17T14:04:18.035 ERROR:teuthology.orchestra.connection:Error authenticating with smithi111.front.sepia.ceph.com: Authentication failed.
2022-02-17T14:06:27.603 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-02-17T14:06:27.904 INFO:teuthology.provision.fog.smithi162:Node is ready
2022-02-17T14:06:27.924 INFO:teuthology.orchestra.run.smithi162.stdout:smithi162.front.sepia.ceph.com
2022-02-17T14:06:27.984 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.15.162 smithi162.front.sepia.ceph.com smithi162
2022-02-17T14:06:28.336 INFO:teuthology.provision.fog.smithi162:Deploy complete!
2022-02-17T14:06:31.364 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-02-17T14:06:41.625 INFO:teuthology.provision.fog.smithi111:Node is ready
2022-02-17T14:06:41.647 INFO:teuthology.orchestra.run.smithi111.stdout:smithi111.front.sepia.ceph.com
2022-02-17T14:06:41.707 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111 smithi111.front.sepia.ceph.com smithi111
2022-02-17T14:06:42.071 INFO:teuthology.provision.fog.smithi111:Deploy complete!
2022-02-17T14:06:42.230 INFO:teuthology.lock.ops:Checking smithi111.front.sepia.ceph.com
2022-02-17T14:06:42.231 INFO:teuthology.lock.ops:New key found. Updating...
2022-02-17T14:06:42.251 INFO:teuthology.lock.ops:Checking smithi162.front.sepia.ceph.com
2022-02-17T14:06:42.252 INFO:teuthology.lock.ops:New key found. Updating...
2022-02-17T14:06:42.269 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: set os type and version on server
2022-02-17T14:06:42.270 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com'
2022-02-17T14:06:42.465 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64
2022-02-17T14:06:42.522 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="CentOS Stream"
2022-02-17T14:06:42.522 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="8"
2022-02-17T14:06:42.523 INFO:teuthology.orchestra.run.smithi111.stdout:ID="centos"
2022-02-17T14:06:42.523 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="rhel fedora"
2022-02-17T14:06:42.523 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="8"
2022-02-17T14:06:42.524 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el8"
2022-02-17T14:06:42.524 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="CentOS Stream 8"
2022-02-17T14:06:42.524 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31"
2022-02-17T14:06:42.524 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-02-17T14:06:42.525 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://centos.org/"
2022-02-17T14:06:42.525 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-02-17T14:06:42.525 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-02-17T14:06:42.525 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-02-17T14:06:42.527 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server
2022-02-17T14:06:42.546 INFO:teuthology.lock.ops:Updating [smithi162.front.sepia.ceph.com]: set os type and version on server
2022-02-17T14:06:42.546 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com'
2022-02-17T14:06:42.794 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64
2022-02-17T14:06:42.852 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="CentOS Stream"
2022-02-17T14:06:42.853 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="8"
2022-02-17T14:06:42.853 INFO:teuthology.orchestra.run.smithi162.stdout:ID="centos"
2022-02-17T14:06:42.853 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="rhel fedora"
2022-02-17T14:06:42.853 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="8"
2022-02-17T14:06:42.854 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el8"
2022-02-17T14:06:42.854 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="CentOS Stream 8"
2022-02-17T14:06:42.854 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31"
2022-02-17T14:06:42.854 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-02-17T14:06:42.855 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://centos.org/"
2022-02-17T14:06:42.855 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-02-17T14:06:42.855 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-02-17T14:06:42.855 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-02-17T14:06:42.856 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server
2022-02-17T14:06:42.947 INFO:teuthology.dispatcher.supervisor:Running job 6690260
2022-02-17T14:06:42.947 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_c6442aa9e509aace1201390ea4c2d6a80e3d0800/virtualenv/bin/teuthology -v --owner scheduled_nojha@teuthology --archive /home/teuthworker/archive/nojha-2022-02-16_23:40:43-rados:thrash-GBH_scrub_allocation_file_on_mount-distro-basic-smithi/6690260 --name nojha-2022-02-16_23:40:43-rados:thrash-GBH_scrub_allocation_file_on_mount-distro-basic-smithi --description rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-pool-snaps-readproxy} -- /home/teuthworker/archive/nojha-2022-02-16_23:40:43-rados:thrash-GBH_scrub_allocation_file_on_mount-distro-basic-smithi/6690260/orig.config.yaml
2022-02-17T14:06:42.950 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/nojha-2022-02-16_23:40:43-rados:thrash-GBH_scrub_allocation_file_on_mount-distro-basic-smithi/6690260
2022-02-17T14:06:42.951 INFO:teuthology.dispatcher.supervisor:Job PID: 28398
2022-02-17T14:06:42.951 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-02-17T20:36:54.203 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-02-17T20:36:54.485 INFO:teuthology.kill:Killing Pids: {28398}
2022-02-17T20:36:55.612 INFO:teuthology.task.internal:roles: ubuntu@smithi111.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2022-02-17T20:36:55.613 INFO:teuthology.task.internal:roles: ubuntu@smithi162.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2022-02-17T20:36:55.614 INFO:teuthology.misc:Compressing logs...
2022-02-17T20:36:55.614 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com'
2022-02-17T20:36:55.804 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com'
2022-02-17T20:36:56.122 INFO:teuthology.misc:Compressing logs...
2022-02-17T20:36:56.649 INFO:teuthology.orchestra.run.smithi162.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-02-17T20:36:56.807 INFO:teuthology.orchestra.run.smithi111.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-02-17T20:36:57.189 INFO:teuthology.misc:Compressing logs...
2022-02-17T20:37:02.010 INFO:teuthology.kill:No teuthology processes running
2022-02-17T20:37:03.094 INFO:teuthology.kill:Nuking machines: ['smithi111', 'smithi162']
2022-02-17T20:37:03.998 INFO:teuthology.kill:2022-02-17 20:37:03,997.997 INFO:teuthology.nuke:targets:
2022-02-17T20:37:03.998 INFO:teuthology.kill:  smithi111.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDW648o4jIFQx+qgRsZWSO6pSVtqWw66HuQFAA88qwjz8kDY2sg6P92yTs9s8Lr5Igv700j1yoSu2szoF5W95UBjlnT6L2mGVBb9b0vaqkefCrrLzWP2JG72VE0cy9zJ39bCyTYyreXQzIvdX29x4Y62P9LDSLjB6INgkiJL3JKjiJUtTSD/euIAlrT4D5ywicIQySLxzZ/eg9iCa6qWHVslWMe0JCdb2UFSRr1UT4VZ3ZzJhEcYcne3BXB3N+dQUxRer13KpcJh6vRGysVMUU8tuqttybvUSxOJBPjRfZuE/d1juiC3N1p2PUyNK0lURGielAnO/+hPp/mtn4nnitdkcm36hm2VXlLnETI7WdJykEq4DZnmcVbbnoSnEAACmgZyR9mNJPmdcpAFw7iRVpQQNdFNpzxVA6cHbd7y/tFapg5ZLJaxRvBtw+bO+6awcL6xKdqKI4I2nDJGaoDKEJuTDefdDpIO6kxEYuDmcB2Q4L58ArFGok21pfNCfgcqQc=
2022-02-17T20:37:03.999 INFO:teuthology.kill:  smithi162.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC7ywjObhiGNlqUwPxVlZsq1apDqJ+5m1AVuBm8m+L9F3Cz7eGcFsgindci3of0WP730n+g6DZph//fpc3zDTMZUKhjU/HRILx8r34Gu9XhyBTFYLimWDL0EQ3PFIc99JqkqW5dS14o1IRGbb2k4tyzgBI1vwTE682MlD/H03xEGq3JFt2hDurS+xazTo20CDtxa2K8TVtc9Zh4oExllJ/d25r+qk9og0nW0JT3jfuvYFoufmK0yKN8agLuCN1WCmchPaQpfWLyhmR/UUlX3ONCK3/qYNwPWRbAbT3bRcJrU9iUqA4NqlBjNrGnTBIzpn3FtDfEVXTSrO/WS8hRs2AGYISvFBp9dXoz9Wgn+Np0sYEAeI7yXv+3xi3CZAw/o4tKaJMqaNaFkmAAnauuWl5NB+WtWiSARQS0NOMCuP8qngGoASBC+gqpqCX4U5WY5QKwgj/z5UOJTpJGn387lGVM7NglbJw27B2DI1AZE2p3mhYTg96rwxPW8SgNi747O+8=
2022-02-17T20:37:04.023 INFO:teuthology.kill:2022-02-17 20:37:04,023.023 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-02-17T20:37:04.026 INFO:teuthology.kill:2022-02-17 20:37:04,026.026 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-02-17T20:37:04.097 INFO:teuthology.kill:2022-02-17 20:37:04,097.097 INFO:teuthology.orchestra.console:Power off smithi111
2022-02-17T20:37:04.111 INFO:teuthology.kill:2022-02-17 20:37:04,111.111 INFO:teuthology.orchestra.console:Power off smithi162
2022-02-17T20:37:12.466 INFO:teuthology.kill:2022-02-17 20:37:12,466.466 INFO:teuthology.orchestra.console:Power off for smithi111 completed
2022-02-17T20:37:12.611 INFO:teuthology.kill:2022-02-17 20:37:12,611.611 INFO:teuthology.lock.ops:unlocked: smithi111.front.sepia.ceph.com
2022-02-17T20:37:16.585 INFO:teuthology.kill:2022-02-17 20:37:16,584.584 INFO:teuthology.orchestra.console:Power off for smithi162 completed
2022-02-17T20:37:16.732 INFO:teuthology.kill:2022-02-17 20:37:16,732.732 INFO:teuthology.lock.ops:unlocked: smithi162.front.sepia.ceph.com
2022-02-17T20:39:16.939 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15