2022-03-21T08:17:35.317 INFO:root:teuthology version: 1.1.0-a4e18662
2022-03-21T08:17:35.462 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi109.front.sepia.ceph.com' reimaging
2022-03-21T08:17:35.463 INFO:teuthology.lock.ops:Updating [ubuntu@smithi109.front.sepia.ceph.com]: reset os type and version on server
2022-03-21T08:17:35.463 INFO:teuthology.lock.ops:Updating smithi109.front.sepia.ceph.com on lock server
2022-03-21T08:17:35.487 INFO:teuthology.lock.ops:Node 'ubuntu@smithi109.front.sepia.ceph.com' reimaging is complete
2022-03-21T08:17:35.488 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi123.front.sepia.ceph.com' reimaging
2022-03-21T08:17:35.488 INFO:teuthology.lock.ops:Updating [ubuntu@smithi123.front.sepia.ceph.com]: reset os type and version on server
2022-03-21T08:17:35.489 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server
2022-03-21T08:17:35.511 INFO:teuthology.lock.ops:Node 'ubuntu@smithi123.front.sepia.ceph.com' reimaging is complete
2022-03-21T08:17:35.683 INFO:teuthology.provision.fog.smithi109:Scheduling deploy of centos 8.stream
2022-03-21T08:17:35.700 INFO:teuthology.provision.fog.smithi123:Scheduling deploy of centos 8.stream
2022-03-21T08:17:35.957 INFO:teuthology.orchestra.console:Power off smithi109
2022-03-21T08:17:35.998 INFO:teuthology.orchestra.console:Power off smithi123
2022-03-21T08:17:48.449 INFO:teuthology.orchestra.console:Power off for smithi109 completed
2022-03-21T08:17:48.466 INFO:teuthology.orchestra.console:Power off for smithi123 completed
2022-03-21T08:17:48.551 INFO:teuthology.orchestra.console:Power on smithi109
2022-03-21T08:17:48.566 INFO:teuthology.orchestra.console:Power on smithi123
2022-03-21T08:17:52.810 INFO:teuthology.orchestra.console:Power on for smithi109 completed
2022-03-21T08:17:52.817 INFO:teuthology.orchestra.console:Power on for smithi123 completed
2022-03-21T08:17:52.911 INFO:teuthology.provision.fog.smithi109:Waiting for deploy to finish
2022-03-21T08:17:52.918 INFO:teuthology.provision.fog.smithi123:Waiting for deploy to finish
2022-03-21T08:20:23.921 ERROR:teuthology.orchestra.connection:Error authenticating with smithi123.front.sepia.ceph.com: Authentication failed.
2022-03-21T08:22:31.957 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-21T08:22:32.210 INFO:teuthology.provision.fog.smithi123:Node is ready
2022-03-21T08:22:32.229 INFO:teuthology.orchestra.run.smithi123.stdout:smithi123.front.sepia.ceph.com
2022-03-21T08:22:32.289 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123 smithi123.front.sepia.ceph.com smithi123
2022-03-21T08:22:32.658 INFO:teuthology.provision.fog.smithi123:Deploy complete!
2022-03-21T08:22:39.519 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-21T08:22:39.796 INFO:teuthology.provision.fog.smithi109:Node is ready
2022-03-21T08:22:39.815 INFO:teuthology.orchestra.run.smithi109.stdout:smithi109.front.sepia.ceph.com
2022-03-21T08:22:39.873 INFO:teuthology.orchestra.run.smithi109.stdout:172.21.15.109 smithi109.front.sepia.ceph.com smithi109
2022-03-21T08:22:40.232 INFO:teuthology.provision.fog.smithi109:Deploy complete!
2022-03-21T08:22:40.383 INFO:teuthology.lock.ops:Checking smithi109.front.sepia.ceph.com
2022-03-21T08:22:40.384 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-21T08:22:40.402 INFO:teuthology.lock.ops:Checking smithi123.front.sepia.ceph.com
2022-03-21T08:22:40.403 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-21T08:22:40.420 INFO:teuthology.lock.ops:Updating [smithi109.front.sepia.ceph.com]: set os type and version on server
2022-03-21T08:22:40.421 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi109.front.sepia.ceph.com'
2022-03-21T08:22:40.610 INFO:teuthology.orchestra.run.smithi109.stdout:x86_64
2022-03-21T08:22:40.666 INFO:teuthology.orchestra.run.smithi109.stdout:NAME="CentOS Stream"
2022-03-21T08:22:40.667 INFO:teuthology.orchestra.run.smithi109.stdout:VERSION="8"
2022-03-21T08:22:40.667 INFO:teuthology.orchestra.run.smithi109.stdout:ID="centos"
2022-03-21T08:22:40.667 INFO:teuthology.orchestra.run.smithi109.stdout:ID_LIKE="rhel fedora"
2022-03-21T08:22:40.667 INFO:teuthology.orchestra.run.smithi109.stdout:VERSION_ID="8"
2022-03-21T08:22:40.668 INFO:teuthology.orchestra.run.smithi109.stdout:PLATFORM_ID="platform:el8"
2022-03-21T08:22:40.668 INFO:teuthology.orchestra.run.smithi109.stdout:PRETTY_NAME="CentOS Stream 8"
2022-03-21T08:22:40.668 INFO:teuthology.orchestra.run.smithi109.stdout:ANSI_COLOR="0;31"
2022-03-21T08:22:40.668 INFO:teuthology.orchestra.run.smithi109.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-03-21T08:22:40.668 INFO:teuthology.orchestra.run.smithi109.stdout:HOME_URL="https://centos.org/"
2022-03-21T08:22:40.669 INFO:teuthology.orchestra.run.smithi109.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-21T08:22:40.669 INFO:teuthology.orchestra.run.smithi109.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-21T08:22:40.669 INFO:teuthology.orchestra.run.smithi109.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-03-21T08:22:40.670 INFO:teuthology.lock.ops:Updating smithi109.front.sepia.ceph.com on lock server
2022-03-21T08:22:40.694 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: set os type and version on server
2022-03-21T08:22:40.694 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com'
2022-03-21T08:22:40.886 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64
2022-03-21T08:22:40.944 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="CentOS Stream"
2022-03-21T08:22:40.944 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="8"
2022-03-21T08:22:40.945 INFO:teuthology.orchestra.run.smithi123.stdout:ID="centos"
2022-03-21T08:22:40.945 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="rhel fedora"
2022-03-21T08:22:40.945 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="8"
2022-03-21T08:22:40.945 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el8"
2022-03-21T08:22:40.945 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="CentOS Stream 8"
2022-03-21T08:22:40.946 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31"
2022-03-21T08:22:40.946 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-03-21T08:22:40.946 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://centos.org/"
2022-03-21T08:22:40.946 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-21T08:22:40.947 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-21T08:22:40.947 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-03-21T08:22:40.947 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server
2022-03-21T08:22:41.047 INFO:teuthology.dispatcher.supervisor:Running job 6749807
2022-03-21T08:22:41.047 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_a4e18662e5de936eb0ac089e531b933ecbcadb0a/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2022-03-21_06:07:09-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi/6749807 --name vshankar-2022-03-21_06:07:09-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/ffsb}} -- /home/teuthworker/archive/vshankar-2022-03-21_06:07:09-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi/6749807/orig.config.yaml
2022-03-21T08:22:41.051 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2022-03-21_06:07:09-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi/6749807
2022-03-21T08:22:41.051 INFO:teuthology.dispatcher.supervisor:Job PID: 20323
2022-03-21T08:22:41.052 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-03-21T14:52:51.903 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-03-21T14:52:52.095 INFO:teuthology.kill:Killing Pids: {20323}
2022-03-21T14:52:53.242 INFO:teuthology.task.internal:roles: ubuntu@smithi109.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-03-21T14:52:53.243 INFO:teuthology.task.internal:roles: ubuntu@smithi123.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-03-21T14:52:53.243 INFO:teuthology.misc:Compressing logs...
2022-03-21T14:52:53.244 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi109.front.sepia.ceph.com'
2022-03-21T14:52:53.463 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com'
2022-03-21T14:52:53.869 INFO:teuthology.misc:Compressing logs...
2022-03-21T14:52:54.124 INFO:teuthology.misc:Compressing logs...
2022-03-21T15:02:53.418 INFO:teuthology.kill:No teuthology processes running
2022-03-21T15:02:54.522 INFO:teuthology.kill:Nuking machines: ['smithi109', 'smithi123']
2022-03-21T15:02:55.468 INFO:teuthology.kill:2022-03-21 15:02:55,467.467 INFO:teuthology.nuke:targets:
2022-03-21T15:02:55.469 INFO:teuthology.kill:  smithi109.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDczqGMS51pF/TFXJtbNvFYobt5D86q9WC14Sx/N9FBb4nf43EdZxtaeKxXAL+oue5WrDECmkKU2+dMKi28x0GMwFdtViarxUjwB2VrfNoGLi8O1pOAbWqRG/oTwYwyc6LLJmYHHLSZRgIt4TvP5u0tbimU1W1GfyMd6EJ8OcAx6bcjsU2Er+UWXi2r+YjAosUlB7irGRCVJBrgubh13HkgPJb/cVAQaZB/wbpmSGQOkyEfiAqc34RbJsxvye1trJ+2SH+aNBEH0luScyn3PJkCSIwWS4yKq2IjAYWo2SxfR0FGL5eEMQApnf70CzEptSbyJADpRZ/9B/4O8KIzskWeCoTARs3e7HzISF9Y+9t79qivOppy3IjFcsrnXuCvYplBPUO7dG5pO/94dxyUb4t7GZw+H7NYFzOl3c3eu52yYZKCV+O7fZXjzTU8pwB6ErGOT68NCOFHsrLsD2YZwLtWSSPs8V2ef8KvTZrl2mlNFYnZWRef/nYXPS9poW32oTM=
2022-03-21T15:02:55.469 INFO:teuthology.kill:  smithi123.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpGIbLyOyJadSbNnpK+9bpfZzNQ3x4YRrAZP/e9f8I4J4i7l86//CPW/xynetPGs6aaUNQ8AJiMGeKdZMzj2oqlPYB6+YZyWizQATRblXRnFCJy3CSlmY6eNkSse37tgoVBY86t2q5g40JDQ7nrRuiCm0f36ZDI9n1tgbkC7iGrZ8KgNpz6EtvlII2Hr4vW6pUmQcHUivnJaogfgnZ4lROC5v+z8cCGAZRDCEubf0wXEnL7TTFN9jhZnxftgNFe90rk3T2bVAbiGDXU3VxbUHQ9Up4JkFlqfIErxaSAr7fRH0ftU8TTe+h/DjyuoX3kgG16H2EldyK3/Jkk3N4bhGwRafME01GcA6ZvGje4PIu0zOUlOgvU+uxR1+GMPUVLfYcr/sZtiFWuGP0S2NG9RS1p/8MogdCaEhb17g5ze13l/P4voQcUgjthbaB630UvRyUPpwk4IGVDQJLKHN86TIAGJnzbBVVQIIA9jr/on6Pvh48dS/kSh56hZui6Oy1290=
2022-03-21T15:02:55.494 INFO:teuthology.kill:2022-03-21 15:02:55,494.494 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-21T15:02:55.497 INFO:teuthology.kill:2022-03-21 15:02:55,497.497 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-21T15:02:55.571 INFO:teuthology.kill:2022-03-21 15:02:55,571.571 INFO:teuthology.orchestra.console:Power off smithi109
2022-03-21T15:02:55.589 INFO:teuthology.kill:2022-03-21 15:02:55,588.588 INFO:teuthology.orchestra.console:Power off smithi123
2022-03-21T15:03:03.949 INFO:teuthology.kill:2022-03-21 15:03:03,949.949 INFO:teuthology.orchestra.console:Power off for smithi109 completed
2022-03-21T15:03:04.095 INFO:teuthology.kill:2022-03-21 15:03:04,094.094 INFO:teuthology.lock.ops:unlocked: smithi109.front.sepia.ceph.com
2022-03-21T15:03:08.068 INFO:teuthology.kill:2022-03-21 15:03:08,067.067 INFO:teuthology.orchestra.console:Power off for smithi123 completed
2022-03-21T15:03:08.213 INFO:teuthology.kill:2022-03-21 15:03:08,212.212 INFO:teuthology.lock.ops:unlocked: smithi123.front.sepia.ceph.com
2022-03-21T15:05:08.411 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-03-21T15:05:08.514 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi109 but it was locked by another job: /home/teuthworker/archive/gsalomon-2022-03-21_06:34:03-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6750067
2022-03-21T15:05:08.515 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi123 but it was locked by another job: /home/teuthworker/archive/gsalomon-2022-03-21_06:34:03-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6750067