2022-03-04T18:50:40.773 INFO:root:teuthology version: 1.1.0-eeaeee38
2022-03-04T18:50:40.905 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi107.front.sepia.ceph.com' reimaging
2022-03-04T18:50:40.906 INFO:teuthology.lock.ops:Updating [ubuntu@smithi107.front.sepia.ceph.com]: reset os type and version on server
2022-03-04T18:50:40.907 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server
2022-03-04T18:50:40.926 INFO:teuthology.lock.ops:Node 'ubuntu@smithi107.front.sepia.ceph.com' reimaging is complete
2022-03-04T18:50:40.927 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi123.front.sepia.ceph.com' reimaging
2022-03-04T18:50:40.927 INFO:teuthology.lock.ops:Updating [ubuntu@smithi123.front.sepia.ceph.com]: reset os type and version on server
2022-03-04T18:50:40.927 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server
2022-03-04T18:50:40.950 INFO:teuthology.lock.ops:Node 'ubuntu@smithi123.front.sepia.ceph.com' reimaging is complete
2022-03-04T18:50:41.134 INFO:teuthology.provision.fog.smithi107:Scheduling deploy of rhel 8.4
2022-03-04T18:50:41.164 INFO:teuthology.provision.fog.smithi123:Scheduling deploy of rhel 8.4
2022-03-04T18:50:41.471 INFO:teuthology.orchestra.console:Power off smithi107
2022-03-04T18:50:41.514 INFO:teuthology.orchestra.console:Power off smithi123
2022-03-04T18:50:49.845 INFO:teuthology.orchestra.console:Power off for smithi107 completed
2022-03-04T18:50:49.946 INFO:teuthology.orchestra.console:Power on smithi107
2022-03-04T18:50:53.994 INFO:teuthology.orchestra.console:Power off for smithi123 completed
2022-03-04T18:50:54.096 INFO:teuthology.orchestra.console:Power on smithi123
2022-03-04T18:50:58.345 INFO:teuthology.orchestra.console:Power on for smithi123 completed
2022-03-04T18:50:58.421 INFO:teuthology.orchestra.console:Power on for smithi107 completed
2022-03-04T18:50:58.447 INFO:teuthology.provision.fog.smithi123:Waiting for deploy to finish
2022-03-04T18:50:58.522 INFO:teuthology.provision.fog.smithi107:Waiting for deploy to finish
2022-03-04T18:55:04.774 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-04T18:55:25.371 INFO:teuthology.provision.fog.smithi123:Node is ready
2022-03-04T18:55:25.391 INFO:teuthology.orchestra.run.smithi123.stdout:smithi123.front.sepia.ceph.com
2022-03-04T18:55:25.447 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123 smithi123.front.sepia.ceph.com smithi123
2022-03-04T18:55:25.782 INFO:teuthology.provision.fog.smithi123:Deploy complete!
2022-03-04T18:55:45.312 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-04T18:55:45.546 INFO:teuthology.provision.fog.smithi107:Node is ready
2022-03-04T18:55:45.561 INFO:teuthology.orchestra.run.smithi107.stdout:smithi107.front.sepia.ceph.com
2022-03-04T18:55:45.617 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107 smithi107.front.sepia.ceph.com smithi107
2022-03-04T18:55:45.947 INFO:teuthology.provision.fog.smithi107:Deploy complete!
2022-03-04T18:55:46.094 INFO:teuthology.lock.ops:Checking smithi107.front.sepia.ceph.com
2022-03-04T18:55:46.095 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-04T18:55:46.114 INFO:teuthology.lock.ops:Checking smithi123.front.sepia.ceph.com
2022-03-04T18:55:46.114 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-04T18:55:46.132 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: set os type and version on server
2022-03-04T18:55:46.133 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com'
2022-03-04T18:55:46.355 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64
2022-03-04T18:55:46.409 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="Red Hat Enterprise Linux"
2022-03-04T18:55:46.410 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="8.4 (Ootpa)"
2022-03-04T18:55:46.410 INFO:teuthology.orchestra.run.smithi107.stdout:ID="rhel"
2022-03-04T18:55:46.410 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="fedora"
2022-03-04T18:55:46.410 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="8.4"
2022-03-04T18:55:46.411 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el8"
2022-03-04T18:55:46.411 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-03-04T18:55:46.411 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31"
2022-03-04T18:55:46.411 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-03-04T18:55:46.412 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://www.redhat.com/"
2022-03-04T18:55:46.412 INFO:teuthology.orchestra.run.smithi107.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-03-04T18:55:46.412 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-04T18:55:46.412 INFO:teuthology.orchestra.run.smithi107.stdout:
2022-03-04T18:55:46.412 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-04T18:55:46.413 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-03-04T18:55:46.413 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-03-04T18:55:46.413 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-03-04T18:55:46.415 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server
2022-03-04T18:55:46.432 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: set os type and version on server
2022-03-04T18:55:46.433 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com'
2022-03-04T18:55:46.668 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64
2022-03-04T18:55:46.723 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="Red Hat Enterprise Linux"
2022-03-04T18:55:46.724 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="8.4 (Ootpa)"
2022-03-04T18:55:46.724 INFO:teuthology.orchestra.run.smithi123.stdout:ID="rhel"
2022-03-04T18:55:46.724 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="fedora"
2022-03-04T18:55:46.724 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="8.4"
2022-03-04T18:55:46.725 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el8"
2022-03-04T18:55:46.725 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-03-04T18:55:46.725 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31"
2022-03-04T18:55:46.725 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-03-04T18:55:46.726 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://www.redhat.com/"
2022-03-04T18:55:46.726 INFO:teuthology.orchestra.run.smithi123.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-03-04T18:55:46.726 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-04T18:55:46.726 INFO:teuthology.orchestra.run.smithi123.stdout:
2022-03-04T18:55:46.726 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-04T18:55:46.727 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-03-04T18:55:46.727 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-03-04T18:55:46.727 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-03-04T18:55:46.728 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server
2022-03-04T18:55:46.823 INFO:teuthology.dispatcher.supervisor:Running job 6720592
2022-03-04T18:55:46.823 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_eeaeee38264fad8a01fd1ce912d8908676ed64bc/virtualenv/bin/teuthology -v --owner scheduled_rzarzynski@teuthology --archive /home/teuthworker/archive/rzarzynski-2022-03-04_18:41:01-rados-master-distro-basic-smithi/6720592 --name rzarzynski-2022-03-04_18:41:01-rados-master-distro-basic-smithi --description rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/small-objects-balanced} -- /home/teuthworker/archive/rzarzynski-2022-03-04_18:41:01-rados-master-distro-basic-smithi/6720592/orig.config.yaml
2022-03-04T18:55:46.827 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rzarzynski-2022-03-04_18:41:01-rados-master-distro-basic-smithi/6720592
2022-03-04T18:55:46.827 INFO:teuthology.dispatcher.supervisor:Job PID: 15014
2022-03-04T18:55:46.828 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-03-05T01:26:15.545 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-03-05T01:26:15.729 INFO:teuthology.kill:Killing Pids: {15014}
2022-03-05T01:26:16.910 INFO:teuthology.task.internal:roles: ubuntu@smithi107.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2022-03-05T01:26:16.911 INFO:teuthology.task.internal:roles: ubuntu@smithi123.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2022-03-05T01:26:16.911 INFO:teuthology.misc:Compressing logs...
2022-03-05T01:26:16.912 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com'
2022-03-05T01:26:17.096 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com'
2022-03-05T01:26:17.430 INFO:teuthology.misc:Compressing logs...
2022-03-05T01:26:17.920 INFO:teuthology.orchestra.run.smithi123.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-03-05T01:26:18.092 INFO:teuthology.orchestra.run.smithi107.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-03-05T01:26:18.443 INFO:teuthology.misc:Compressing logs...
2022-03-05T01:26:25.007 INFO:teuthology.kill:No teuthology processes running
2022-03-05T01:26:26.121 INFO:teuthology.kill:Nuking machines: ['smithi107', 'smithi123']
2022-03-05T01:26:27.066 INFO:teuthology.kill:2022-03-05 01:26:27,065.065 INFO:teuthology.nuke:targets:
2022-03-05T01:26:27.066 INFO:teuthology.kill:  smithi107.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/vpkc2v4TJpF9jrWMH05wCIxE++LEf0TynKL8dnrHrewixo+1Y4iS33CbwcVtzbl9uYMDoU4+Pta6SmrhcLV+iiEgHQGDh4+8CxAlwtjFQdxcxFlNnPVRqSLPOk7TXaPTDT2c5b75k0dOj4NcXc6mF2FUxvvXcqpXtKtd03MFmXzaHoY0lPD7mCkLk5y5lIVThBuvw8BR5KL+lrIFZ4jkVBJtBRjnI8BgmqCYuQd1uCdNXKyN69tVKwqqY81G6mbq+21mnZ/EXGCYiZ5WsEbKFA+V8eUgDuGENHBkbXOESp1xcuqvjuEj+QhwSSVi01jcz3BQh9eujz6itieUetrfUy1e6IuVg8owsIcUHJJSbzuiN+NcNsGlk5EpX/e12IZ5+BEhxKL0JgQZ/LIDdooJRzZgyH99SDJg3PC5E8VIgIlH2o9Wof3bdf0JeTGySs+4nA+SGD221R3V1peftzHIf8COsR0rEgdzMZShvHt9EYxoZI5WtsXE2BMo/NpjkFE=
2022-03-05T01:26:27.067 INFO:teuthology.kill:  smithi123.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPoS4p2/w2XJGQvHZo6/sSQTbQygarWKMkj2Bbtw9jeOF1ozM4r08uHGvOBtbkeMCeIDAPpwoRPE0ErBcoUOqNQsG5Flc3Nq+OwUtMwnrARlj7tJfzyvVR/j8ZDsWp8k30TTScNXpnfrPdTXmUZgz3WKWgnBiKezjCiU+55/FDcNSEHpJUSTxukDUnxY/Ds4ciV2YOA0VKzgYbt14nazA/MYmR1/ldP+fo+vVzmfn3Pqnynxpji6/nrP3kshhC/aVGEEwChG+K9eWArBE/6GxCDCxBo5mqAnIGy2apJMijGGDCbZrGnBaiN46p8znJKGQi+qDk0SLN1aQBHgM3obkolDZ8kz+zLupL1FFMA+SZgEm+OHiRQ7UK3dgVzcb0M1JNEuaCoikReUbPGb8e1TzOELdosiBd2fj9mZdGaFbO1Qj1xxJpgM+vGTkYgoiu6+Sc9cCVhG/gBkMBqNRT7ouZKy2JUJ5kBbEPdvoALeJ7fqsfZ/ADh3hrzsmY9Kfcwhc=
2022-03-05T01:26:27.093 INFO:teuthology.kill:2022-03-05 01:26:27,093.093 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-05T01:26:27.096 INFO:teuthology.kill:2022-03-05 01:26:27,096.096 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-05T01:26:27.173 INFO:teuthology.kill:2022-03-05 01:26:27,173.173 INFO:teuthology.orchestra.console:Power off smithi107
2022-03-05T01:26:27.186 INFO:teuthology.kill:2022-03-05 01:26:27,186.186 INFO:teuthology.orchestra.console:Power off smithi123
2022-03-05T01:26:35.539 INFO:teuthology.kill:2022-03-05 01:26:35,539.539 INFO:teuthology.orchestra.console:Power off for smithi107 completed
2022-03-05T01:26:35.545 INFO:teuthology.kill:2022-03-05 01:26:35,545.545 INFO:teuthology.orchestra.console:Power off for smithi123 completed
2022-03-05T01:26:35.685 INFO:teuthology.kill:2022-03-05 01:26:35,684.684 INFO:teuthology.lock.ops:unlocked: smithi107.front.sepia.ceph.com
2022-03-05T01:26:35.689 INFO:teuthology.kill:2022-03-05 01:26:35,689.689 INFO:teuthology.lock.ops:unlocked: smithi123.front.sepia.ceph.com
2022-03-05T01:28:35.996 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-03-05T01:28:36.107 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi107 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-03-04_21:56:41-rados-wip-yuri4-testing-2022-03-03-1448-distro-default-smithi/6721313
2022-03-05T01:28:36.108 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi123 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-03-04_21:56:41-rados-wip-yuri4-testing-2022-03-03-1448-distro-default-smithi/6721313