2021-09-19T02:55:29.978 INFO:root:teuthology version: 1.1.0-4e1f59de 2021-09-19T02:55:30.073 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi112.front.sepia.ceph.com' reimaging 2021-09-19T02:55:30.074 INFO:teuthology.lock.ops:Updating [ubuntu@smithi112.front.sepia.ceph.com]: reset os type and version on server 2021-09-19T02:55:30.074 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2021-09-19T02:55:30.090 INFO:teuthology.lock.ops:Node 'ubuntu@smithi112.front.sepia.ceph.com' reimaging is complete 2021-09-19T02:55:30.090 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi156.front.sepia.ceph.com' reimaging 2021-09-19T02:55:30.090 INFO:teuthology.lock.ops:Updating [ubuntu@smithi156.front.sepia.ceph.com]: reset os type and version on server 2021-09-19T02:55:30.091 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2021-09-19T02:55:30.107 INFO:teuthology.lock.ops:Node 'ubuntu@smithi156.front.sepia.ceph.com' reimaging is complete 2021-09-19T02:55:30.305 INFO:teuthology.provision.fog.smithi112:Scheduling deploy of centos 8.3 2021-09-19T02:55:30.311 INFO:teuthology.provision.fog.smithi156:Scheduling deploy of centos 8.3 2021-09-19T02:55:30.611 INFO:teuthology.orchestra.console:Power off smithi112 2021-09-19T02:55:30.626 INFO:teuthology.orchestra.console:Power off smithi156 2021-09-19T02:55:30.758 INFO:teuthology.orchestra.console:Power off for smithi112 completed 2021-09-19T02:55:30.765 INFO:teuthology.orchestra.console:Power off for smithi156 completed 2021-09-19T02:55:30.860 INFO:teuthology.orchestra.console:Power on smithi112 2021-09-19T02:55:30.867 INFO:teuthology.orchestra.console:Power on smithi156 2021-09-19T02:55:35.113 INFO:teuthology.orchestra.console:Power on for smithi112 completed 2021-09-19T02:55:35.120 INFO:teuthology.orchestra.console:Power on for smithi156 completed 2021-09-19T02:55:35.215 INFO:teuthology.provision.fog.smithi112:Waiting for deploy to finish 2021-09-19T02:55:35.221 INFO:teuthology.provision.fog.smithi156:Waiting for deploy to finish 2021-09-19T02:59:41.415 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-09-19T03:00:01.555 INFO:teuthology.provision.fog.smithi112:Node is ready 2021-09-19T03:00:01.575 INFO:teuthology.orchestra.run.smithi112.stdout:smithi112.front.sepia.ceph.com 2021-09-19T03:00:01.633 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112 smithi112.front.sepia.ceph.com smithi112 2021-09-19T03:00:01.979 INFO:teuthology.provision.fog.smithi112:Deploy complete! 2021-09-19T03:00:21.906 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-09-19T03:00:22.207 INFO:teuthology.provision.fog.smithi156:Node is ready 2021-09-19T03:00:22.221 INFO:teuthology.orchestra.run.smithi156.stdout:smithi156.front.sepia.ceph.com 2021-09-19T03:00:22.276 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156 smithi156.front.sepia.ceph.com smithi156 2021-09-19T03:00:22.624 INFO:teuthology.provision.fog.smithi156:Deploy complete! 2021-09-19T03:00:22.764 INFO:teuthology.lock.ops:Checking smithi112.front.sepia.ceph.com 2021-09-19T03:00:22.765 INFO:teuthology.lock.ops:New key found. Updating... 2021-09-19T03:00:22.783 INFO:teuthology.lock.ops:Checking smithi156.front.sepia.ceph.com 2021-09-19T03:00:22.783 INFO:teuthology.lock.ops:New key found. Updating... 2021-09-19T03:00:22.800 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: set os type and version on server 2021-09-19T03:00:22.801 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2021-09-19T03:00:23.073 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2021-09-19T03:00:23.128 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Linux" 2021-09-19T03:00:23.128 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="8" 2021-09-19T03:00:23.129 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos" 2021-09-19T03:00:23.129 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora" 2021-09-19T03:00:23.129 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="8" 2021-09-19T03:00:23.129 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el8" 2021-09-19T03:00:23.130 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Linux 8" 2021-09-19T03:00:23.130 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2021-09-19T03:00:23.131 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-09-19T03:00:23.131 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/" 2021-09-19T03:00:23.131 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-09-19T03:00:23.132 INFO:teuthology.orchestra.run.smithi112.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-09-19T03:00:23.132 INFO:teuthology.orchestra.run.smithi112.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-09-19T03:00:23.134 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2021-09-19T03:00:23.152 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: set os type and version on server 2021-09-19T03:00:23.153 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2021-09-19T03:00:23.411 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64 2021-09-19T03:00:23.465 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Linux" 2021-09-19T03:00:23.466 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="8" 2021-09-19T03:00:23.466 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos" 2021-09-19T03:00:23.466 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora" 2021-09-19T03:00:23.466 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="8" 2021-09-19T03:00:23.467 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el8" 2021-09-19T03:00:23.467 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Linux 8" 2021-09-19T03:00:23.467 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2021-09-19T03:00:23.467 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-09-19T03:00:23.467 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://centos.org/" 2021-09-19T03:00:23.468 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-09-19T03:00:23.468 INFO:teuthology.orchestra.run.smithi156.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-09-19T03:00:23.468 INFO:teuthology.orchestra.run.smithi156.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-09-19T03:00:23.469 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2021-09-19T03:00:23.558 INFO:teuthology.dispatcher.supervisor:Running job 6396571 2021-09-19T03:00:23.559 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_4e1f59de82924f116bd6b91664f90ef632c60a3f/virtualenv/bin/teuthology -v --owner scheduled_ozeneva@teuthology --archive /home/teuthworker/archive/ozeneva-2021-09-18_18:19:17-rados-wip-omri-tracer-2-distro-basic-smithi/6396571 --name ozeneva-2021-09-18_18:19:17-rados-wip-omri-tracer-2-distro-basic-smithi --description rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-fast-read-overwrites} -- /home/teuthworker/archive/ozeneva-2021-09-18_18:19:17-rados-wip-omri-tracer-2-distro-basic-smithi/6396571/orig.config.yaml 2021-09-19T03:00:23.564 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/ozeneva-2021-09-18_18:19:17-rados-wip-omri-tracer-2-distro-basic-smithi/6396571 2021-09-19T03:00:23.565 INFO:teuthology.dispatcher.supervisor:Job PID: 19662 2021-09-19T03:00:23.565 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-09-19T15:01:16.291 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-09-19T15:01:16.489 INFO:teuthology.kill:Killing Pids: {19662} 2021-09-19T15:01:17.901 INFO:teuthology.task.internal:roles: ubuntu@smithi112.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2021-09-19T15:01:17.903 INFO:teuthology.task.internal:roles: ubuntu@smithi156.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2021-09-19T15:01:17.903 INFO:teuthology.misc:Compressing logs... 2021-09-19T15:01:17.904 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2021-09-19T15:01:18.126 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2021-09-19T15:01:18.743 INFO:teuthology.misc:Compressing logs... 2021-09-19T15:01:19.741 INFO:teuthology.orchestra.run.smithi156.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2021-09-19T15:01:20.017 INFO:teuthology.orchestra.run.smithi112.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2021-09-19T15:03:35.715 INFO:teuthology.misc:Compressing logs... 2021-09-19T15:03:43.168 INFO:teuthology.kill:No teuthology processes running 2021-09-19T15:03:44.361 INFO:teuthology.kill:Nuking machines: ['smithi112', 'smithi156'] 2021-09-19T15:03:45.415 INFO:teuthology.kill:2021-09-19 15:03:45,415.415 INFO:teuthology.nuke:targets: 2021-09-19T15:03:45.416 INFO:teuthology.kill: smithi112.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnNHWRgy1o8403hd+zUzwW5LQxJR0JNuOeKqAcurmdjXq8n6bPl6S343Nw/tcyL6bSLIA/PKcD7zObwJOVkR+Od/XcfxGZUcyc4xx5fKaHZU4+XMFlWyC5whV/BpP4C9x5KYoz0aHCy2vuIrq5z/PnLeBtWpUaoKoeB+i/xjwq9C3C8mbv6efn3G3TwuB42CZ4+v6mb/IsOCq7f3LnSNHyMJAukHxk+CoB1D+AT/ij65Q0iQkMt+JZTnq1vjFlZ5ISHrxiQpX0vJ7iZH8DaOr1TvQuDQaKZ/IZ3hec9gCM9AX3Ax1uk8yBTQ6BSz7sWczn2OScY10dXHwFMkNKQfx6oBh4ctpYd47STxlUTShLSoW7mZiNnZpL8TjWiCWJGLLlWMmhNzNZ6qHy31oBPtvr4AyDVnRr76hughNJwuT1CGIUoBBkUJmvnZ1OKnmiXAw1V1wd6XmleMqgER+ygaspDkCymnUGWH7YJrNijGorJXyIgLbR3C17bzup8M3skhE= 2021-09-19T15:03:45.416 INFO:teuthology.kill: smithi156.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDIIr5Xw1tfW0whJfnLtMCgjRSH05vT3UTcIvC7oVRHQFIL9ws3HgiIoEib1Jy4FIX5GCXdXDVTC94xylqXCxanEycfefzX0knArbPB/qCq6lTx3k7RpoMPq79W67Xs2+fqnT3JwDYkIUcPnB5HMW8/eizd1Fx8CQZg8fzZuaow+y47OMhgvmd4m+VR85Y5M0FtXrh3yrhgCt8Kf3eh/uc3SNWaQ206doyBpNW4uwT8bRkPGw1qGo4iwr/kwLA9LKhSaC05brxuoqwMbQRqZQQ586U7dN90gz+LHUoTcbN0rAbLJv1Zl49WXlkihRZaasdkAhIJsyr5as6d4XQbvPLKKbU73JvpuswsvpvfIGbtwB/4wR5J7km5Ks91i7doIcSuvSeBBLXGvhUer7qaV0jVpDgwpE5spl9NVtub+yy67XvdFEr2M61D5HYr79LP6sOm/0PGEDqMYHRaJ9bJVZDKXorM/TXXar/ivxXRW3BviSNZwVMyc0Cm66WkK7e/s1k= 2021-09-19T15:03:45.437 INFO:teuthology.kill:2021-09-19 15:03:45,437.437 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-09-19T15:03:45.441 INFO:teuthology.kill:2021-09-19 15:03:45,440.440 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-09-19T15:03:45.502 INFO:teuthology.kill:2021-09-19 15:03:45,501.501 INFO:teuthology.orchestra.console:Power off smithi156 2021-09-19T15:03:45.517 INFO:teuthology.kill:2021-09-19 15:03:45,517.517 INFO:teuthology.orchestra.console:Power off smithi112 2021-09-19T15:03:53.878 INFO:teuthology.kill:2021-09-19 15:03:53,877.877 INFO:teuthology.orchestra.console:Power off for smithi156 completed 2021-09-19T15:03:54.020 INFO:teuthology.kill:2021-09-19 15:03:54,019.019 INFO:teuthology.lock.ops:unlocked smithi156.front.sepia.ceph.com 2021-09-19T15:03:58.010 INFO:teuthology.kill:2021-09-19 15:03:58,009.009 INFO:teuthology.orchestra.console:Power off for smithi112 completed 2021-09-19T15:03:58.147 INFO:teuthology.kill:2021-09-19 15:03:58,147.147 INFO:teuthology.lock.ops:unlocked smithi112.front.sepia.ceph.com 2021-09-19T15:05:58.450 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-09-19T15:05:58.554 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2021-09-19T15:05:58.555 INFO:teuthology.nuke:Checking targets against current locks 2021-09-19T15:05:58.648 INFO:teuthology.nuke:Not nuking smithi112.front.sepia.ceph.com because description doesn't match 2021-09-19T15:05:58.649 INFO:teuthology.nuke:Not nuking smithi156.front.sepia.ceph.com because description doesn't match