2021-09-18T21:22:53.374 INFO:root:teuthology version: 1.1.0-4e1f59de 2021-09-18T21:22:53.475 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi017.front.sepia.ceph.com' reimaging 2021-09-18T21:22:53.476 INFO:teuthology.lock.ops:Updating [ubuntu@smithi017.front.sepia.ceph.com]: reset os type and version on server 2021-09-18T21:22:53.477 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2021-09-18T21:22:53.493 INFO:teuthology.lock.ops:Node 'ubuntu@smithi017.front.sepia.ceph.com' reimaging is complete 2021-09-18T21:22:53.494 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi036.front.sepia.ceph.com' reimaging 2021-09-18T21:22:53.494 INFO:teuthology.lock.ops:Updating [ubuntu@smithi036.front.sepia.ceph.com]: reset os type and version on server 2021-09-18T21:22:53.494 INFO:teuthology.lock.ops:Updating smithi036.front.sepia.ceph.com on lock server 2021-09-18T21:22:53.511 INFO:teuthology.lock.ops:Node 'ubuntu@smithi036.front.sepia.ceph.com' reimaging is complete 2021-09-18T21:22:53.693 INFO:teuthology.provision.fog.smithi017:Scheduling deploy of ubuntu 20.04 2021-09-18T21:22:53.696 INFO:teuthology.provision.fog.smithi036:Scheduling deploy of ubuntu 20.04 2021-09-18T21:22:53.978 INFO:teuthology.orchestra.console:Power off smithi017 2021-09-18T21:22:53.993 INFO:teuthology.orchestra.console:Power off smithi036 2021-09-18T21:23:06.470 INFO:teuthology.orchestra.console:Power off for smithi017 completed 2021-09-18T21:23:06.474 INFO:teuthology.orchestra.console:Power off for smithi036 completed 2021-09-18T21:23:06.572 INFO:teuthology.orchestra.console:Power on smithi017 2021-09-18T21:23:06.580 INFO:teuthology.orchestra.console:Power on smithi036 2021-09-18T21:23:14.937 INFO:teuthology.orchestra.console:Power on for smithi017 completed 2021-09-18T21:23:14.943 INFO:teuthology.orchestra.console:Power on for smithi036 completed 2021-09-18T21:23:15.040 INFO:teuthology.provision.fog.smithi017:Waiting for deploy to finish 2021-09-18T21:23:15.044 INFO:teuthology.provision.fog.smithi036:Waiting for deploy to finish 2021-09-18T21:27:52.645 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-09-18T21:27:52.656 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-09-18T21:27:53.084 INFO:teuthology.provision.fog.smithi036:Node is ready 2021-09-18T21:27:53.090 INFO:teuthology.orchestra.run.smithi036.stdout:smithi036.front.sepia.ceph.com 2021-09-18T21:27:53.095 INFO:teuthology.provision.fog.smithi017:Node is ready 2021-09-18T21:27:53.101 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017.front.sepia.ceph.com 2021-09-18T21:27:53.109 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17 smithi017.front.sepia.ceph.com smithi017 2021-09-18T21:27:53.141 INFO:teuthology.orchestra.run.smithi036.stdout:172.21.15.36 smithi036.front.sepia.ceph.com smithi036 2021-09-18T21:27:53.247 INFO:teuthology.provision.fog.smithi017:Deploy complete! 2021-09-18T21:27:53.330 INFO:teuthology.provision.fog.smithi036:Deploy complete! 2021-09-18T21:27:53.508 INFO:teuthology.lock.ops:Checking smithi017.front.sepia.ceph.com 2021-09-18T21:27:53.509 INFO:teuthology.lock.ops:New key found. Updating... 2021-09-18T21:27:53.526 INFO:teuthology.lock.ops:Checking smithi036.front.sepia.ceph.com 2021-09-18T21:27:53.526 INFO:teuthology.lock.ops:New key found. Updating... 2021-09-18T21:27:53.545 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: set os type and version on server 2021-09-18T21:27:53.546 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2021-09-18T21:27:53.735 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64 2021-09-18T21:27:53.742 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="Ubuntu" 2021-09-18T21:27:53.742 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-09-18T21:27:53.743 INFO:teuthology.orchestra.run.smithi017.stdout:ID=ubuntu 2021-09-18T21:27:53.743 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE=debian 2021-09-18T21:27:53.743 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-09-18T21:27:53.743 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="20.04" 2021-09-18T21:27:53.744 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://www.ubuntu.com/" 2021-09-18T21:27:53.744 INFO:teuthology.orchestra.run.smithi017.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-09-18T21:27:53.744 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-09-18T21:27:53.744 INFO:teuthology.orchestra.run.smithi017.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-09-18T21:27:53.744 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_CODENAME=focal 2021-09-18T21:27:53.745 INFO:teuthology.orchestra.run.smithi017.stdout:UBUNTU_CODENAME=focal 2021-09-18T21:27:53.746 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2021-09-18T21:27:53.761 INFO:teuthology.lock.ops:Updating [smithi036.front.sepia.ceph.com]: set os type and version on server 2021-09-18T21:27:53.762 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi036.front.sepia.ceph.com' 2021-09-18T21:27:53.934 INFO:teuthology.orchestra.run.smithi036.stdout:x86_64 2021-09-18T21:27:53.940 INFO:teuthology.orchestra.run.smithi036.stdout:NAME="Ubuntu" 2021-09-18T21:27:53.940 INFO:teuthology.orchestra.run.smithi036.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-09-18T21:27:53.940 INFO:teuthology.orchestra.run.smithi036.stdout:ID=ubuntu 2021-09-18T21:27:53.941 INFO:teuthology.orchestra.run.smithi036.stdout:ID_LIKE=debian 2021-09-18T21:27:53.941 INFO:teuthology.orchestra.run.smithi036.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-09-18T21:27:53.941 INFO:teuthology.orchestra.run.smithi036.stdout:VERSION_ID="20.04" 2021-09-18T21:27:53.942 INFO:teuthology.orchestra.run.smithi036.stdout:HOME_URL="https://www.ubuntu.com/" 2021-09-18T21:27:53.942 INFO:teuthology.orchestra.run.smithi036.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-09-18T21:27:53.942 INFO:teuthology.orchestra.run.smithi036.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-09-18T21:27:53.943 INFO:teuthology.orchestra.run.smithi036.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-09-18T21:27:53.943 INFO:teuthology.orchestra.run.smithi036.stdout:VERSION_CODENAME=focal 2021-09-18T21:27:53.943 INFO:teuthology.orchestra.run.smithi036.stdout:UBUNTU_CODENAME=focal 2021-09-18T21:27:53.944 INFO:teuthology.lock.ops:Updating smithi036.front.sepia.ceph.com on lock server 2021-09-18T21:27:54.022 INFO:teuthology.dispatcher.supervisor:Running job 6396472 2021-09-18T21:27:54.023 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_4e1f59de82924f116bd6b91664f90ef632c60a3f/virtualenv/bin/teuthology -v --owner scheduled_ozeneva@teuthology --archive /home/teuthworker/archive/ozeneva-2021-09-18_18:19:17-rados-wip-omri-tracer-2-distro-basic-smithi/6396472 --name ozeneva-2021-09-18_18:19:17-rados-wip-omri-tracer-2-distro-basic-smithi --description rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} -- /home/teuthworker/archive/ozeneva-2021-09-18_18:19:17-rados-wip-omri-tracer-2-distro-basic-smithi/6396472/orig.config.yaml 2021-09-18T21:27:54.026 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/ozeneva-2021-09-18_18:19:17-rados-wip-omri-tracer-2-distro-basic-smithi/6396472 2021-09-18T21:27:54.027 INFO:teuthology.dispatcher.supervisor:Job PID: 22954 2021-09-18T21:27:54.027 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-09-19T09:28:44.635 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-09-19T09:28:44.873 INFO:teuthology.kill:Killing Pids: {22954} 2021-09-19T09:28:46.031 INFO:teuthology.task.internal:roles: ubuntu@smithi017.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2021-09-19T09:28:46.032 INFO:teuthology.task.internal:roles: ubuntu@smithi036.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2021-09-19T09:28:46.033 INFO:teuthology.misc:Compressing logs... 2021-09-19T09:28:46.033 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2021-09-19T09:28:46.226 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi036.front.sepia.ceph.com' 2021-09-19T09:28:46.697 INFO:teuthology.misc:Compressing logs... 2021-09-19T09:30:25.127 INFO:teuthology.misc:Compressing logs... 2021-09-19T09:30:28.558 INFO:teuthology.kill:No teuthology processes running 2021-09-19T09:30:29.668 INFO:teuthology.kill:Nuking machines: ['smithi017', 'smithi036'] 2021-09-19T09:30:30.626 INFO:teuthology.kill:2021-09-19 09:30:30,626.626 INFO:teuthology.nuke:targets: 2021-09-19T09:30:30.627 INFO:teuthology.kill: smithi017.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDYauhXuN78PmnYVJK6JE51xTKFg0VMGR82CF+Hqg0s2mAssGGtAGkh/wtJ3iXBRQS8PwRk4TFrpWhCrBudHClQCg0UzmFZCto4cwuMOwHnhKoiTXPvU90TouBXvlNhK/dNIiM91536ZwRgxHHBunwersJYgqaWIaSmu06xQgp9jngalBmYrmfzZm+9N2RpJP5xoofQ//QDAH2Z0wYVfYeuj39LyiSXkYtCH6whcRhnBO3NGrEs7+rW8/i3evnYMFnhJ/WVfJuQ7CksT+IQcC6fM7eo5F1Z0yAtCj34U0mRmjnIV59+jXnqbMuoG6DBKgQlCLuWr/czBDMl2VUVhJS+QKW3S3EZl0WxmLb9tvMlNuRDlbhZNQN7G4ZE4PHScrPwkoNoF5uxhlwYiDDsQOGRZcAjQC4OJKq6qQJdx5iOgzKlxMYHSDIAl8QttxOw5hDLKqPhLDDym/zwoyMqFVbntNuA2C1hMUe3UMRt/F//z0RVrc3i9QDqsj/Ytosswn8= 2021-09-19T09:30:30.627 INFO:teuthology.kill: smithi036.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD1JqZ8Hxw+EJUl2DrNuq2AmODmHJOPmoxYJBg0kgwyyotM0NijYJtDNQSI5zlQF4RKQNBETxj9S+eGXNWtGSctF2qzMuXTLETsiirJnFxeqWM2++Ao+clPVdYhnuHOtRAcoxyScMwr4pHsnfUDgbfTwDbJD+EJaIAoW6tKC8Am3mZ9kJ2mafhe0E0n/tHj/xdjG+beCjyGU3t711mZhKUAO35EQWC2rDFA0+oKA+8qMmgJR3JgWio9SqXqt/nq00jcADbhe/KrXI3oQphkh0C48MQ5/hVivzqwvfjLZx8KoHs06VRXG1uV14t0nrqfxaMxLixlRBXuePbjXHnr3cgHJWBrf9T0vBEsqtiDNiNGDlCGdpxZIpL/DwechDc7McoIzrrB0r+/PbMkzfOObExjah/pkSgcT+SL8P5X/gIzEORi8DUfXMXgYBcMKEQ3KD+qVSLKGF9mDBsoOcUYw6nW5gh7b/dNWgQ83p/ffY1Tgk5vsDImDC0n4w4040oh700= 2021-09-19T09:30:30.648 INFO:teuthology.kill:2021-09-19 09:30:30,648.648 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-09-19T09:30:30.651 INFO:teuthology.kill:2021-09-19 09:30:30,651.651 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-09-19T09:30:30.709 INFO:teuthology.kill:2021-09-19 09:30:30,709.709 INFO:teuthology.orchestra.console:Power off smithi017 2021-09-19T09:30:30.723 INFO:teuthology.kill:2021-09-19 09:30:30,723.723 INFO:teuthology.orchestra.console:Power off smithi036 2021-09-19T09:30:39.089 INFO:teuthology.kill:2021-09-19 09:30:39,089.089 INFO:teuthology.orchestra.console:Power off for smithi036 completed 2021-09-19T09:30:39.230 INFO:teuthology.kill:2021-09-19 09:30:39,229.229 INFO:teuthology.lock.ops:unlocked smithi036.front.sepia.ceph.com 2021-09-19T09:30:43.208 INFO:teuthology.kill:2021-09-19 09:30:43,208.208 INFO:teuthology.orchestra.console:Power off for smithi017 completed 2021-09-19T09:30:43.356 INFO:teuthology.kill:2021-09-19 09:30:43,355.355 INFO:teuthology.lock.ops:unlocked smithi017.front.sepia.ceph.com 2021-09-19T09:32:43.686 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-09-19T09:32:43.793 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2021-09-19T09:32:43.793 INFO:teuthology.nuke:Checking targets against current locks 2021-09-19T09:32:43.879 INFO:teuthology.nuke:Not nuking smithi036.front.sepia.ceph.com because description doesn't match 2021-09-19T09:32:43.879 INFO:teuthology.nuke:Not nuking smithi017.front.sepia.ceph.com because description doesn't match