2021-12-07T13:23:31.635 INFO:root:teuthology version: 1.1.0-844d1377 2021-12-07T13:23:31.767 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi142.front.sepia.ceph.com' reimaging 2021-12-07T13:23:31.768 INFO:teuthology.lock.ops:Updating [ubuntu@smithi142.front.sepia.ceph.com]: reset os type and version on server 2021-12-07T13:23:31.769 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2021-12-07T13:23:31.787 INFO:teuthology.lock.ops:Node 'ubuntu@smithi142.front.sepia.ceph.com' reimaging is complete 2021-12-07T13:23:31.788 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi184.front.sepia.ceph.com' reimaging 2021-12-07T13:23:31.788 INFO:teuthology.lock.ops:Updating [ubuntu@smithi184.front.sepia.ceph.com]: reset os type and version on server 2021-12-07T13:23:31.788 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2021-12-07T13:23:31.806 INFO:teuthology.lock.ops:Node 'ubuntu@smithi184.front.sepia.ceph.com' reimaging is complete 2021-12-07T13:23:32.011 INFO:teuthology.provision.fog.smithi142:Scheduling deploy of ubuntu 20.04 2021-12-07T13:23:32.048 INFO:teuthology.provision.fog.smithi184:Scheduling deploy of ubuntu 20.04 2021-12-07T13:23:32.528 INFO:teuthology.orchestra.console:Power off smithi184 2021-12-07T13:23:32.543 INFO:teuthology.orchestra.console:Power off smithi142 2021-12-07T13:23:40.902 INFO:teuthology.orchestra.console:Power off for smithi184 completed 2021-12-07T13:23:40.907 INFO:teuthology.orchestra.console:Power off for smithi142 completed 2021-12-07T13:23:41.005 INFO:teuthology.orchestra.console:Power on smithi184 2021-12-07T13:23:41.013 INFO:teuthology.orchestra.console:Power on smithi142 2021-12-07T13:23:49.369 INFO:teuthology.orchestra.console:Power on for smithi184 completed 2021-12-07T13:23:49.375 INFO:teuthology.orchestra.console:Power on for smithi142 completed 2021-12-07T13:23:49.472 INFO:teuthology.provision.fog.smithi184:Waiting for deploy to finish 2021-12-07T13:23:49.475 INFO:teuthology.provision.fog.smithi142:Waiting for deploy to finish 2021-12-07T13:29:11.323 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-12-07T13:29:11.885 INFO:teuthology.provision.fog.smithi142:Node is ready 2021-12-07T13:29:11.892 INFO:teuthology.orchestra.run.smithi142.stdout:smithi142.front.sepia.ceph.com 2021-12-07T13:29:11.941 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142 smithi142.front.sepia.ceph.com smithi142 2021-12-07T13:29:12.159 INFO:teuthology.provision.fog.smithi142:Deploy complete! 2021-12-07T13:29:12.644 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-12-07T13:29:13.203 INFO:teuthology.provision.fog.smithi184:Node is ready 2021-12-07T13:29:13.253 INFO:teuthology.orchestra.run.smithi184.stdout:smithi184.front.sepia.ceph.com 2021-12-07T13:29:13.261 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.15.184 smithi184.front.sepia.ceph.com smithi184 2021-12-07T13:29:13.416 INFO:teuthology.provision.fog.smithi184:Deploy complete! 2021-12-07T13:29:13.596 INFO:teuthology.lock.ops:Checking smithi142.front.sepia.ceph.com 2021-12-07T13:29:13.597 INFO:teuthology.lock.ops:New key found. Updating... 2021-12-07T13:29:13.615 INFO:teuthology.lock.ops:Checking smithi184.front.sepia.ceph.com 2021-12-07T13:29:13.616 INFO:teuthology.lock.ops:New key found. Updating... 2021-12-07T13:29:13.633 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: set os type and version on server 2021-12-07T13:29:13.634 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2021-12-07T13:29:13.827 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2021-12-07T13:29:13.835 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="Ubuntu" 2021-12-07T13:29:13.835 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-12-07T13:29:13.835 INFO:teuthology.orchestra.run.smithi142.stdout:ID=ubuntu 2021-12-07T13:29:13.836 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE=debian 2021-12-07T13:29:13.836 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-12-07T13:29:13.836 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="20.04" 2021-12-07T13:29:13.836 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://www.ubuntu.com/" 2021-12-07T13:29:13.836 INFO:teuthology.orchestra.run.smithi142.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-12-07T13:29:13.837 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-12-07T13:29:13.837 INFO:teuthology.orchestra.run.smithi142.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-12-07T13:29:13.837 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_CODENAME=focal 2021-12-07T13:29:13.837 INFO:teuthology.orchestra.run.smithi142.stdout:UBUNTU_CODENAME=focal 2021-12-07T13:29:13.839 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2021-12-07T13:29:13.857 INFO:teuthology.lock.ops:Updating [smithi184.front.sepia.ceph.com]: set os type and version on server 2021-12-07T13:29:13.857 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2021-12-07T13:29:14.034 INFO:teuthology.orchestra.run.smithi184.stdout:x86_64 2021-12-07T13:29:14.041 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="Ubuntu" 2021-12-07T13:29:14.041 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-12-07T13:29:14.041 INFO:teuthology.orchestra.run.smithi184.stdout:ID=ubuntu 2021-12-07T13:29:14.041 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE=debian 2021-12-07T13:29:14.041 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-12-07T13:29:14.042 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="20.04" 2021-12-07T13:29:14.042 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://www.ubuntu.com/" 2021-12-07T13:29:14.042 INFO:teuthology.orchestra.run.smithi184.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-12-07T13:29:14.042 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-12-07T13:29:14.043 INFO:teuthology.orchestra.run.smithi184.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-12-07T13:29:14.043 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_CODENAME=focal 2021-12-07T13:29:14.043 INFO:teuthology.orchestra.run.smithi184.stdout:UBUNTU_CODENAME=focal 2021-12-07T13:29:14.043 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2021-12-07T13:29:14.155 INFO:teuthology.dispatcher.supervisor:Running job 6547959 2021-12-07T13:29:14.155 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2021-12-06_16:41:40-rados-WIP_GBH_safe_fast_shutdown_2-distro-basic-smithi/6547959 --name benhanokh-2021-12-06_16:41:40-rados-WIP_GBH_safe_fast_shutdown_2-distro-basic-smithi --description rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} -- /home/teuthworker/archive/benhanokh-2021-12-06_16:41:40-rados-WIP_GBH_safe_fast_shutdown_2-distro-basic-smithi/6547959/orig.config.yaml 2021-12-07T13:29:14.159 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2021-12-06_16:41:40-rados-WIP_GBH_safe_fast_shutdown_2-distro-basic-smithi/6547959 2021-12-07T13:29:14.160 INFO:teuthology.dispatcher.supervisor:Job PID: 18355 2021-12-07T13:29:14.161 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-12-08T01:30:08.675 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-12-08T01:30:08.935 INFO:teuthology.kill:Killing Pids: {18355} 2021-12-08T01:30:10.151 INFO:teuthology.task.internal:roles: ubuntu@smithi142.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2021-12-08T01:30:10.152 INFO:teuthology.task.internal:roles: ubuntu@smithi184.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2021-12-08T01:30:10.152 INFO:teuthology.misc:Compressing logs... 2021-12-08T01:30:10.153 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2021-12-08T01:30:10.326 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2021-12-08T01:30:10.667 INFO:teuthology.misc:Compressing logs... 2021-12-08T01:30:20.367 INFO:teuthology.misc:Compressing logs... 2021-12-08T01:30:44.482 INFO:teuthology.kill:No teuthology processes running 2021-12-08T01:30:45.792 INFO:teuthology.kill:Nuking machines: ['smithi142', 'smithi184'] 2021-12-08T01:30:46.778 INFO:teuthology.kill:2021-12-08 01:30:46,778.778 INFO:teuthology.nuke:targets: 2021-12-08T01:30:46.779 INFO:teuthology.kill: smithi142.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBXav7C4C5BU2W0AyEAxDwReUhfz0glxfNT7js6PO9VxjoQgk7HtFtsrTwtOUTPOXzpDv/yO3ks4yMZz/hfynwhqdj5pqVXOFUsNwCWXaZ5rLRCkOI6QMXVhl+qx1lxFVGK5xZQI9DTPkpvDKRIs64AN37qCgOmfhhF+hi1mR53QXTLGSTPiGRUXqo0BRo3UfmYfibi1RrcO9kSIrih+kypUm+KjWrVtYcQNcZ6ZSPF156lufUaUt8sRvmwCryRJz6voFBIa5hc/PgJLNYCGed7Hwl1NC/HX3whSzIERydSkhR4SSzC4nLY6SNAq3QRBNNChQV70xVSb75qO5CGUMbJjaMf1zEBYBPwwF31ljJLdDk+tCtayQHREOelv6yq+II9/n9qKdFVA4p4tSRbCgPhSfR+//W1pyiQFdDCsrBqQZfahVD626+h0+ZZaKzr2/RoSkLgI1FDIE77Iw+IDkCede4TC6P6LOeKpjDABbRZGitxdtViKt4QWx/CF4ajCE= 2021-12-08T01:30:46.780 INFO:teuthology.kill: smithi184.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8NXeGOZIljv2CgrzWH/19U0kWukPBvrpVRKvK8w0DpIqErPyvTLsDdOCGWHpyCj/hYx5Z/c1ShHYcIQrjt5fQ8Pp/gcfd0NzzJhFuw1VaQ8PfP/U4STBAzWbS1SjwZtpp/nU01MwqYIqRXU3rIIVnJGEKIXlHVY03cfTLl31mmiZwl5vjHN5/47iHwkyoN68iWlK/4V+xqmO5p+cMzXGP09pMETm/fahw/EGyErRtp8dxglHnKdPYOb0vG1EGXatWjDOjuixzJBSsk2Hb0UZ+qSbXyaPNKK537RS1Tf7VF5y4ype41PmUA4eBc8zaGOIuqusqu6vV1f14km99mNhQ0mmK2SlFR4/m07EcbHHQ1CQCz41LD4SHrS2GIpAF/24r2ecac9CufCC5FC9+urSHGsXl+svuaEQNXwJVItWNCMz30bJP9ceOwn915aGYxMasCHqOf9gITPrg8OElavQgX3gUPBBrI/kBeHAst5oTKuKNngmEWWadyAoBpzHCxwk= 2021-12-08T01:30:46.804 INFO:teuthology.kill:2021-12-08 01:30:46,804.804 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-12-08T01:30:46.807 INFO:teuthology.kill:2021-12-08 01:30:46,807.807 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-12-08T01:30:46.884 INFO:teuthology.kill:2021-12-08 01:30:46,884.884 INFO:teuthology.orchestra.console:Power off smithi184 2021-12-08T01:30:46.899 INFO:teuthology.kill:2021-12-08 01:30:46,899.899 INFO:teuthology.orchestra.console:Power off smithi142 2021-12-08T01:30:55.254 INFO:teuthology.kill:2021-12-08 01:30:55,254.254 INFO:teuthology.orchestra.console:Power off for smithi184 completed 2021-12-08T01:30:55.410 INFO:teuthology.kill:2021-12-08 01:30:55,409.409 INFO:teuthology.lock.ops:unlocked: smithi184.front.sepia.ceph.com 2021-12-08T01:30:59.373 INFO:teuthology.kill:2021-12-08 01:30:59,373.373 INFO:teuthology.orchestra.console:Power off for smithi142 completed 2021-12-08T01:30:59.520 INFO:teuthology.kill:2021-12-08 01:30:59,520.520 INFO:teuthology.lock.ops:unlocked: smithi142.front.sepia.ceph.com 2021-12-08T01:32:59.830 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-12-08T01:32:59.930 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi142 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-12-07_16:02:55-rados-wip-yuri11-testing-2021-12-06-1619-distro-default-smithi/6550973 2021-12-08T01:32:59.930 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi184 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-12-07_16:02:55-rados-wip-yuri11-testing-2021-12-06-1619-distro-default-smithi/6550973