2021-11-07T00:21:12.381 INFO:root:teuthology version: 1.1.0-c56135d1 2021-11-07T00:21:12.501 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba017.front.sepia.ceph.com' reimaging 2021-11-07T00:21:12.502 INFO:teuthology.lock.ops:Updating [ubuntu@gibba017.front.sepia.ceph.com]: reset os type and version on server 2021-11-07T00:21:12.502 INFO:teuthology.lock.ops:Updating gibba017.front.sepia.ceph.com on lock server 2021-11-07T00:21:12.521 INFO:teuthology.lock.ops:Node 'ubuntu@gibba017.front.sepia.ceph.com' reimaging is complete 2021-11-07T00:21:12.521 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba019.front.sepia.ceph.com' reimaging 2021-11-07T00:21:12.522 INFO:teuthology.lock.ops:Updating [ubuntu@gibba019.front.sepia.ceph.com]: reset os type and version on server 2021-11-07T00:21:12.522 INFO:teuthology.lock.ops:Updating gibba019.front.sepia.ceph.com on lock server 2021-11-07T00:21:12.544 INFO:teuthology.lock.ops:Node 'ubuntu@gibba019.front.sepia.ceph.com' reimaging is complete 2021-11-07T00:21:12.747 INFO:teuthology.provision.fog.gibba017:Scheduling deploy of ubuntu 20.04 2021-11-07T00:21:12.751 INFO:teuthology.provision.fog.gibba019:Scheduling deploy of ubuntu 20.04 2021-11-07T00:21:13.070 INFO:teuthology.orchestra.console:Power off gibba019 2021-11-07T00:21:13.084 INFO:teuthology.orchestra.console:Power off gibba017 2021-11-07T00:21:21.450 INFO:teuthology.orchestra.console:Power off for gibba019 completed 2021-11-07T00:21:21.455 INFO:teuthology.orchestra.console:Power off for gibba017 completed 2021-11-07T00:21:21.552 INFO:teuthology.orchestra.console:Power on gibba019 2021-11-07T00:21:21.561 INFO:teuthology.orchestra.console:Power on gibba017 2021-11-07T00:21:29.939 INFO:teuthology.orchestra.console:Power on for gibba019 completed 2021-11-07T00:21:29.944 INFO:teuthology.orchestra.console:Power on for gibba017 completed 2021-11-07T00:21:30.041 INFO:teuthology.provision.fog.gibba019:Waiting for deploy to finish 2021-11-07T00:21:30.045 INFO:teuthology.provision.fog.gibba017:Waiting for deploy to finish 2021-11-07T00:26:19.249 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-11-07T00:26:19.678 INFO:teuthology.provision.fog.gibba019:Node is ready 2021-11-07T00:26:19.683 INFO:teuthology.orchestra.run.gibba019.stdout:gibba019.front.sepia.ceph.com 2021-11-07T00:26:19.688 INFO:teuthology.orchestra.run.gibba019.stdout:172.21.2.119 gibba019.front.sepia.ceph.com gibba019 2021-11-07T00:26:19.843 INFO:teuthology.provision.fog.gibba019:Deploy complete! 2021-11-07T00:27:02.999 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-11-07T00:27:03.438 INFO:teuthology.provision.fog.gibba017:Node is ready 2021-11-07T00:27:03.488 INFO:teuthology.orchestra.run.gibba017.stdout:gibba017.front.sepia.ceph.com 2021-11-07T00:27:03.496 INFO:teuthology.orchestra.run.gibba017.stdout:172.21.2.117 gibba017.front.sepia.ceph.com gibba017 2021-11-07T00:27:03.657 INFO:teuthology.provision.fog.gibba017:Deploy complete! 2021-11-07T00:27:03.814 INFO:teuthology.lock.ops:Checking gibba017.front.sepia.ceph.com 2021-11-07T00:27:03.814 INFO:teuthology.lock.ops:New key found. Updating... 2021-11-07T00:27:03.833 INFO:teuthology.lock.ops:Checking gibba019.front.sepia.ceph.com 2021-11-07T00:27:03.834 INFO:teuthology.lock.ops:New key found. Updating... 2021-11-07T00:27:03.852 INFO:teuthology.lock.ops:Updating [gibba017.front.sepia.ceph.com]: set os type and version on server 2021-11-07T00:27:03.853 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba017.front.sepia.ceph.com' 2021-11-07T00:27:04.115 INFO:teuthology.orchestra.run.gibba017.stdout:x86_64 2021-11-07T00:27:04.123 INFO:teuthology.orchestra.run.gibba017.stdout:NAME="Ubuntu" 2021-11-07T00:27:04.123 INFO:teuthology.orchestra.run.gibba017.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-11-07T00:27:04.123 INFO:teuthology.orchestra.run.gibba017.stdout:ID=ubuntu 2021-11-07T00:27:04.124 INFO:teuthology.orchestra.run.gibba017.stdout:ID_LIKE=debian 2021-11-07T00:27:04.124 INFO:teuthology.orchestra.run.gibba017.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-11-07T00:27:04.124 INFO:teuthology.orchestra.run.gibba017.stdout:VERSION_ID="20.04" 2021-11-07T00:27:04.124 INFO:teuthology.orchestra.run.gibba017.stdout:HOME_URL="https://www.ubuntu.com/" 2021-11-07T00:27:04.125 INFO:teuthology.orchestra.run.gibba017.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-11-07T00:27:04.125 INFO:teuthology.orchestra.run.gibba017.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-11-07T00:27:04.125 INFO:teuthology.orchestra.run.gibba017.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-11-07T00:27:04.125 INFO:teuthology.orchestra.run.gibba017.stdout:VERSION_CODENAME=focal 2021-11-07T00:27:04.126 INFO:teuthology.orchestra.run.gibba017.stdout:UBUNTU_CODENAME=focal 2021-11-07T00:27:04.127 INFO:teuthology.lock.ops:Updating gibba017.front.sepia.ceph.com on lock server 2021-11-07T00:27:04.147 INFO:teuthology.lock.ops:Updating [gibba019.front.sepia.ceph.com]: set os type and version on server 2021-11-07T00:27:04.148 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba019.front.sepia.ceph.com' 2021-11-07T00:27:04.329 INFO:teuthology.orchestra.run.gibba019.stdout:x86_64 2021-11-07T00:27:04.376 INFO:teuthology.orchestra.run.gibba019.stdout:NAME="Ubuntu" 2021-11-07T00:27:04.376 INFO:teuthology.orchestra.run.gibba019.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-11-07T00:27:04.376 INFO:teuthology.orchestra.run.gibba019.stdout:ID=ubuntu 2021-11-07T00:27:04.377 INFO:teuthology.orchestra.run.gibba019.stdout:ID_LIKE=debian 2021-11-07T00:27:04.377 INFO:teuthology.orchestra.run.gibba019.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-11-07T00:27:04.377 INFO:teuthology.orchestra.run.gibba019.stdout:VERSION_ID="20.04" 2021-11-07T00:27:04.377 INFO:teuthology.orchestra.run.gibba019.stdout:HOME_URL="https://www.ubuntu.com/" 2021-11-07T00:27:04.378 INFO:teuthology.orchestra.run.gibba019.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-11-07T00:27:04.378 INFO:teuthology.orchestra.run.gibba019.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-11-07T00:27:04.378 INFO:teuthology.orchestra.run.gibba019.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-11-07T00:27:04.378 INFO:teuthology.orchestra.run.gibba019.stdout:VERSION_CODENAME=focal 2021-11-07T00:27:04.379 INFO:teuthology.orchestra.run.gibba019.stdout:UBUNTU_CODENAME=focal 2021-11-07T00:27:04.379 INFO:teuthology.lock.ops:Updating gibba019.front.sepia.ceph.com on lock server 2021-11-07T00:27:04.476 INFO:teuthology.dispatcher.supervisor:Running job 6471756 2021-11-07T00:27:04.477 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2021-11-01_02:01:02-rbd-master-distro-default-gibba/6471756 --name teuthology-2021-11-01_02:01:02-rbd-master-distro-default-gibba --description rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} -- /home/teuthworker/archive/teuthology-2021-11-01_02:01:02-rbd-master-distro-default-gibba/6471756/orig.config.yaml 2021-11-07T00:27:04.480 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2021-11-01_02:01:02-rbd-master-distro-default-gibba/6471756 2021-11-07T00:27:04.481 INFO:teuthology.dispatcher.supervisor:Job PID: 15320 2021-11-07T00:27:04.481 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-11-07T12:27:58.723 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-11-07T12:27:58.926 INFO:teuthology.kill:Killing Pids: {15320} 2021-11-07T12:28:00.180 INFO:teuthology.task.internal:roles: ubuntu@gibba017.front.sepia.ceph.com - ['cluster1.mon.a', 'cluster1.mgr.x', 'cluster2.mgr.x', 'cluster1.osd.0', 'cluster1.osd.1', 'cluster1.osd.2', 'cluster1.client.0', 'cluster2.client.0'] 2021-11-07T12:28:00.182 INFO:teuthology.task.internal:roles: ubuntu@gibba019.front.sepia.ceph.com - ['cluster2.mon.a', 'cluster2.osd.0', 'cluster2.osd.1', 'cluster2.osd.2', 'cluster1.client.mirror', 'cluster1.client.mirror.0', 'cluster1.client.mirror.1', 'cluster1.client.mirror.2', 'cluster1.client.mirror.3', 'cluster1.client.mirror.4', 'cluster1.client.mirror.5', 'cluster1.client.mirror.6', 'cluster2.client.mirror', 'cluster2.client.mirror.0', 'cluster2.client.mirror.1', 'cluster2.client.mirror.2', 'cluster2.client.mirror.3', 'cluster2.client.mirror.4', 'cluster2.client.mirror.5', 'cluster2.client.mirror.6'] 2021-11-07T12:28:00.182 INFO:teuthology.misc:Compressing logs... 2021-11-07T12:28:00.183 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba017.front.sepia.ceph.com' 2021-11-07T12:28:00.490 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba019.front.sepia.ceph.com' 2021-11-07T12:28:00.766 INFO:teuthology.misc:Compressing logs... 2021-11-07T12:28:33.513 INFO:teuthology.misc:Compressing logs... 2021-11-07T12:29:17.887 INFO:teuthology.orchestra.run.gibba019.stderr:gzip: /var/log/ceph/cluster1-client.mirror.1.27472.log: file size changed while zipping 2021-11-07T12:31:12.369 INFO:teuthology.kill:No teuthology processes running 2021-11-07T12:31:13.520 INFO:teuthology.kill:Nuking machines: ['gibba017', 'gibba019'] 2021-11-07T12:31:14.497 INFO:teuthology.kill:2021-11-07 12:31:14,497.497 INFO:teuthology.nuke:targets: 2021-11-07T12:31:14.498 INFO:teuthology.kill: gibba017.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3U89kZUqMJ3WkEtXtDlKChIS1DVJUIa2YrkpbjkudgCqFa9y76NmCoTZ5qXwIu/zbuoVayiHbtKns2kiwKkIBE1g9HVS0Qp035nB3dFNXUdBxsVUcPiebyM1zgFvadSocUlFXRQ1NDCh9X+ak/nOfUb6ufDwUm6I0vqfDjwjSb3iFnViak1WyFvWMiA6UC/AQPpFtkPHeSeVquC+NUCbVxD+XlHvgM8VFmWxPDkhHX8mMQnFWuJzDtCENTxlkLAyTt+PfDXMC/0Qirr5g9SAyqu/HlbZComNP9zMvcjBJesANbp5ddabAap9PhcQJPPr/rZtkCFD1dHXnSUSl9xXmxjIvLJnyf+bBgP/Nb/IswJAEYAq8l2PYbRqTuDXqcb9NwKu74+Vm0V8/x5gP2URKofDQX1ez0VLBfc5kxxmixE77NQ1mIHD7jXl0vEb0aswvpTEtxmUkgBo/cGe1PdukpIpKTTWLf4cCc+EhfaPD4+7duGCbLpQMOsNy5NqE5cM= 2021-11-07T12:31:14.498 INFO:teuthology.kill: gibba019.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCyTJ29YhBz4EjbCTi9NshNXqtjpZT1Et+a2aJgozvAnlnKypEEvp+PltFM0TJzdixLZC+K3Eu+vhtpL3Z9Cu7UoPLgyzm6x8O1kLdNVCXjBorH1WK5P40ykFlAd9h3agQsI+U1QS7ceknVdY8aHGmUVZ5xtew3ibH240hDFh2AcJXrc/xjEBaON6cSMVKLCg8gaTfGY8ta08g7CAR0WPpV/CRdbKHiyQiWHpiCCk8P7GOlTdignO7WwJZd2tEraD1j1iPFMZeu1Uk4nNlxRzBOBKrWS2BDtbpmnQ+Y9QxltL1hUCQHHgrvDXZDNkrTA504trs5FoWNrCxgvjywr2xuv8pVCxs797veSg9MLdjnjuI5/2c5jue//q4nshuF7JLxdUY8CkhDVTkAmdlsJGCRUvWvyXVpwCeSdSqqh5y/aCoR0NUw2MFzCnscSSdy+DhcU5ab7CnJVJnDAHYbcP2Xoara7nqhzpYru+R9EuUMEDOD5j620Fcozkk9yPA1zq8= 2021-11-07T12:31:14.526 INFO:teuthology.kill:2021-11-07 12:31:14,525.525 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-11-07T12:31:14.528 INFO:teuthology.kill:2021-11-07 12:31:14,528.528 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-11-07T12:31:14.605 INFO:teuthology.kill:2021-11-07 12:31:14,604.604 INFO:teuthology.orchestra.console:Power off gibba019 2021-11-07T12:31:14.621 INFO:teuthology.kill:2021-11-07 12:31:14,621.621 INFO:teuthology.orchestra.console:Power off gibba017 2021-11-07T12:31:22.989 INFO:teuthology.kill:2021-11-07 12:31:22,989.989 INFO:teuthology.orchestra.console:Power off for gibba019 completed 2021-11-07T12:31:23.006 INFO:teuthology.kill:2021-11-07 12:31:23,005.005 INFO:teuthology.orchestra.console:Power off for gibba017 completed 2021-11-07T12:31:23.140 INFO:teuthology.kill:2021-11-07 12:31:23,140.140 INFO:teuthology.lock.ops:unlocked: gibba019.front.sepia.ceph.com 2021-11-07T12:31:23.147 INFO:teuthology.kill:2021-11-07 12:31:23,147.147 INFO:teuthology.lock.ops:unlocked: gibba017.front.sepia.ceph.com 2021-11-07T12:33:23.452 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-11-07T12:33:23.588 WARNING:teuthology.dispatcher.supervisor:Was going to unlock gibba017 but it was locked by another job: /home/teuthworker/archive/teuthology-2021-11-01_05:05:03-rgw-octopus-distro-default-gibba/6471992 2021-11-07T12:33:23.588 WARNING:teuthology.dispatcher.supervisor:Was going to unlock gibba019 but it was locked by another job: /home/teuthworker/archive/teuthology-2021-11-01_05:05:03-rgw-octopus-distro-default-gibba/6471992