2021-02-08T09:08:24.525 INFO:root:teuthology version: 1.1.0-17c09965 2021-02-08T09:08:24.629 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi008.front.sepia.ceph.com' reimaging 2021-02-08T09:08:24.629 INFO:teuthology.lock.ops:Updating [ubuntu@smithi008.front.sepia.ceph.com]: reset os type and version on server 2021-02-08T09:08:24.629 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2021-02-08T09:08:24.648 INFO:teuthology.lock.ops:Node 'ubuntu@smithi008.front.sepia.ceph.com' reimaging is complete 2021-02-08T09:08:24.648 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi081.front.sepia.ceph.com' reimaging 2021-02-08T09:08:24.649 INFO:teuthology.lock.ops:Updating [ubuntu@smithi081.front.sepia.ceph.com]: reset os type and version on server 2021-02-08T09:08:24.649 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2021-02-08T09:08:24.667 INFO:teuthology.lock.ops:Node 'ubuntu@smithi081.front.sepia.ceph.com' reimaging is complete 2021-02-08T09:08:24.868 INFO:teuthology.provision.fog.smithi008:Scheduling deploy of ubuntu 18.04 2021-02-08T09:08:24.880 INFO:teuthology.provision.fog.smithi081:Scheduling deploy of ubuntu 18.04 2021-02-08T09:08:25.196 INFO:teuthology.orchestra.console:Power off smithi008 2021-02-08T09:08:25.245 INFO:teuthology.orchestra.console:Power off smithi081 2021-02-08T09:08:33.616 INFO:teuthology.orchestra.console:Power off for smithi081 completed 2021-02-08T09:08:33.717 INFO:teuthology.orchestra.console:Power on smithi081 2021-02-08T09:08:37.722 INFO:teuthology.orchestra.console:Power off for smithi008 completed 2021-02-08T09:08:37.823 INFO:teuthology.orchestra.console:Power on smithi008 2021-02-08T09:08:42.082 INFO:teuthology.orchestra.console:Power on for smithi081 completed 2021-02-08T09:08:42.183 INFO:teuthology.provision.fog.smithi081:Waiting for deploy to finish 2021-02-08T09:08:46.292 INFO:teuthology.orchestra.console:Power on for smithi008 completed 2021-02-08T09:08:46.392 INFO:teuthology.provision.fog.smithi008:Waiting for deploy to finish 2021-02-08T09:13:07.528 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2021-02-08T09:13:13.574 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2021-02-08T09:13:19.588 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2021-02-08T09:13:26.604 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2021-02-08T09:13:32.695 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-02-08T09:13:33.162 INFO:teuthology.provision.fog.smithi008:Node is ready 2021-02-08T09:13:33.210 INFO:teuthology.orchestra.run.smithi008.stdout:smithi008.front.sepia.ceph.com 2021-02-08T09:13:33.259 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8 smithi008.front.sepia.ceph.com smithi008 2021-02-08T09:13:33.529 INFO:teuthology.provision.fog.smithi008:Deploy complete! 2021-02-08T09:13:43.740 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-02-08T09:13:44.183 INFO:teuthology.provision.fog.smithi081:Node is ready 2021-02-08T09:13:44.230 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081.front.sepia.ceph.com 2021-02-08T09:13:44.278 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81 smithi081.front.sepia.ceph.com smithi081 2021-02-08T09:13:44.566 INFO:teuthology.provision.fog.smithi081:Deploy complete! 2021-02-08T09:13:44.703 INFO:teuthology.lock.ops:Checking smithi008.front.sepia.ceph.com 2021-02-08T09:13:44.704 INFO:teuthology.lock.ops:New key found. Updating... 2021-02-08T09:13:44.720 INFO:teuthology.lock.ops:Checking smithi081.front.sepia.ceph.com 2021-02-08T09:13:44.720 INFO:teuthology.lock.ops:New key found. Updating... 2021-02-08T09:13:44.733 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: set os type and version on server 2021-02-08T09:13:44.733 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-08T09:13:45.083 INFO:teuthology.orchestra.run.smithi008.stdout:x86_64 2021-02-08T09:13:45.132 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="Ubuntu" 2021-02-08T09:13:45.132 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-02-08T09:13:45.132 INFO:teuthology.orchestra.run.smithi008.stdout:ID=ubuntu 2021-02-08T09:13:45.132 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE=debian 2021-02-08T09:13:45.132 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-02-08T09:13:45.132 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="18.04" 2021-02-08T09:13:45.132 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://www.ubuntu.com/" 2021-02-08T09:13:45.132 INFO:teuthology.orchestra.run.smithi008.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-02-08T09:13:45.132 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-02-08T09:13:45.132 INFO:teuthology.orchestra.run.smithi008.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-02-08T09:13:45.132 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_CODENAME=bionic 2021-02-08T09:13:45.133 INFO:teuthology.orchestra.run.smithi008.stdout:UBUNTU_CODENAME=bionic 2021-02-08T09:13:45.133 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2021-02-08T09:13:45.149 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: set os type and version on server 2021-02-08T09:13:45.149 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-08T09:13:45.462 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2021-02-08T09:13:45.510 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Ubuntu" 2021-02-08T09:13:45.510 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-02-08T09:13:45.510 INFO:teuthology.orchestra.run.smithi081.stdout:ID=ubuntu 2021-02-08T09:13:45.510 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE=debian 2021-02-08T09:13:45.510 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-02-08T09:13:45.510 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="18.04" 2021-02-08T09:13:45.510 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.ubuntu.com/" 2021-02-08T09:13:45.511 INFO:teuthology.orchestra.run.smithi081.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-02-08T09:13:45.511 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-02-08T09:13:45.511 INFO:teuthology.orchestra.run.smithi081.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-02-08T09:13:45.511 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_CODENAME=bionic 2021-02-08T09:13:45.511 INFO:teuthology.orchestra.run.smithi081.stdout:UBUNTU_CODENAME=bionic 2021-02-08T09:13:45.511 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2021-02-08T09:13:45.588 INFO:teuthology.dispatcher.supervisor:Running job 5867232 2021-02-08T09:13:45.588 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_17c099650191e7aa47a7d9f502facca74f9b4d44/virtualenv/bin/teuthology -v --owner scheduled_trociny@teuthology --archive /home/teuthworker/archive/trociny-2021-02-08_07:52:50-rbd-wip-mgolub-testing-distro-basic-smithi/5867232 --name trociny-2021-02-08_07:52:50-rbd-wip-mgolub-testing-distro-basic-smithi --description rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-simple} -- /home/teuthworker/archive/trociny-2021-02-08_07:52:50-rbd-wip-mgolub-testing-distro-basic-smithi/5867232/orig.config.yaml 2021-02-08T09:13:45.591 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/trociny-2021-02-08_07:52:50-rbd-wip-mgolub-testing-distro-basic-smithi/5867232 2021-02-08T09:13:45.592 INFO:teuthology.dispatcher.supervisor:Job PID: 21247 2021-02-08T09:13:45.592 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-02-08T21:14:01.906 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-02-08T21:14:02.125 INFO:teuthology.task.internal:roles: ubuntu@smithi008.front.sepia.ceph.com - ['cluster1.mon.a', 'cluster1.mgr.x', 'cluster2.mgr.x', 'cluster1.osd.0', 'cluster1.osd.1', 'cluster1.osd.2', 'cluster1.client.0', 'cluster2.client.0'] 2021-02-08T21:14:02.125 INFO:teuthology.task.internal:roles: ubuntu@smithi081.front.sepia.ceph.com - ['cluster2.mon.a', 'cluster2.osd.0', 'cluster2.osd.1', 'cluster2.osd.2', 'cluster1.client.mirror', 'cluster1.client.mirror.0', 'cluster1.client.mirror.1', 'cluster1.client.mirror.2', 'cluster1.client.mirror.3', 'cluster1.client.mirror.4', 'cluster1.client.mirror.5', 'cluster1.client.mirror.6', 'cluster2.client.mirror', 'cluster2.client.mirror.0', 'cluster2.client.mirror.1', 'cluster2.client.mirror.2', 'cluster2.client.mirror.3', 'cluster2.client.mirror.4', 'cluster2.client.mirror.5', 'cluster2.client.mirror.6'] 2021-02-08T21:14:02.125 INFO:teuthology.misc:Compressing logs... 2021-02-08T21:14:02.125 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-08T21:14:03.026 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-08T21:14:03.894 INFO:teuthology.misc:Compressing logs... 2021-02-08T21:14:04.034 INFO:teuthology.misc:Compressing logs... 2021-02-08T21:14:07.252 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/cluster1-client.mirror.3.39377.log: file size changed while zipping 2021-02-08T21:14:14.614 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/cluster2-client.mirror.39274.log: file size changed while zipping 2021-02-08T21:14:17.581 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/cluster2-client.mirror.39377.log: file size changed while zipping 2021-02-08T21:14:21.607 INFO:teuthology.orchestra.run.smithi008.stderr:gzip: /var/log/ceph/cluster1-mon.a.log: file size changed while zipping 2021-02-08T21:14:28.542 INFO:teuthology.orchestra.run.smithi008.stderr:gzip: /var/log/ceph/cluster1-mgr.x.log: file size changed while zipping 2021-02-08T21:17:03.452 INFO:teuthology.orchestra.run.smithi008.stderr:gzip: /var/log/ceph/cluster1-osd.1.log: file size changed while zipping 2021-02-08T21:17:55.424 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/cluster2-osd.2.log: file size changed while zipping 2021-02-08T21:19:54.518 INFO:teuthology.orchestra.run.smithi008.stderr:gzip: /var/log/ceph/cluster1-osd.2.log: file size changed while zipping 2021-02-08T21:20:17.615 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/cluster2-osd.1.log: file size changed while zipping 2021-02-08T21:22:36.201 INFO:teuthology.orchestra.run.smithi008.stderr:gzip: /var/log/ceph/cluster1-osd.0.log: file size changed while zipping 2021-02-08T21:22:42.479 INFO:teuthology.orchestra.run.smithi008.stderr:gzip: /var/log/ceph/cluster2-mgr.x.log: file size changed while zipping 2021-02-08T21:24:15.610 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/cluster2-osd.0.log: file size changed while zipping 2021-02-08T21:24:26.656 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/cluster2-mon.a.log: file size changed while zipping 2021-02-08T21:24:31.569 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/cluster2-client.mirror.39302.log: file size changed while zipping 2021-02-08T21:24:34.079 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/cluster1-client.mirror.1.39274.log: file size changed while zipping 2021-02-08T21:24:38.497 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/cluster1-client.mirror.2.39302.log: file size changed while zipping 2021-02-08T21:25:09.714 INFO:teuthology.orchestra.run.smithi008.stderr:tar: ./cluster1.log: file changed as we read it 2021-02-08T21:27:40.848 INFO:teuthology.kill:Killing Pids: {21247} 2021-02-08T21:27:41.955 INFO:teuthology.kill:Nuking machines: ['smithi008', 'smithi081'] 2021-02-08T21:27:42.729 INFO:teuthology.kill:2021-02-08 21:27:42,728.728 INFO:teuthology.nuke:targets: 2021-02-08T21:27:42.729 INFO:teuthology.kill: smithi008.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlSU7WV/Xp+qXiZL9QjCbGg/UNX1+m3YH8GoefwGLlNqFgyLmiRMlvB5hkbamM28DyY+tDYD8YeAmJm7i66E0kWMlI+7H151393uYe2WTOXcY6m7uv/aXUMb2TQNzaVr4FLc1GJPY1PqCHdGnEoluJO1kg6eTsZ+Q4HXA58MpoVFMbUH5eFQ6NiMuridKqAl7uTtkHPVW0i6dmPTr2QWZmaqr8dLPTTpFtLiAcOo5HeVxtk2KZ86jWvm4VGh0h+c3/qhFUcgX2+2LeQsBS41YFfvdEOK17UW0PUEAYsv1r3IN3WwueuHljDh33SSGCaTJ01MqewANpmonXwvag5Bgl 2021-02-08T21:27:42.729 INFO:teuthology.kill: smithi081.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCn7KrEy5q1Vrc2vHbmL0IuwedAQmREjMaT3MVK81LrO1s8f0Y8D9eD2TTUOEACfZUwkXxNlAgvS3CJE38arwRBKx3Q7TIipWYiV2AC4Zx3hC2sBIeXYM0uEWgnN4kb+Z/ohd3LBUe+GPGaox5px+NgSMaDfWkalWXLHYk+sqG5wEG5FxU5wLHDsbdo4U5y78JfgHuFU4EPOjifjebnnEjECTsDRW06GmhXNBWckw0o64M3nQxEqJkIUPJcAsy9h0yMvdxdNgX+0kzl8YIuWJ06+HtSdvQHOX3WZLy5gq08HLIIWOYkatPVtsoew0mJZZmaMwqEGBbZwUftA1VwmtWP 2021-02-08T21:27:42.756 INFO:teuthology.kill:2021-02-08 21:27:42,755.755 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-02-08T21:27:42.759 INFO:teuthology.kill:2021-02-08 21:27:42,758.758 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-02-08T21:27:42.816 INFO:teuthology.kill:2021-02-08 21:27:42,816.816 INFO:teuthology.orchestra.console:Power off smithi008 2021-02-08T21:27:42.828 INFO:teuthology.kill:2021-02-08 21:27:42,828.828 INFO:teuthology.orchestra.console:Power off smithi081 2021-02-08T21:27:51.181 INFO:teuthology.kill:2021-02-08 21:27:51,180.180 INFO:teuthology.orchestra.console:Power off for smithi008 completed 2021-02-08T21:27:51.326 INFO:teuthology.kill:2021-02-08 21:27:51,325.325 INFO:teuthology.lock.ops:unlocked smithi008.front.sepia.ceph.com 2021-02-08T21:27:55.300 INFO:teuthology.kill:2021-02-08 21:27:55,299.299 INFO:teuthology.orchestra.console:Power off for smithi081 completed 2021-02-08T21:27:55.442 INFO:teuthology.kill:2021-02-08 21:27:55,441.441 INFO:teuthology.lock.ops:unlocked smithi081.front.sepia.ceph.com 2021-02-08T21:29:55.635 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-02-08T21:29:55.731 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2021-02-08T21:29:55.732 INFO:teuthology.nuke:Checking targets against current locks 2021-02-08T21:29:55.806 INFO:teuthology.nuke:Not nuking smithi008.front.sepia.ceph.com because description doesn't match 2021-02-08T21:29:55.806 INFO:teuthology.nuke:Not nuking smithi081.front.sepia.ceph.com because description doesn't match