2022-07-05T20:40:12.631 INFO:root:teuthology version: 1.1.1.dev379+gf58709e3 2022-07-05T20:40:12.909 INFO:teuthology.lock.ops:Start node 'smithi141.front.sepia.ceph.com' reimaging 2022-07-05T20:40:12.912 INFO:teuthology.lock.ops:Updating [smithi141.front.sepia.ceph.com]: reset os type and version on server 2022-07-05T20:40:12.913 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server 2022-07-05T20:40:12.944 INFO:teuthology.lock.ops:Node 'smithi141.front.sepia.ceph.com' reimaging is complete 2022-07-05T20:40:12.945 INFO:teuthology.lock.ops:Start node 'smithi164.front.sepia.ceph.com' reimaging 2022-07-05T20:40:12.945 INFO:teuthology.lock.ops:Updating [smithi164.front.sepia.ceph.com]: reset os type and version on server 2022-07-05T20:40:12.946 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2022-07-05T20:40:13.004 INFO:teuthology.lock.ops:Node 'smithi164.front.sepia.ceph.com' reimaging is complete 2022-07-05T20:40:13.264 INFO:teuthology.provision.fog.smithi141:Scheduling deploy of ubuntu 18.04 2022-07-05T20:40:13.312 INFO:teuthology.provision.fog.smithi164:Scheduling deploy of ubuntu 18.04 2022-07-05T20:40:13.728 INFO:teuthology.orchestra.console:Power off smithi141 2022-07-05T20:40:13.807 INFO:teuthology.orchestra.console:Power off smithi164 2022-07-05T20:40:22.215 INFO:teuthology.orchestra.console:Power off for smithi164 completed 2022-07-05T20:40:22.318 INFO:teuthology.orchestra.console:Power on smithi164 2022-07-05T20:40:26.283 INFO:teuthology.orchestra.console:Power off for smithi141 completed 2022-07-05T20:40:26.385 INFO:teuthology.orchestra.console:Power on smithi141 2022-07-05T20:40:26.681 INFO:teuthology.orchestra.console:Power on for smithi164 completed 2022-07-05T20:40:26.786 INFO:teuthology.provision.fog.smithi164:Waiting for deploy to finish 2022-07-05T20:40:34.831 INFO:teuthology.orchestra.console:Power on for smithi141 completed 2022-07-05T20:40:34.934 INFO:teuthology.provision.fog.smithi141:Waiting for deploy to finish 2022-07-05T20:49:39.298 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2022-07-05T20:49:40.107 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2022-07-05T20:49:46.125 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2022-07-05T20:49:52.142 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2022-07-05T20:50:03.717 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-07-05T20:50:03.959 INFO:teuthology.provision.fog.smithi141:Node is ready 2022-07-05T20:50:04.015 INFO:teuthology.orchestra.run.smithi141.stdout:smithi141.front.sepia.ceph.com 2022-07-05T20:50:04.088 INFO:teuthology.orchestra.run.smithi141.stdout:172.21.15.141 smithi141.front.sepia.ceph.com smithi141 2022-07-05T20:50:04.475 INFO:teuthology.provision.fog.smithi141:Deploy complete! 2022-07-05T20:50:07.504 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-07-05T20:50:07.901 INFO:teuthology.provision.fog.smithi164:Node is ready 2022-07-05T20:50:07.965 INFO:teuthology.orchestra.run.smithi164.stdout:smithi164.front.sepia.ceph.com 2022-07-05T20:50:08.015 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164 smithi164.front.sepia.ceph.com smithi164 2022-07-05T20:50:08.350 INFO:teuthology.provision.fog.smithi164:Deploy complete! 2022-07-05T20:50:08.773 INFO:teuthology.lock.ops:Checking smithi141.front.sepia.ceph.com 2022-07-05T20:50:08.775 INFO:teuthology.lock.ops:New key found. Updating... 2022-07-05T20:50:08.831 INFO:teuthology.lock.ops:Checking smithi164.front.sepia.ceph.com 2022-07-05T20:50:08.831 INFO:teuthology.lock.ops:New key found. Updating... 2022-07-05T20:50:08.856 INFO:teuthology.lock.ops:Updating [smithi141.front.sepia.ceph.com]: set os type and version on server 2022-07-05T20:50:08.857 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2022-07-05T20:50:09.297 INFO:teuthology.orchestra.run.smithi141.stdout:x86_64 2022-07-05T20:50:09.348 INFO:teuthology.orchestra.run.smithi141.stdout:NAME="Ubuntu" 2022-07-05T20:50:09.349 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION="18.04.6 LTS (Bionic Beaver)" 2022-07-05T20:50:09.349 INFO:teuthology.orchestra.run.smithi141.stdout:ID=ubuntu 2022-07-05T20:50:09.350 INFO:teuthology.orchestra.run.smithi141.stdout:ID_LIKE=debian 2022-07-05T20:50:09.350 INFO:teuthology.orchestra.run.smithi141.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS" 2022-07-05T20:50:09.351 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_ID="18.04" 2022-07-05T20:50:09.351 INFO:teuthology.orchestra.run.smithi141.stdout:HOME_URL="https://www.ubuntu.com/" 2022-07-05T20:50:09.352 INFO:teuthology.orchestra.run.smithi141.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-07-05T20:50:09.352 INFO:teuthology.orchestra.run.smithi141.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-07-05T20:50:09.353 INFO:teuthology.orchestra.run.smithi141.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-07-05T20:50:09.353 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_CODENAME=bionic 2022-07-05T20:50:09.353 INFO:teuthology.orchestra.run.smithi141.stdout:UBUNTU_CODENAME=bionic 2022-07-05T20:50:09.355 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server 2022-07-05T20:50:09.380 INFO:teuthology.lock.ops:Updating [smithi164.front.sepia.ceph.com]: set os type and version on server 2022-07-05T20:50:09.381 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2022-07-05T20:50:09.724 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64 2022-07-05T20:50:09.786 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="Ubuntu" 2022-07-05T20:50:09.787 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="18.04.6 LTS (Bionic Beaver)" 2022-07-05T20:50:09.787 INFO:teuthology.orchestra.run.smithi164.stdout:ID=ubuntu 2022-07-05T20:50:09.788 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE=debian 2022-07-05T20:50:09.788 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS" 2022-07-05T20:50:09.790 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="18.04" 2022-07-05T20:50:09.794 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://www.ubuntu.com/" 2022-07-05T20:50:09.796 INFO:teuthology.orchestra.run.smithi164.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-07-05T20:50:09.797 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-07-05T20:50:09.797 INFO:teuthology.orchestra.run.smithi164.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-07-05T20:50:09.797 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_CODENAME=bionic 2022-07-05T20:50:09.797 INFO:teuthology.orchestra.run.smithi164.stdout:UBUNTU_CODENAME=bionic 2022-07-05T20:50:09.798 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2022-07-05T20:50:09.983 INFO:teuthology.dispatcher.supervisor:Running job 6915872 2022-07-05T20:50:09.983 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-07-05_20:26:53-rbd-wip-yuri6-testing-2022-07-04-0712-octopus-distro-default-smithi/6915872 --name yuriw-2022-07-05_20:26:53-rbd-wip-yuri6-testing-2022-07-04-0712-octopus-distro-default-smithi --description rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_18.04} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} -- /home/teuthworker/archive/yuriw-2022-07-05_20:26:53-rbd-wip-yuri6-testing-2022-07-04-0712-octopus-distro-default-smithi/6915872/orig.config.yaml 2022-07-05T20:50:09.990 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-07-05_20:26:53-rbd-wip-yuri6-testing-2022-07-04-0712-octopus-distro-default-smithi/6915872 2022-07-05T20:50:09.991 INFO:teuthology.dispatcher.supervisor:Job PID: 26825 2022-07-05T20:50:09.992 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-07-06T08:50:44.291 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-07-06T08:50:45.812 INFO:teuthology.kill:Killing Pids: {26825} 2022-07-06T08:51:00.463 INFO:teuthology.task.internal:roles: ubuntu@smithi141.front.sepia.ceph.com - ['cluster1.mon.a', 'cluster1.mgr.x', 'cluster2.mgr.x', 'cluster1.osd.0', 'cluster1.osd.1', 'cluster1.osd.2', 'cluster1.client.0', 'cluster2.client.0'] 2022-07-06T08:51:00.465 INFO:teuthology.task.internal:roles: ubuntu@smithi164.front.sepia.ceph.com - ['cluster2.mon.a', 'cluster2.osd.0', 'cluster2.osd.1', 'cluster2.osd.2', 'cluster1.client.mirror', 'cluster1.client.mirror.0', 'cluster1.client.mirror.1', 'cluster1.client.mirror.2', 'cluster1.client.mirror.3', 'cluster1.client.mirror.4', 'cluster1.client.mirror.5', 'cluster1.client.mirror.6', 'cluster2.client.mirror', 'cluster2.client.mirror.0', 'cluster2.client.mirror.1', 'cluster2.client.mirror.2', 'cluster2.client.mirror.3', 'cluster2.client.mirror.4', 'cluster2.client.mirror.5', 'cluster2.client.mirror.6'] 2022-07-06T08:51:00.473 INFO:teuthology.misc:Compressing logs... 2022-07-06T08:51:00.475 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2022-07-06T08:51:01.362 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2022-07-06T08:51:02.499 INFO:teuthology.misc:Compressing logs... 2022-07-06T08:51:02.752 INFO:teuthology.misc:Compressing logs... 2022-07-06T09:01:50.218 INFO:teuthology.kill:No teuthology processes running 2022-07-06T09:01:52.796 INFO:teuthology.kill:Nuking machines: ['smithi141', 'smithi164'] 2022-07-06T09:01:55.370 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-07-06T09:01:55.371 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-07-06T09:01:55.372 INFO:teuthology.kill:2022-07-06 09:01:55,366.366 INFO:teuthology.nuke:targets: 2022-07-06T09:01:55.372 INFO:teuthology.kill: smithi141.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBVSPnq23oailHDZypLIWpv/BAgItn0kKqyCgYfs1hzjjcfaG7ydphD072ZFXZbKwRJ5orvcdD7fb7JpuKRtsCV9InKTb+ORLMW/FGRudGkFg95iwVNUwVSZXYucJH/icmlRJ+zWSmbQw9c+06iPetAt+meItc87fu3qxVJYtitDKgndM93pI2RPI3pDOTucsIy01RlDUOVSibmJYYMrvZ5i6hnbdKBb+OqF7m/X4QYo4Lu9tAEcZXPLvTkfUU71k96V7MgrkwNGrE0Kse0pqpQZSoBcfjACXvLiBX2Kvb4WV3WNbXk/nAxGeBbN3i3l2VKnw9FpGhogr1HuMnQGj 2022-07-06T09:01:55.374 INFO:teuthology.kill: smithi164.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMaOPoxvmtRZw1iBQJU6WUaSFpH2qj0nGho5LLSgNsHLRiO50ZpvD013FRCtgFAmBCatW02069SlxueksQA/YUBhbKHWjKx0gEUH27EAvg5tGJ1pDh+xxCtlfqXKAcI75T0eqBM3at6B9YW2vLd1DhkxNH85FCg+3HQKhf6GNWYsOEJYcldY3jklsnutxUSomih9T58n5PY/5hsFiB/Y3NrrxXThrGuKTOVcTTdHDiyMSF5eSS0YkJ2GIWAWgQJ8I3o2572mL+ztt1vx3iEFnOqsvIdE+teEwd59YaelFq++7kZvuUs0e/yOWSmPJbKx5jooQGTndYDHJlK8aqGdPx 2022-07-06T09:01:55.374 INFO:teuthology.kill:2022-07-06 09:01:55,366.366 INFO:teuthology.nuke:Checking targets against current locks 2022-07-06T09:01:55.456 INFO:teuthology.kill:2022-07-06 09:01:55,448.448 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-07-06T09:01:55.507 INFO:teuthology.kill:2022-07-06 09:01:55,506.506 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-07-06T09:01:55.608 INFO:teuthology.kill:2022-07-06 09:01:55,607.607 INFO:teuthology.orchestra.console:Power off smithi141 2022-07-06T09:01:55.638 INFO:teuthology.kill:2022-07-06 09:01:55,637.637 INFO:teuthology.orchestra.console:Power off smithi164 2022-07-06T09:02:04.021 INFO:teuthology.kill:2022-07-06 09:02:04,020.020 INFO:teuthology.orchestra.console:Power off for smithi164 completed 2022-07-06T09:02:04.207 INFO:teuthology.kill:2022-07-06 09:02:04,206.206 INFO:teuthology.lock.ops:unlocked: smithi164.front.sepia.ceph.com 2022-07-06T09:02:08.125 INFO:teuthology.kill:2022-07-06 09:02:08,125.125 INFO:teuthology.orchestra.console:Power off for smithi141 completed 2022-07-06T09:02:08.298 INFO:teuthology.kill:2022-07-06 09:02:08,293.293 INFO:teuthology.lock.ops:unlocked: smithi141.front.sepia.ceph.com 2022-07-06T09:04:08.813 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-07-06T09:04:09.107 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi164 but it was locked by another job: /home/teuthworker/archive/rishabh-2022-07-06_05:24:29-fs-wip-rishabh-testing-20220705-2132-distro-default-smithi/6916739