2022-12-06T10:22:42.889 INFO:root:teuthology version: 0.0.1.dev3+g4da97cf 2022-12-06T10:22:43.045 INFO:teuthology.lock.ops:Start node 'smithi119.front.sepia.ceph.com' reimaging 2022-12-06T10:22:43.046 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: reset os type and version on server 2022-12-06T10:22:43.046 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2022-12-06T10:22:43.067 INFO:teuthology.lock.ops:Node 'smithi119.front.sepia.ceph.com' reimaging is complete 2022-12-06T10:22:43.067 INFO:teuthology.lock.ops:Start node 'smithi181.front.sepia.ceph.com' reimaging 2022-12-06T10:22:43.068 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: reset os type and version on server 2022-12-06T10:22:43.068 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2022-12-06T10:22:43.100 INFO:teuthology.lock.ops:Node 'smithi181.front.sepia.ceph.com' reimaging is complete 2022-12-06T10:22:43.320 INFO:teuthology.provision.fog.smithi119:Scheduling deploy of ubuntu 20.04 2022-12-06T10:22:43.356 INFO:teuthology.provision.fog.smithi181:Scheduling deploy of ubuntu 20.04 2022-12-06T10:22:43.674 INFO:teuthology.orchestra.console:Power off smithi119 2022-12-06T10:22:43.759 INFO:teuthology.orchestra.console:Power off smithi181 2022-12-06T10:22:43.839 INFO:teuthology.orchestra.console:Power off for smithi119 completed 2022-12-06T10:22:43.924 INFO:teuthology.orchestra.console:Power off for smithi181 completed 2022-12-06T10:22:43.940 INFO:teuthology.orchestra.console:Power on smithi119 2022-12-06T10:22:44.026 INFO:teuthology.orchestra.console:Power on smithi181 2022-12-06T10:22:52.454 INFO:teuthology.orchestra.console:Power on for smithi181 completed 2022-12-06T10:22:52.505 INFO:teuthology.orchestra.console:Power on for smithi119 completed 2022-12-06T10:22:52.556 INFO:teuthology.provision.fog.smithi181:Waiting for deploy to finish 2022-12-06T10:22:52.607 INFO:teuthology.provision.fog.smithi119:Waiting for deploy to finish 2022-12-06T10:27:44.455 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-12-06T10:27:44.912 INFO:teuthology.provision.fog.smithi119:Node is ready 2022-12-06T10:27:44.919 INFO:teuthology.orchestra.run.smithi119.stdout:smithi119.front.sepia.ceph.com 2022-12-06T10:27:44.926 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119 smithi119.front.sepia.ceph.com smithi119 2022-12-06T10:27:45.119 INFO:teuthology.provision.fog.smithi119:Deploy complete! 2022-12-06T10:27:56.478 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-12-06T10:27:56.935 INFO:teuthology.provision.fog.smithi181:Node is ready 2022-12-06T10:27:56.948 INFO:teuthology.orchestra.run.smithi181.stdout:smithi181.front.sepia.ceph.com 2022-12-06T10:27:56.955 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.181 smithi181.front.sepia.ceph.com smithi181 2022-12-06T10:27:57.183 INFO:teuthology.provision.fog.smithi181:Deploy complete! 2022-12-06T10:27:57.540 INFO:teuthology.lock.ops:Checking smithi119.front.sepia.ceph.com 2022-12-06T10:27:57.541 INFO:teuthology.lock.ops:New key found. Updating... 2022-12-06T10:27:57.580 INFO:teuthology.lock.ops:Checking smithi181.front.sepia.ceph.com 2022-12-06T10:27:57.580 INFO:teuthology.lock.ops:New key found. Updating... 2022-12-06T10:27:57.606 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: set os type and version on server 2022-12-06T10:27:57.607 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2022-12-06T10:27:57.979 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64 2022-12-06T10:27:58.033 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="Ubuntu" 2022-12-06T10:27:58.034 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="20.04.5 LTS (Focal Fossa)" 2022-12-06T10:27:58.035 INFO:teuthology.orchestra.run.smithi119.stdout:ID=ubuntu 2022-12-06T10:27:58.035 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE=debian 2022-12-06T10:27:58.036 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="Ubuntu 20.04.5 LTS" 2022-12-06T10:27:58.036 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="20.04" 2022-12-06T10:27:58.037 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://www.ubuntu.com/" 2022-12-06T10:27:58.037 INFO:teuthology.orchestra.run.smithi119.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-12-06T10:27:58.038 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-12-06T10:27:58.038 INFO:teuthology.orchestra.run.smithi119.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-12-06T10:27:58.038 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_CODENAME=focal 2022-12-06T10:27:58.039 INFO:teuthology.orchestra.run.smithi119.stdout:UBUNTU_CODENAME=focal 2022-12-06T10:27:58.064 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2022-12-06T10:27:58.109 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: set os type and version on server 2022-12-06T10:27:58.110 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2022-12-06T10:27:58.327 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64 2022-12-06T10:27:58.334 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="Ubuntu" 2022-12-06T10:27:58.335 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="20.04.5 LTS (Focal Fossa)" 2022-12-06T10:27:58.335 INFO:teuthology.orchestra.run.smithi181.stdout:ID=ubuntu 2022-12-06T10:27:58.340 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE=debian 2022-12-06T10:27:58.340 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="Ubuntu 20.04.5 LTS" 2022-12-06T10:27:58.341 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="20.04" 2022-12-06T10:27:58.341 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://www.ubuntu.com/" 2022-12-06T10:27:58.341 INFO:teuthology.orchestra.run.smithi181.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-12-06T10:27:58.341 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-12-06T10:27:58.342 INFO:teuthology.orchestra.run.smithi181.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-12-06T10:27:58.342 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_CODENAME=focal 2022-12-06T10:27:58.342 INFO:teuthology.orchestra.run.smithi181.stdout:UBUNTU_CODENAME=focal 2022-12-06T10:27:58.343 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2022-12-06T10:27:58.472 INFO:teuthology.dispatcher.supervisor:Running job 7105126 2022-12-06T10:27:58.473 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_4da97cf64e542f347ec47b7bdbe5eca99759f9b7/virtualenv/bin/teuthology -v --owner scheduled_dis@teuthology --archive /home/teuthworker/archive/dis-2022-12-06_10:20:40-rbd-wip-dis-testing-distro-default-smithi/7105126 --name dis-2022-12-06_10:20:40-rbd-wip-dis-testing-distro-default-smithi --description rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} -- /home/teuthworker/archive/dis-2022-12-06_10:20:40-rbd-wip-dis-testing-distro-default-smithi/7105126/orig.config.yaml 2022-12-06T10:27:58.481 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/dis-2022-12-06_10:20:40-rbd-wip-dis-testing-distro-default-smithi/7105126 2022-12-06T10:27:58.483 INFO:teuthology.dispatcher.supervisor:Job PID: 28705 2022-12-06T10:27:58.483 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-12-06T22:28:57.545 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-12-06T22:28:57.736 INFO:teuthology.kill:Killing Pids: {28705} 2022-12-06T22:28:59.385 INFO:teuthology.task.internal:roles: ubuntu@smithi119.front.sepia.ceph.com - ['cluster1.mon.a', 'cluster1.mgr.x', 'cluster2.mgr.x', 'cluster1.osd.0', 'cluster1.osd.1', 'cluster1.osd.2', 'cluster1.client.0', 'cluster2.client.0'] 2022-12-06T22:28:59.386 INFO:teuthology.task.internal:roles: ubuntu@smithi181.front.sepia.ceph.com - ['cluster2.mon.a', 'cluster2.osd.0', 'cluster2.osd.1', 'cluster2.osd.2', 'cluster1.client.mirror', 'cluster1.client.mirror.0', 'cluster1.client.mirror.1', 'cluster1.client.mirror.2', 'cluster1.client.mirror.3', 'cluster1.client.mirror.4', 'cluster1.client.mirror.5', 'cluster1.client.mirror.6', 'cluster2.client.mirror', 'cluster2.client.mirror.0', 'cluster2.client.mirror.1', 'cluster2.client.mirror.2', 'cluster2.client.mirror.3', 'cluster2.client.mirror.4', 'cluster2.client.mirror.5', 'cluster2.client.mirror.6'] 2022-12-06T22:28:59.387 INFO:teuthology.misc:Compressing logs... 2022-12-06T22:28:59.388 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2022-12-06T22:28:59.626 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2022-12-06T22:29:00.056 INFO:teuthology.misc:Compressing logs... 2022-12-06T22:29:47.470 INFO:teuthology.misc:Compressing logs... 2022-12-06T22:33:02.689 INFO:teuthology.kill:No teuthology processes running 2022-12-06T22:33:04.213 INFO:teuthology.kill:Nuking machines: ['smithi119', 'smithi181'] 2022-12-06T22:33:05.393 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_teuthology_4da97cf64e542f347ec47b7bdbe5eca99759f9b7/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-12-06T22:33:05.394 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-12-06T22:33:05.394 INFO:teuthology.kill:2022-12-06 22:33:05,393.393 INFO:teuthology.nuke:targets: 2022-12-06T22:33:05.395 INFO:teuthology.kill: smithi119.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCmCYUJbX7x6S51OOZDFfh7VCuPc7MGdciPbO8q3IoBpECJWxHFGZBi2XRP8sJBnt3YvIC0YFHdhDjJ4kU93LZx+oiKjHL+Iqcsi56kuEWDv10np0tovekpeJtoKGMVi3bFQi1pCWJRelqgirBcXt+2McDRaervrqsxUJsmsT7/msTSggIIFFM2cFhB+Kdk9Ys23rQT00ScoeoMw0nQ3tYvu53Q5W9LB2VAviJTlY5P3813PQd9066yy0/Piw+DBIiLtTMVq0O8ajmPcO+Ak8fleFR8ImhJMZjmXQMn+GC0K3PCWXlE+dccjo3SATpP9u1hU057ffac4mPPR8cDH1nfWCLjKDVPqPvCHlqY8ixdXqb4gVX9slgD4tZ98e0Yq4d2etfw55xEKC0gN2X5FFBNzgTSfEFhD31CQ+gaqvTv7OvdVH7l8DfNqwT5Y3JT5z3+ClGLLMalutRI3wOLaV+sU3MJ6er/ZT0aZjG1f1E1MwUCXrHnnVr8GB3BL8X3Gy8= 2022-12-06T22:33:05.395 INFO:teuthology.kill: smithi181.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrQdkjMRPkECk8SjQx2KUBa8WsUpsO/lmodBP46gPROtjU2lWL5IdlsPyPYXjzOX4R1AbsJc7uDOidmWRF7nQSfYYAOGqWvOMZ1G6mb+umsKZX3MOo3/VyUndKADPMFdfUoBagP1+Pbb864+sTM+YRNmtgGLTsxGdxaTMp/AX3qFrHOmuJaCNPnhVg99i6c5hl/rOaZXT3VcZsNVnKpUGcqxvYTmS/G3cQcJMf/R9nADnlq0kW95hHtVsFK5tbebTkZYJNFVEr7ce3XbmNDQ8vK3aVPfwL8+B9JJWfIPmNsOfdETS1wyj8EQczNH73j8Dh3a6oPffvjLtMWfRPPM3BVD+k9v/gTYjyHANixzeQpudEwPoUZxHztRw6gRm4fCCmGKGg8y9feKd6BeSmqn1KCss0Frp8lja4i8Dyld6k3CTe3j3jP2ka2nFhyO+ml4yassWLWnsna3dXzegfl4r0QD2kPwteFkTcVgHGdLfObahIPITJpa32EPtTQzGaHPk= 2022-12-06T22:33:05.395 INFO:teuthology.kill:2022-12-06 22:33:05,393.393 INFO:teuthology.nuke:Checking targets against current locks 2022-12-06T22:33:05.457 INFO:teuthology.kill:2022-12-06 22:33:05,456.456 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-12-06T22:33:05.495 INFO:teuthology.kill:2022-12-06 22:33:05,495.495 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-12-06T22:33:05.556 INFO:teuthology.kill:2022-12-06 22:33:05,555.555 INFO:teuthology.orchestra.console:Power off smithi119 2022-12-06T22:33:05.604 INFO:teuthology.kill:2022-12-06 22:33:05,603.603 INFO:teuthology.orchestra.console:Power off smithi181 2022-12-06T22:33:13.938 INFO:teuthology.kill:2022-12-06 22:33:13,936.936 INFO:teuthology.orchestra.console:Power off for smithi119 completed 2022-12-06T22:33:14.095 INFO:teuthology.kill:2022-12-06 22:33:14,094.094 INFO:teuthology.lock.ops:unlocked: smithi119.front.sepia.ceph.com 2022-12-06T22:33:18.086 INFO:teuthology.kill:2022-12-06 22:33:18,085.085 INFO:teuthology.orchestra.console:Power off for smithi181 completed 2022-12-06T22:33:18.265 INFO:teuthology.kill:2022-12-06 22:33:18,265.265 INFO:teuthology.lock.ops:unlocked: smithi181.front.sepia.ceph.com 2022-12-06T22:35:18.707 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-12-06T22:35:18.833 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi119 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-12-06_15:43:07-rados-wip-yuri8-testing-2022-12-05-1031-pacific-distro-default-smithi/7105808 2022-12-06T22:35:18.834 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi181 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-12-06_15:43:07-rados-wip-yuri8-testing-2022-12-05-1031-pacific-distro-default-smithi/7105809