2022-08-26T21:42:56.070 INFO:root:teuthology version: 1.1.1.dev412+gb1d387f1
2022-08-26T21:42:56.260 INFO:teuthology.lock.ops:Start node 'smithi047.front.sepia.ceph.com' reimaging
2022-08-26T21:42:56.262 INFO:teuthology.lock.ops:Updating [smithi047.front.sepia.ceph.com]: reset os type and version on server
2022-08-26T21:42:56.262 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server
2022-08-26T21:42:56.287 INFO:teuthology.lock.ops:Node 'smithi047.front.sepia.ceph.com' reimaging is complete
2022-08-26T21:42:56.287 INFO:teuthology.lock.ops:Start node 'smithi093.front.sepia.ceph.com' reimaging
2022-08-26T21:42:56.289 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: reset os type and version on server
2022-08-26T21:42:56.289 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server
2022-08-26T21:42:56.316 INFO:teuthology.lock.ops:Node 'smithi093.front.sepia.ceph.com' reimaging is complete
2022-08-26T21:42:56.317 INFO:teuthology.lock.ops:Start node 'smithi133.front.sepia.ceph.com' reimaging
2022-08-26T21:42:56.317 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: reset os type and version on server
2022-08-26T21:42:56.318 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server
2022-08-26T21:42:56.345 INFO:teuthology.lock.ops:Node 'smithi133.front.sepia.ceph.com' reimaging is complete
2022-08-26T21:42:56.515 INFO:teuthology.provision.fog.smithi047:Scheduling deploy of ubuntu 20.04
2022-08-26T21:42:56.542 INFO:teuthology.provision.fog.smithi093:Scheduling deploy of ubuntu 20.04
2022-08-26T21:42:56.565 INFO:teuthology.provision.fog.smithi133:Scheduling deploy of ubuntu 20.04
2022-08-26T21:42:56.905 INFO:teuthology.orchestra.console:Power off smithi093
2022-08-26T21:42:56.931 INFO:teuthology.orchestra.console:Power off smithi047
2022-08-26T21:42:56.961 INFO:teuthology.orchestra.console:Power off smithi133
2022-08-26T21:42:57.106 INFO:teuthology.orchestra.console:Power off for smithi093 completed
2022-08-26T21:42:57.109 INFO:teuthology.orchestra.console:Power off for smithi047 completed
2022-08-26T21:42:57.117 INFO:teuthology.orchestra.console:Power off for smithi133 completed
2022-08-26T21:42:57.208 INFO:teuthology.orchestra.console:Power on smithi093
2022-08-26T21:42:57.216 INFO:teuthology.orchestra.console:Power on smithi047
2022-08-26T21:42:57.222 INFO:teuthology.orchestra.console:Power on smithi133
2022-08-26T21:43:05.597 INFO:teuthology.orchestra.console:Power on for smithi093 completed
2022-08-26T21:43:05.676 INFO:teuthology.orchestra.console:Power on for smithi133 completed
2022-08-26T21:43:05.699 INFO:teuthology.provision.fog.smithi093:Waiting for deploy to finish
2022-08-26T21:43:05.703 INFO:teuthology.orchestra.console:Power on for smithi047 completed
2022-08-26T21:43:05.777 INFO:teuthology.provision.fog.smithi133:Waiting for deploy to finish
2022-08-26T21:43:05.809 INFO:teuthology.provision.fog.smithi047:Waiting for deploy to finish
2022-08-26T21:47:34.631 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-08-26T21:47:35.173 INFO:teuthology.provision.fog.smithi047:Node is ready
2022-08-26T21:47:35.181 INFO:teuthology.orchestra.run.smithi047.stdout:smithi047.front.sepia.ceph.com
2022-08-26T21:47:35.232 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47 smithi047.front.sepia.ceph.com smithi047
2022-08-26T21:47:35.459 INFO:teuthology.provision.fog.smithi047:Deploy complete!
2022-08-26T21:48:03.228 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-08-26T21:48:03.355 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-08-26T21:48:03.784 INFO:teuthology.provision.fog.smithi093:Node is ready
2022-08-26T21:48:03.792 INFO:teuthology.orchestra.run.smithi093.stdout:smithi093.front.sepia.ceph.com
2022-08-26T21:48:03.800 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93 smithi093.front.sepia.ceph.com smithi093
2022-08-26T21:48:03.878 INFO:teuthology.provision.fog.smithi133:Node is ready
2022-08-26T21:48:03.929 INFO:teuthology.orchestra.run.smithi133.stdout:smithi133.front.sepia.ceph.com
2022-08-26T21:48:03.944 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.15.133 smithi133.front.sepia.ceph.com smithi133
2022-08-26T21:48:04.037 INFO:teuthology.provision.fog.smithi093:Deploy complete!
2022-08-26T21:48:04.062 INFO:teuthology.provision.fog.smithi133:Deploy complete!
2022-08-26T21:48:04.458 INFO:teuthology.lock.ops:Checking smithi047.front.sepia.ceph.com
2022-08-26T21:48:04.459 INFO:teuthology.lock.ops:New key found. Updating...
2022-08-26T21:48:04.492 INFO:teuthology.lock.ops:Checking smithi093.front.sepia.ceph.com
2022-08-26T21:48:04.493 INFO:teuthology.lock.ops:New key found. Updating...
2022-08-26T21:48:04.514 INFO:teuthology.lock.ops:Checking smithi133.front.sepia.ceph.com
2022-08-26T21:48:04.515 INFO:teuthology.lock.ops:New key found. Updating...
2022-08-26T21:48:04.536 INFO:teuthology.lock.ops:Updating [smithi047.front.sepia.ceph.com]: set os type and version on server
2022-08-26T21:48:04.537 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com'
2022-08-26T21:48:04.870 INFO:teuthology.orchestra.run.smithi047.stdout:x86_64
2022-08-26T21:48:04.875 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="Ubuntu"
2022-08-26T21:48:04.875 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2022-08-26T21:48:04.876 INFO:teuthology.orchestra.run.smithi047.stdout:ID=ubuntu
2022-08-26T21:48:04.876 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE=debian
2022-08-26T21:48:04.876 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2022-08-26T21:48:04.876 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="20.04"
2022-08-26T21:48:04.877 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://www.ubuntu.com/"
2022-08-26T21:48:04.877 INFO:teuthology.orchestra.run.smithi047.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-08-26T21:48:04.877 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-08-26T21:48:04.877 INFO:teuthology.orchestra.run.smithi047.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-08-26T21:48:04.878 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_CODENAME=focal
2022-08-26T21:48:04.878 INFO:teuthology.orchestra.run.smithi047.stdout:UBUNTU_CODENAME=focal
2022-08-26T21:48:04.879 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server
2022-08-26T21:48:04.901 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: set os type and version on server
2022-08-26T21:48:04.901 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com'
2022-08-26T21:48:05.121 INFO:teuthology.orchestra.run.smithi093.stdout:x86_64
2022-08-26T21:48:05.128 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="Ubuntu"
2022-08-26T21:48:05.129 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2022-08-26T21:48:05.129 INFO:teuthology.orchestra.run.smithi093.stdout:ID=ubuntu
2022-08-26T21:48:05.129 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE=debian
2022-08-26T21:48:05.129 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2022-08-26T21:48:05.130 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="20.04"
2022-08-26T21:48:05.130 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://www.ubuntu.com/"
2022-08-26T21:48:05.130 INFO:teuthology.orchestra.run.smithi093.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-08-26T21:48:05.130 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-08-26T21:48:05.131 INFO:teuthology.orchestra.run.smithi093.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-08-26T21:48:05.131 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_CODENAME=focal
2022-08-26T21:48:05.131 INFO:teuthology.orchestra.run.smithi093.stdout:UBUNTU_CODENAME=focal
2022-08-26T21:48:05.132 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server
2022-08-26T21:48:05.154 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: set os type and version on server
2022-08-26T21:48:05.154 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com'
2022-08-26T21:48:05.440 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64
2022-08-26T21:48:05.447 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="Ubuntu"
2022-08-26T21:48:05.448 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2022-08-26T21:48:05.448 INFO:teuthology.orchestra.run.smithi133.stdout:ID=ubuntu
2022-08-26T21:48:05.448 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE=debian
2022-08-26T21:48:05.449 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2022-08-26T21:48:05.449 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="20.04"
2022-08-26T21:48:05.450 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://www.ubuntu.com/"
2022-08-26T21:48:05.450 INFO:teuthology.orchestra.run.smithi133.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-08-26T21:48:05.451 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-08-26T21:48:05.451 INFO:teuthology.orchestra.run.smithi133.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-08-26T21:48:05.451 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_CODENAME=focal
2022-08-26T21:48:05.451 INFO:teuthology.orchestra.run.smithi133.stdout:UBUNTU_CODENAME=focal
2022-08-26T21:48:05.452 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server
2022-08-26T21:48:05.585 INFO:teuthology.dispatcher.supervisor:Running job 6993291
2022-08-26T21:48:05.585 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b1d387f12b117399cb87c86aaa341398fa0c0919/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2022-08-25_18:36:20-rados-WIP_GBH_snap_mapper_one_way-distro-default-smithi/6993291 --name benhanokh-2022-08-25_18:36:20-rados-WIP_GBH_snap_mapper_one_way-distro-default-smithi --description rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} -- /home/teuthworker/archive/benhanokh-2022-08-25_18:36:20-rados-WIP_GBH_snap_mapper_one_way-distro-default-smithi/6993291/orig.config.yaml
2022-08-26T21:48:05.590 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2022-08-25_18:36:20-rados-WIP_GBH_snap_mapper_one_way-distro-default-smithi/6993291
2022-08-26T21:48:05.591 INFO:teuthology.dispatcher.supervisor:Job PID: 8840
2022-08-26T21:48:05.592 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-08-27T09:49:06.535 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-08-27T09:49:06.705 INFO:teuthology.kill:Killing Pids: {8840}
2022-08-27T09:49:08.258 INFO:teuthology.task.internal:roles: ubuntu@smithi047.front.sepia.ceph.com - ['osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'mon.a']
2022-08-27T09:49:08.259 INFO:teuthology.task.internal:roles: ubuntu@smithi093.front.sepia.ceph.com - ['osd.4', 'osd.5', 'osd.6', 'osd.7', 'mon.b', 'mgr.x']
2022-08-27T09:49:08.260 INFO:teuthology.task.internal:roles: ubuntu@smithi133.front.sepia.ceph.com - ['osd.8', 'osd.9', 'osd.10', 'osd.11', 'mon.c']
2022-08-27T09:49:08.260 INFO:teuthology.misc:Compressing logs...
2022-08-27T09:49:08.261 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com'
2022-08-27T09:49:08.518 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com'
2022-08-27T09:49:08.777 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com'
2022-08-27T09:49:09.391 INFO:teuthology.misc:Compressing logs...
2022-08-27T09:51:26.779 INFO:teuthology.misc:Compressing logs...
2022-08-27T09:51:31.917 INFO:teuthology.kill:No teuthology processes running
2022-08-27T09:51:33.200 INFO:teuthology.kill:Nuking machines: ['smithi047', 'smithi093', 'smithi133']
2022-08-27T09:51:34.320 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b1d387f12b117399cb87c86aaa341398fa0c0919/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2022-08-27T09:51:34.321 INFO:teuthology.kill:  from cryptography.hazmat.backends import default_backend
2022-08-27T09:51:34.321 INFO:teuthology.kill:2022-08-27 09:51:34,320.320 INFO:teuthology.nuke:targets:
2022-08-27T09:51:34.322 INFO:teuthology.kill:  smithi047.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDL7F5kaxuKvQxs3yXtwZaPLWIbP8q9I9VAEnnVuIl4a5omxcKisd2qm6x37rgISSXsaDEOla7j5aLScRMeWWKr+B98ibJqooRHH/8NQn9yBkysvwmZVI1JKT7LFfndiCj3zMq2iPh/h+b4S9GLeyBkjnBLkmXhjfVKRyOpGtQcB1P192KjbjBaspQl4GY1+utmyEZIt4Rt+DOqyUR1axmVgu16P/+yIhk8WDHPhNnpqMa6udKQ62j2X+N+Y/FCcUU/OI5xHw0CLN6CfjTRzQ+joWbWOVKAIa/rKayUyMI6wlwNh2WgMoIxrU/I4/QyjzwLSVvmVFj7LIgd2S2b+b1bUdV+/7sEiu8xAZ23atsQkh3BR4xEgfDuW7XHJYUaUABSOCw2MwgzPnzw5qdBOd2gLwhzvIXNC1RWNdNn0B0jqIO5ebQ0wDvvRt48SlpNchrNxQ/qziZ+29UEZ3v5cd/5meZ7O4DHsYz1xq8oJpTspKhXtegMo+p6bDGafHFPBSU=
2022-08-27T09:51:34.322 INFO:teuthology.kill:  smithi093.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDB6CVNHijU0XMG3zdHEJv4G5TNCHWllm46Yent9Dn9I7YTfvPJrMXMGL7sc0+z29IiqaLtBRfhazXS8gkkn/HveD9N9OxFp8iPgMJDoJ+mJv3XALN2qcVez51ffQfNuUlxeeypFot3mYqQpPqomAtd/BPst1/mknTUGll79nEge5kAZRffIMqctjSKMvtgZAD6ftc/GdiwrbJPqHx4W2W4l8gRdEjX6IRUXISmkbwgY38lfeCfDrSP3myl9+tOltqOskqgHq/92bQYBORcjCYRt6EGSAC2MIpE01/4oTembjtNCrBv8a7gr88kjHFJ4YdekVJam8Oi3yaf0e9dH/paDqCE3+M7xJf1a9Zqi9s4UVnVzNil5MvD1605SKZx8uBjfTv7RYtYzNYKyM2xpMbsnXocQbxhD3d7cVJ6tjsV3HoUJTx2kZiwrL5hkwPYESQOTScFx8ta3bhBI58MZd8yexDfAKBHJQinrnnV3lef+/3BqQEtGQFBnRpCShNsPaE=
2022-08-27T09:51:34.322 INFO:teuthology.kill:  smithi133.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDIjMU2bYFbd/07SE8NsYimJ1B+ltD/5+RKWqrnRf6oTj1F/zGB0LBMoeLuyjh3WELUw46xjo3R9zm1xaCkago6sIoEXeY4h5ZuZf+eaDVxr4wW5EdrALFgls29gW7HKzt3SmfNuYPeBsyINLHe/8riGBzRcG8ZxhpUk7HjTe0F3hBP6mU3avaWOOK/ZILhsdJI+NlHoPiWU+XFcKMGyEL/QU8XZ7G16cuEO1Sl8HgDBp0bnq5r3alWmXAQjfu+mD1tfMkbWVsmM9Qv856lW6+PcQ60ExYGJDNF/waAlkF0X2Lai/sW8nzga95BwIp48ht5ngpZRUaSibX35IvO+ccMgEtG4OXL3F9VKgiOuX3wqva/EH+si132p4NO70Ny7hXtENC+PLGm6pVKUQ4F/RfDPJd7WF7t7zBZ/mZBi20Eaqq6agRW6TtAHMczftvRCbZk/aJZAJRRIVPQNUBiqm3pwimztmD3IGboyBNzvTvu+C7lF26DRNWjDEFd6nXelsE=
2022-08-27T09:51:34.323 INFO:teuthology.kill:2022-08-27 09:51:34,320.320 INFO:teuthology.nuke:Checking targets against current locks
2022-08-27T09:51:34.372 INFO:teuthology.kill:2022-08-27 09:51:34,372.372 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-08-27T09:51:34.401 INFO:teuthology.kill:2022-08-27 09:51:34,401.401 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-08-27T09:51:34.431 INFO:teuthology.kill:2022-08-27 09:51:34,431.431 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-08-27T09:51:34.453 INFO:teuthology.kill:2022-08-27 09:51:34,453.453 INFO:teuthology.orchestra.console:Power off smithi047
2022-08-27T09:51:34.496 INFO:teuthology.kill:2022-08-27 09:51:34,496.496 INFO:teuthology.orchestra.console:Power off smithi093
2022-08-27T09:51:34.540 INFO:teuthology.kill:2022-08-27 09:51:34,540.540 INFO:teuthology.orchestra.console:Power off smithi133
2022-08-27T09:51:46.953 INFO:teuthology.kill:2022-08-27 09:51:46,952.952 INFO:teuthology.orchestra.console:Power off for smithi047 completed
2022-08-27T09:51:46.981 INFO:teuthology.kill:2022-08-27 09:51:46,981.981 INFO:teuthology.orchestra.console:Power off for smithi093 completed
2022-08-27T09:51:47.024 INFO:teuthology.kill:2022-08-27 09:51:47,023.023 INFO:teuthology.orchestra.console:Power off for smithi133 completed
2022-08-27T09:51:47.105 INFO:teuthology.kill:2022-08-27 09:51:47,104.104 INFO:teuthology.lock.ops:unlocked: smithi047.front.sepia.ceph.com
2022-08-27T09:51:47.128 INFO:teuthology.kill:2022-08-27 09:51:47,128.128 INFO:teuthology.lock.ops:unlocked: smithi093.front.sepia.ceph.com
2022-08-27T09:51:47.176 INFO:teuthology.kill:2022-08-27 09:51:47,176.176 INFO:teuthology.lock.ops:unlocked: smithi133.front.sepia.ceph.com
2022-08-27T09:53:47.544 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-08-27T09:53:47.687 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi047 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-08-23_05:15:02-krbd-octopus-testing-default-smithi/6987517
2022-08-27T09:53:47.688 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi093 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-08-23_05:15:02-krbd-octopus-testing-default-smithi/6987517
2022-08-27T09:53:47.688 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi133 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-08-23_05:15:02-krbd-octopus-testing-default-smithi/6987517