2022-05-01T08:12:15.183 INFO:root:teuthology version: 1.1.1.dev326+g135488ac
2022-05-01T08:12:15.364 INFO:teuthology.lock.ops:Start node 'smithi022.front.sepia.ceph.com' reimaging
2022-05-01T08:12:15.364 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: reset os type and version on server
2022-05-01T08:12:15.365 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server
2022-05-01T08:12:15.388 INFO:teuthology.lock.ops:Node 'smithi022.front.sepia.ceph.com' reimaging is complete
2022-05-01T08:12:15.388 INFO:teuthology.lock.ops:Start node 'smithi047.front.sepia.ceph.com' reimaging
2022-05-01T08:12:15.388 INFO:teuthology.lock.ops:Updating [smithi047.front.sepia.ceph.com]: reset os type and version on server
2022-05-01T08:12:15.388 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server
2022-05-01T08:12:15.411 INFO:teuthology.lock.ops:Node 'smithi047.front.sepia.ceph.com' reimaging is complete
2022-05-01T08:12:15.411 INFO:teuthology.lock.ops:Start node 'smithi142.front.sepia.ceph.com' reimaging
2022-05-01T08:12:15.411 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: reset os type and version on server
2022-05-01T08:12:15.411 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server
2022-05-01T08:12:15.431 INFO:teuthology.lock.ops:Node 'smithi142.front.sepia.ceph.com' reimaging is complete
2022-05-01T08:12:15.601 INFO:teuthology.provision.fog.smithi022:Scheduling deploy of ubuntu 18.04
2022-05-01T08:12:15.632 INFO:teuthology.provision.fog.smithi047:Scheduling deploy of ubuntu 18.04
2022-05-01T08:12:15.671 INFO:teuthology.provision.fog.smithi142:Scheduling deploy of ubuntu 18.04
2022-05-01T08:12:15.968 INFO:teuthology.orchestra.console:Power off smithi142
2022-05-01T08:12:16.048 INFO:teuthology.orchestra.console:Power off smithi022
2022-05-01T08:12:16.060 INFO:teuthology.orchestra.console:Power off smithi047
2022-05-01T08:12:24.388 INFO:teuthology.orchestra.console:Power off for smithi142 completed
2022-05-01T08:12:24.416 INFO:teuthology.orchestra.console:Power off for smithi022 completed
2022-05-01T08:12:24.490 INFO:teuthology.orchestra.console:Power on smithi142
2022-05-01T08:12:24.519 INFO:teuthology.orchestra.console:Power on smithi022
2022-05-01T08:12:28.535 INFO:teuthology.orchestra.console:Power off for smithi047 completed
2022-05-01T08:12:28.637 INFO:teuthology.orchestra.console:Power on smithi047
2022-05-01T08:12:32.916 INFO:teuthology.orchestra.console:Power on for smithi142 completed
2022-05-01T08:12:32.957 INFO:teuthology.orchestra.console:Power on for smithi047 completed
2022-05-01T08:12:32.958 INFO:teuthology.orchestra.console:Power on for smithi022 completed
2022-05-01T08:12:33.058 INFO:teuthology.provision.fog.smithi142:Waiting for deploy to finish
2022-05-01T08:12:33.060 INFO:teuthology.provision.fog.smithi047:Waiting for deploy to finish
2022-05-01T08:12:33.061 INFO:teuthology.provision.fog.smithi022:Waiting for deploy to finish
2022-05-01T08:16:32.847 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-05-01T08:16:35.791 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-05-01T08:16:38.902 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-05-01T08:16:41.806 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-05-01T08:16:44.924 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-05-01T08:16:47.869 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-05-01T08:16:50.936 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-05-01T08:16:53.884 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-05-01T08:16:57.034 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-05-01T08:16:57.372 INFO:teuthology.provision.fog.smithi047:Node is ready
2022-05-01T08:16:57.421 INFO:teuthology.orchestra.run.smithi047.stdout:smithi047.front.sepia.ceph.com
2022-05-01T08:16:57.470 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47 smithi047.front.sepia.ceph.com smithi047
2022-05-01T08:16:57.768 INFO:teuthology.provision.fog.smithi047:Deploy complete!
2022-05-01T08:17:00.001 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-05-01T08:17:00.380 INFO:teuthology.provision.fog.smithi022:Node is ready
2022-05-01T08:17:00.428 INFO:teuthology.orchestra.run.smithi022.stdout:smithi022.front.sepia.ceph.com
2022-05-01T08:17:00.477 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022
2022-05-01T08:17:00.830 INFO:teuthology.provision.fog.smithi022:Deploy complete!
2022-05-01T08:17:28.646 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-05-01T08:17:29.092 INFO:teuthology.provision.fog.smithi142:Node is ready
2022-05-01T08:17:29.140 INFO:teuthology.orchestra.run.smithi142.stdout:smithi142.front.sepia.ceph.com
2022-05-01T08:17:29.188 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142 smithi142.front.sepia.ceph.com smithi142
2022-05-01T08:17:29.475 INFO:teuthology.provision.fog.smithi142:Deploy complete!
2022-05-01T08:17:29.765 INFO:teuthology.lock.ops:Checking smithi022.front.sepia.ceph.com
2022-05-01T08:17:29.830 INFO:teuthology.lock.ops:New key found. Updating...
2022-05-01T08:17:29.853 INFO:teuthology.lock.ops:Checking smithi047.front.sepia.ceph.com
2022-05-01T08:17:29.853 INFO:teuthology.lock.ops:New key found. Updating...
2022-05-01T08:17:29.869 INFO:teuthology.lock.ops:Checking smithi142.front.sepia.ceph.com
2022-05-01T08:17:29.869 INFO:teuthology.lock.ops:New key found. Updating...
2022-05-01T08:17:29.886 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: set os type and version on server
2022-05-01T08:17:29.886 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com'
2022-05-01T08:17:30.134 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64
2022-05-01T08:17:30.182 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="Ubuntu"
2022-05-01T08:17:30.182 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="18.04.6 LTS (Bionic Beaver)"
2022-05-01T08:17:30.182 INFO:teuthology.orchestra.run.smithi022.stdout:ID=ubuntu
2022-05-01T08:17:30.182 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE=debian
2022-05-01T08:17:30.183 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS"
2022-05-01T08:17:30.183 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="18.04"
2022-05-01T08:17:30.183 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://www.ubuntu.com/"
2022-05-01T08:17:30.183 INFO:teuthology.orchestra.run.smithi022.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-05-01T08:17:30.183 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-05-01T08:17:30.184 INFO:teuthology.orchestra.run.smithi022.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-05-01T08:17:30.184 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_CODENAME=bionic
2022-05-01T08:17:30.184 INFO:teuthology.orchestra.run.smithi022.stdout:UBUNTU_CODENAME=bionic
2022-05-01T08:17:30.185 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server
2022-05-01T08:17:30.203 INFO:teuthology.lock.ops:Updating [smithi047.front.sepia.ceph.com]: set os type and version on server
2022-05-01T08:17:30.203 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com'
2022-05-01T08:17:30.456 INFO:teuthology.orchestra.run.smithi047.stdout:x86_64
2022-05-01T08:17:30.504 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="Ubuntu"
2022-05-01T08:17:30.504 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="18.04.6 LTS (Bionic Beaver)"
2022-05-01T08:17:30.504 INFO:teuthology.orchestra.run.smithi047.stdout:ID=ubuntu
2022-05-01T08:17:30.504 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE=debian
2022-05-01T08:17:30.504 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS"
2022-05-01T08:17:30.504 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="18.04"
2022-05-01T08:17:30.504 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://www.ubuntu.com/"
2022-05-01T08:17:30.504 INFO:teuthology.orchestra.run.smithi047.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-05-01T08:17:30.505 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-05-01T08:17:30.505 INFO:teuthology.orchestra.run.smithi047.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-05-01T08:17:30.505 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_CODENAME=bionic
2022-05-01T08:17:30.505 INFO:teuthology.orchestra.run.smithi047.stdout:UBUNTU_CODENAME=bionic
2022-05-01T08:17:30.506 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server
2022-05-01T08:17:30.523 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: set os type and version on server
2022-05-01T08:17:30.523 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com'
2022-05-01T08:17:30.828 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64
2022-05-01T08:17:30.876 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="Ubuntu"
2022-05-01T08:17:30.876 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="18.04.6 LTS (Bionic Beaver)"
2022-05-01T08:17:30.876 INFO:teuthology.orchestra.run.smithi142.stdout:ID=ubuntu
2022-05-01T08:17:30.877 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE=debian
2022-05-01T08:17:30.877 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS"
2022-05-01T08:17:30.877 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="18.04"
2022-05-01T08:17:30.877 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://www.ubuntu.com/"
2022-05-01T08:17:30.877 INFO:teuthology.orchestra.run.smithi142.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-05-01T08:17:30.877 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-05-01T08:17:30.877 INFO:teuthology.orchestra.run.smithi142.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-05-01T08:17:30.877 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_CODENAME=bionic
2022-05-01T08:17:30.877 INFO:teuthology.orchestra.run.smithi142.stdout:UBUNTU_CODENAME=bionic
2022-05-01T08:17:30.878 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server
2022-05-01T08:17:30.977 INFO:teuthology.dispatcher.supervisor:Running job 6810240
2022-05-01T08:17:30.978 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_135488acc76a85490d37201ec506706cc4ab2d62/virtualenv/bin/teuthology -v --owner scheduled_lflores@teuthology --archive /home/teuthworker/archive/lflores-2022-04-27_17:53:15-rados:thrash-erasure-code-big-wip-yuri2-testing-2022-04-26-1132-octopus-distro-default-smithi/6810240 --name lflores-2022-04-27_17:53:15-rados:thrash-erasure-code-big-wip-yuri2-testing-2022-04-26-1132-octopus-distro-default-smithi --description rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_18.04} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} -- /home/teuthworker/archive/lflores-2022-04-27_17:53:15-rados:thrash-erasure-code-big-wip-yuri2-testing-2022-04-26-1132-octopus-distro-default-smithi/6810240/orig.config.yaml
2022-05-01T08:17:30.981 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/lflores-2022-04-27_17:53:15-rados:thrash-erasure-code-big-wip-yuri2-testing-2022-04-26-1132-octopus-distro-default-smithi/6810240
2022-05-01T08:17:30.982 INFO:teuthology.dispatcher.supervisor:Job PID: 23689
2022-05-01T08:17:30.982 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-05-01T14:48:00.735 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-05-01T14:48:00.895 INFO:teuthology.kill:Killing Pids: {23689}
2022-05-01T14:48:02.443 INFO:teuthology.task.internal:roles: ubuntu@smithi022.front.sepia.ceph.com - ['osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'mon.a']
2022-05-01T14:48:02.443 INFO:teuthology.task.internal:roles: ubuntu@smithi047.front.sepia.ceph.com - ['osd.4', 'osd.5', 'osd.6', 'osd.7', 'mon.b', 'mgr.x']
2022-05-01T14:48:02.443 INFO:teuthology.task.internal:roles: ubuntu@smithi142.front.sepia.ceph.com - ['osd.8', 'osd.9', 'osd.10', 'osd.11', 'mon.c']
2022-05-01T14:48:02.444 INFO:teuthology.misc:Compressing logs...
2022-05-01T14:48:02.444 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com'
2022-05-01T14:48:02.897 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com'
2022-05-01T14:48:03.459 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com'
2022-05-01T14:48:04.353 INFO:teuthology.kill:No teuthology processes running
2022-05-01T14:48:05.749 INFO:teuthology.kill:Nuking machines: ['smithi022', 'smithi047', 'smithi142']
2022-05-01T14:48:06.981 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_135488acc76a85490d37201ec506706cc4ab2d62/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2022-05-01T14:48:06.981 INFO:teuthology.kill:  from cryptography.hazmat.backends import default_backend
2022-05-01T14:48:06.981 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_135488acc76a85490d37201ec506706cc4ab2d62/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:236: CryptographyDeprecationWarning: Blowfish has been deprecated
2022-05-01T14:48:06.982 INFO:teuthology.kill:  "class": algorithms.Blowfish,
2022-05-01T14:48:06.982 INFO:teuthology.kill:2022-05-01 14:48:06,980.980 INFO:teuthology.nuke:targets:
2022-05-01T14:48:06.982 INFO:teuthology.kill:  smithi022.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO+EL94R+NwTHxeHFGugBxLVdufYdyiW/JjX99/qnr2c/KotojWqNRw/0+pMTr99c9mFRKLwaYpSJOGUHVuxty9herqL93rzHi+Lw9nD8TNaOgpvTKvqDEdV55q3i/7JFcB1CyTctlr1Qc2PvF3bh1SHqCrsEnafMnuoKvORCQDpWKXeY5DAjBg9yqj/6oCmmKK/VW9LgLzimCBe0K6QVWYd1eVjW/fQM7zLOav0Dy+XHkrFEZ3r5etj+02VMqlYsbgLDdunbBJcrmtcTHuFVtH3abSr6ScijNXELi9vzE+v/regcafAvnmJdzGAbHjWGYCDJDnA+L3gpdRlmbuPfl
2022-05-01T14:48:06.982 INFO:teuthology.kill:  smithi047.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCglTxMIY4EyKX5e5P6o/z/8Fcdu6Hp3ufAzpQ2hsHy1qwPdds5zmGJdGDnOf2JcU/2DvZVjHGuJGbsQKyc3zvh5ghVArPTBfWv6Qrq63uj7OZMDonRpRUQE4vgFkwxaM69xQwo9GVtZxo2gyBt7qqB0GFEFp8h06Bj3PqKy+sjZI2kVSp03VK2Oj+EHUyF3xM4mgnbXmo7hlgGn/QL68Vlc+hw1r2sTU1XVZoFALt2CdBfvuceubkiR6UWIetRUKC+cD9Wgqk66GuYlTV0gFewqhmNzZXLyd2LhzV/7EYMeGWXZAQsmccbtOnffQHPkJaZVxYBpMWktYhTEa7yP6S1
2022-05-01T14:48:06.983 INFO:teuthology.kill:  smithi142.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCbyMwvKEn64CaSimh0FMvMenOBP9ouWqtcIFkqSQr/bn2XPVARMQCSwmVrbnEiUXdrlIkYd7SQFVAk+FqnQE8Glfwd2m3i8iE++iz5sycFUPJ8i/2GnQhzQas6Dl8Cnqk9bESStliV0sb4hMDA+gaLJtK1Iu7Awj+tVwdFHCmrRKcDS3VkinZfu1CAXmj4xU1CxwaUfiwWU1/x9pNruVmRiwARzBYgSdcXBekLu/w1n4XFXPVj+d7T9e/4Vd57Qrq1egUrLXBsnQHo08afQpoxlOP+O3jonQZm3++0vjmPq7/b5V0XQ1y/PiZ+IpTMHtWqhRLR6KEp10HhO5QrTXGT
2022-05-01T14:48:07.012 INFO:teuthology.kill:2022-05-01 14:48:07,012.012 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-05-01T14:48:07.016 INFO:teuthology.kill:2022-05-01 14:48:07,016.016 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-05-01T14:48:07.019 INFO:teuthology.kill:2022-05-01 14:48:07,018.018 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-05-01T14:48:07.104 INFO:teuthology.kill:2022-05-01 14:48:07,103.103 INFO:teuthology.orchestra.console:Power off smithi142
2022-05-01T14:48:07.123 INFO:teuthology.kill:2022-05-01 14:48:07,122.122 INFO:teuthology.orchestra.console:Power off smithi047
2022-05-01T14:48:07.138 INFO:teuthology.kill:2022-05-01 14:48:07,136.136 INFO:teuthology.orchestra.console:Power off smithi022
2022-05-01T14:48:15.499 INFO:teuthology.kill:2022-05-01 14:48:15,498.498 INFO:teuthology.orchestra.console:Power off for smithi142 completed
2022-05-01T14:48:16.023 INFO:teuthology.kill:2022-05-01 14:48:15,520.520 INFO:teuthology.orchestra.console:Power off for smithi022 completed
2022-05-01T14:48:16.024 INFO:teuthology.kill:2022-05-01 14:48:15,655.655 INFO:teuthology.lock.ops:unlocked: smithi142.front.sepia.ceph.com
2022-05-01T14:48:16.024 INFO:teuthology.kill:2022-05-01 14:48:15,682.682 INFO:teuthology.lock.ops:unlocked: smithi022.front.sepia.ceph.com
2022-05-01T14:48:19.598 INFO:teuthology.kill:2022-05-01 14:48:19,598.598 INFO:teuthology.orchestra.console:Power off for smithi047 completed
2022-05-01T14:48:19.745 INFO:teuthology.kill:2022-05-01 14:48:19,744.744 INFO:teuthology.lock.ops:unlocked: smithi047.front.sepia.ceph.com
2022-05-01T14:50:20.071 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-05-01T14:50:20.204 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi022 but it was locked by another job: /home/teuthworker/archive/vshankar-2022-05-01_13:18:44-fs-wip-vshankar-testing1-20220428-204527-testing-default-smithi/6817570
2022-05-01T14:50:20.205 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi047 but it was locked by another job: /home/teuthworker/archive/vshankar-2022-05-01_13:18:44-fs-wip-vshankar-testing1-20220428-204527-testing-default-smithi/6817571
2022-05-01T14:50:20.205 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi142 but it was locked by another job: /home/teuthworker/archive/vshankar-2022-05-01_13:18:44-fs-wip-vshankar-testing1-20220428-204527-testing-default-smithi/6817570