2022-05-01T07:39:28.404 INFO:root:teuthology version: 1.1.1.dev326+g135488ac
2022-05-01T07:39:28.595 INFO:teuthology.lock.ops:Start node 'smithi032.front.sepia.ceph.com' reimaging
2022-05-01T07:39:28.595 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: reset os type and version on server
2022-05-01T07:39:28.595 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server
2022-05-01T07:39:28.614 INFO:teuthology.lock.ops:Node 'smithi032.front.sepia.ceph.com' reimaging is complete
2022-05-01T07:39:28.615 INFO:teuthology.lock.ops:Start node 'smithi050.front.sepia.ceph.com' reimaging
2022-05-01T07:39:28.615 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: reset os type and version on server
2022-05-01T07:39:28.615 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server
2022-05-01T07:39:28.634 INFO:teuthology.lock.ops:Node 'smithi050.front.sepia.ceph.com' reimaging is complete
2022-05-01T07:39:28.708 INFO:teuthology.lock.ops:Start node 'smithi148.front.sepia.ceph.com' reimaging
2022-05-01T07:39:28.708 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: reset os type and version on server
2022-05-01T07:39:28.708 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server
2022-05-01T07:39:28.736 INFO:teuthology.lock.ops:Node 'smithi148.front.sepia.ceph.com' reimaging is complete
2022-05-01T07:39:28.871 INFO:teuthology.provision.fog.smithi032:Scheduling deploy of ubuntu 18.04
2022-05-01T07:39:28.934 INFO:teuthology.provision.fog.smithi050:Scheduling deploy of ubuntu 18.04
2022-05-01T07:39:28.961 INFO:teuthology.provision.fog.smithi148:Scheduling deploy of ubuntu 18.04
2022-05-01T07:39:29.181 INFO:teuthology.orchestra.console:Power off smithi032
2022-05-01T07:39:29.224 INFO:teuthology.orchestra.console:Power off smithi050
2022-05-01T07:39:29.289 INFO:teuthology.orchestra.console:Power off smithi148
2022-05-01T07:39:37.665 INFO:teuthology.orchestra.console:Power off for smithi050 completed
2022-05-01T07:39:37.766 INFO:teuthology.orchestra.console:Power on smithi050
2022-05-01T07:39:41.708 INFO:teuthology.orchestra.console:Power off for smithi032 completed
2022-05-01T07:39:41.804 INFO:teuthology.orchestra.console:Power off for smithi148 completed
2022-05-01T07:39:41.842 INFO:teuthology.orchestra.console:Power on smithi032
2022-05-01T07:39:41.942 INFO:teuthology.orchestra.console:Power on smithi148
2022-05-01T07:39:46.104 INFO:teuthology.orchestra.console:Power on for smithi032 completed
2022-05-01T07:39:46.261 INFO:teuthology.provision.fog.smithi032:Waiting for deploy to finish
2022-05-01T07:39:46.270 INFO:teuthology.orchestra.console:Power on for smithi148 completed
2022-05-01T07:39:46.273 INFO:teuthology.orchestra.console:Power on for smithi050 completed
2022-05-01T07:39:46.375 INFO:teuthology.provision.fog.smithi148:Waiting for deploy to finish
2022-05-01T07:39:46.376 INFO:teuthology.provision.fog.smithi050:Waiting for deploy to finish
2022-05-01T07:43:46.250 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-05-01T07:43:49.302 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-05-01T07:43:52.263 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-05-01T07:43:55.316 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-05-01T07:43:58.278 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-05-01T07:44:01.329 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-05-01T07:44:04.308 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-05-01T07:44:10.392 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-05-01T07:44:10.407 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-05-01T07:44:10.731 INFO:teuthology.provision.fog.smithi032:Node is ready
2022-05-01T07:44:10.817 INFO:teuthology.orchestra.run.smithi032.stdout:smithi032.front.sepia.ceph.com
2022-05-01T07:44:10.864 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32 smithi032.front.sepia.ceph.com smithi032
2022-05-01T07:44:11.213 INFO:teuthology.provision.fog.smithi032:Deploy complete!
2022-05-01T07:44:16.485 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-05-01T07:44:16.851 INFO:teuthology.provision.fog.smithi050:Node is ready
2022-05-01T07:44:16.898 INFO:teuthology.orchestra.run.smithi050.stdout:smithi050.front.sepia.ceph.com
2022-05-01T07:44:16.947 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50 smithi050.front.sepia.ceph.com smithi050
2022-05-01T07:44:17.227 INFO:teuthology.provision.fog.smithi050:Deploy complete!
2022-05-01T07:45:06.213 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-05-01T07:45:06.672 INFO:teuthology.provision.fog.smithi148:Node is ready
2022-05-01T07:45:06.719 INFO:teuthology.orchestra.run.smithi148.stdout:smithi148.front.sepia.ceph.com
2022-05-01T07:45:06.768 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148 smithi148.front.sepia.ceph.com smithi148
2022-05-01T07:45:07.058 INFO:teuthology.provision.fog.smithi148:Deploy complete!
2022-05-01T07:45:07.306 INFO:teuthology.lock.ops:Checking smithi032.front.sepia.ceph.com
2022-05-01T07:45:07.306 INFO:teuthology.lock.ops:New key found. Updating...
2022-05-01T07:45:07.325 INFO:teuthology.lock.ops:Checking smithi050.front.sepia.ceph.com
2022-05-01T07:45:07.325 INFO:teuthology.lock.ops:New key found. Updating...
2022-05-01T07:45:07.342 INFO:teuthology.lock.ops:Checking smithi148.front.sepia.ceph.com
2022-05-01T07:45:07.342 INFO:teuthology.lock.ops:New key found. Updating...
2022-05-01T07:45:07.361 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: set os type and version on server
2022-05-01T07:45:07.361 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com'
2022-05-01T07:45:07.614 INFO:teuthology.orchestra.run.smithi032.stdout:x86_64
2022-05-01T07:45:07.662 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="Ubuntu"
2022-05-01T07:45:07.662 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="18.04.6 LTS (Bionic Beaver)"
2022-05-01T07:45:07.662 INFO:teuthology.orchestra.run.smithi032.stdout:ID=ubuntu
2022-05-01T07:45:07.662 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE=debian
2022-05-01T07:45:07.662 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS"
2022-05-01T07:45:07.663 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="18.04"
2022-05-01T07:45:07.663 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://www.ubuntu.com/"
2022-05-01T07:45:07.663 INFO:teuthology.orchestra.run.smithi032.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-05-01T07:45:07.663 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-05-01T07:45:07.663 INFO:teuthology.orchestra.run.smithi032.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-05-01T07:45:07.663 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_CODENAME=bionic
2022-05-01T07:45:07.663 INFO:teuthology.orchestra.run.smithi032.stdout:UBUNTU_CODENAME=bionic
2022-05-01T07:45:07.664 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server
2022-05-01T07:45:07.682 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: set os type and version on server
2022-05-01T07:45:07.682 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com'
2022-05-01T07:45:07.931 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64
2022-05-01T07:45:07.979 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="Ubuntu"
2022-05-01T07:45:07.979 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="18.04.6 LTS (Bionic Beaver)"
2022-05-01T07:45:07.979 INFO:teuthology.orchestra.run.smithi050.stdout:ID=ubuntu
2022-05-01T07:45:07.979 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE=debian
2022-05-01T07:45:07.980 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS"
2022-05-01T07:45:07.980 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="18.04"
2022-05-01T07:45:07.980 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://www.ubuntu.com/"
2022-05-01T07:45:07.980 INFO:teuthology.orchestra.run.smithi050.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-05-01T07:45:07.980 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-05-01T07:45:07.980 INFO:teuthology.orchestra.run.smithi050.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-05-01T07:45:07.980 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_CODENAME=bionic
2022-05-01T07:45:07.981 INFO:teuthology.orchestra.run.smithi050.stdout:UBUNTU_CODENAME=bionic
2022-05-01T07:45:07.981 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server
2022-05-01T07:45:07.999 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: set os type and version on server
2022-05-01T07:45:08.054 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com'
2022-05-01T07:45:08.315 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64
2022-05-01T07:45:08.364 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="Ubuntu"
2022-05-01T07:45:08.364 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="18.04.6 LTS (Bionic Beaver)"
2022-05-01T07:45:08.364 INFO:teuthology.orchestra.run.smithi148.stdout:ID=ubuntu
2022-05-01T07:45:08.364 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE=debian
2022-05-01T07:45:08.364 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS"
2022-05-01T07:45:08.364 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="18.04"
2022-05-01T07:45:08.364 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://www.ubuntu.com/"
2022-05-01T07:45:08.365 INFO:teuthology.orchestra.run.smithi148.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-05-01T07:45:08.365 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-05-01T07:45:08.365 INFO:teuthology.orchestra.run.smithi148.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-05-01T07:45:08.365 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_CODENAME=bionic
2022-05-01T07:45:08.365 INFO:teuthology.orchestra.run.smithi148.stdout:UBUNTU_CODENAME=bionic
2022-05-01T07:45:08.365 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server
2022-05-01T07:45:08.467 INFO:teuthology.dispatcher.supervisor:Running job 6810217
2022-05-01T07:45:08.467 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_135488acc76a85490d37201ec506706cc4ab2d62/virtualenv/bin/teuthology -v --owner scheduled_lflores@teuthology --archive /home/teuthworker/archive/lflores-2022-04-27_17:53:15-rados:thrash-erasure-code-big-wip-yuri2-testing-2022-04-26-1132-octopus-distro-default-smithi/6810217 --name lflores-2022-04-27_17:53:15-rados:thrash-erasure-code-big-wip-yuri2-testing-2022-04-26-1132-octopus-distro-default-smithi --description rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_18.04} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} -- /home/teuthworker/archive/lflores-2022-04-27_17:53:15-rados:thrash-erasure-code-big-wip-yuri2-testing-2022-04-26-1132-octopus-distro-default-smithi/6810217/orig.config.yaml
2022-05-01T07:45:08.470 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/lflores-2022-04-27_17:53:15-rados:thrash-erasure-code-big-wip-yuri2-testing-2022-04-26-1132-octopus-distro-default-smithi/6810217
2022-05-01T07:45:08.471 INFO:teuthology.dispatcher.supervisor:Job PID: 25619
2022-05-01T07:45:08.471 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-05-01T14:15:37.883 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-05-01T14:15:38.063 INFO:teuthology.kill:Killing Pids: {25619}
2022-05-01T14:15:39.455 INFO:teuthology.task.internal:roles: ubuntu@smithi032.front.sepia.ceph.com - ['osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'mon.a']
2022-05-01T14:15:39.481 INFO:teuthology.task.internal:roles: ubuntu@smithi050.front.sepia.ceph.com - ['osd.4', 'osd.5', 'osd.6', 'osd.7', 'mon.b', 'mgr.x']
2022-05-01T14:15:39.481 INFO:teuthology.task.internal:roles: ubuntu@smithi148.front.sepia.ceph.com - ['osd.8', 'osd.9', 'osd.10', 'osd.11', 'mon.c']
2022-05-01T14:15:39.481 INFO:teuthology.misc:Compressing logs...
2022-05-01T14:15:39.481 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com'
2022-05-01T14:15:39.754 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com'
2022-05-01T14:15:40.375 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com'
2022-05-01T14:15:41.763 INFO:teuthology.kill:No teuthology processes running
2022-05-01T14:15:43.172 INFO:teuthology.kill:Nuking machines: ['smithi032', 'smithi050', 'smithi148']
2022-05-01T14:15:44.357 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_135488acc76a85490d37201ec506706cc4ab2d62/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2022-05-01T14:15:44.358 INFO:teuthology.kill:  from cryptography.hazmat.backends import default_backend
2022-05-01T14:15:44.358 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_135488acc76a85490d37201ec506706cc4ab2d62/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:236: CryptographyDeprecationWarning: Blowfish has been deprecated
2022-05-01T14:15:44.358 INFO:teuthology.kill:  "class": algorithms.Blowfish,
2022-05-01T14:15:44.358 INFO:teuthology.kill:2022-05-01 14:15:44,357.357 INFO:teuthology.nuke:targets:
2022-05-01T14:15:44.359 INFO:teuthology.kill:  smithi032.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDosjGZfwtlN0inH77+7NiAZm9MUHhjhx3BPCwFphYFaP6wDKkvsOs9bNryhS1BnNsDtqb2VwXIAuQVifYcLsiwIqNY5PYh5Vovhx5uX+AaRwC5qfY85w0ScXuQpATgmj8hDsjh/mtxQ4Wh69YKMBteTqO7ZKpl0zYbY3gMpiyPCcDvCKWRduiBQeWwvA2aQ5I6t6mVM6xN6i8nTbs5EQwLtB6GAG55qgUVcOreHO4qwunrAUgGb5U7ZsgHpnp34TCH+zfo+fMTA7SzzvrCAMiwA+pMmLiT8G7zczPnhljjyFyy68mbCCFfehCCmdkboumiVa1EPeSBDo4m+Wy/niBz
2022-05-01T14:15:44.359 INFO:teuthology.kill:  smithi050.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNfNvqgEKDhZf6DWndgQH8rSFm3ZqWux7CkpoMdO8spHTuXikPA6xxNC5D/MQzVJXymfaFFa1xiIjRabzsKGXYyxpup98XJGHrSX2RviFuOGovEYnvXFPmWS/MRy2mu1votngZ++YQRuTbFa2PXDmdXwdwVy315dvn8X+y2uBhn+CwdkRq6QhWNLRndDKwR6hiRhLfjUtG+yye0e4tE4AX2+XPx+2X3iWH25CbxFLdDSdOXFH7PWK3DUodBXRhrQZ0iaoY9NWP5gMZ+8C1OdKVfbUU+qXA+z1rnkDcVHQNX7ywazLalaqf0Ndbr1yht/UxD+4GjjQoBsuGReko9AMZ
2022-05-01T14:15:44.359 INFO:teuthology.kill:  smithi148.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaqspqD6GEdBEdgZ4dcQjZn39MjZhAA/gSEidFr68cwz/lLeYpTw68vLYnfpoLo7p35L3JoBj0Zc25sAR3itB5bwEf9hoTK7G0xw12G8zI5QExxqdesomHHHIc3lNPR8JiK4AQdenep2w4AkD4ZPBZXbJDZ9dvuCaqWJ1z4VuRSEUMJLcGwkl1+iNj9mCLiy16g2VDlfXk0LmE63g6My98M6PoN9zQLv/GaXwSIM/3XmGtMHE0+k2D3gvN74WZv8HR6W1ZL4FoTmuo+kosYi+C2IEMTWcVE765pJwA/AlzrjYzqIrLU4M1kIwQI1pRHlxufJE2imHN71pPoNSy7sQ3
2022-05-01T14:15:44.386 INFO:teuthology.kill:2022-05-01 14:15:44,386.386 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-05-01T14:15:44.392 INFO:teuthology.kill:2022-05-01 14:15:44,392.392 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-05-01T14:15:44.399 INFO:teuthology.kill:2022-05-01 14:15:44,399.399 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-05-01T14:15:44.480 INFO:teuthology.kill:2022-05-01 14:15:44,480.480 INFO:teuthology.orchestra.console:Power off smithi032
2022-05-01T14:15:44.495 INFO:teuthology.kill:2022-05-01 14:15:44,494.494 INFO:teuthology.orchestra.console:Power off smithi148
2022-05-01T14:15:44.508 INFO:teuthology.kill:2022-05-01 14:15:44,507.507 INFO:teuthology.orchestra.console:Power off smithi050
2022-05-01T14:15:52.878 INFO:teuthology.kill:2022-05-01 14:15:52,877.877 INFO:teuthology.orchestra.console:Power off for smithi050 completed
2022-05-01T14:15:53.025 INFO:teuthology.kill:2022-05-01 14:15:53,024.024 INFO:teuthology.lock.ops:unlocked: smithi050.front.sepia.ceph.com
2022-05-01T14:15:56.977 INFO:teuthology.kill:2022-05-01 14:15:56,977.977 INFO:teuthology.orchestra.console:Power off for smithi032 completed
2022-05-01T14:15:56.983 INFO:teuthology.kill:2022-05-01 14:15:56,983.983 INFO:teuthology.orchestra.console:Power off for smithi148 completed
2022-05-01T14:15:57.129 INFO:teuthology.kill:2022-05-01 14:15:57,128.128 INFO:teuthology.lock.ops:unlocked: smithi032.front.sepia.ceph.com
2022-05-01T14:15:57.132 INFO:teuthology.kill:2022-05-01 14:15:57,132.132 INFO:teuthology.lock.ops:unlocked: smithi148.front.sepia.ceph.com
2022-05-01T14:17:57.455 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-05-01T14:17:57.589 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi032 but it was locked by another job: /home/teuthworker/archive/vshankar-2022-05-01_13:18:44-fs-wip-vshankar-testing1-20220428-204527-testing-default-smithi/6817534
2022-05-01T14:17:57.589 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi050 but it was locked by another job: /home/teuthworker/archive/vshankar-2022-05-01_13:18:44-fs-wip-vshankar-testing1-20220428-204527-testing-default-smithi/6817534
2022-05-01T14:17:57.589 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi148 but it was locked by another job: /home/teuthworker/archive/vshankar-2022-05-01_13:18:44-fs-wip-vshankar-testing1-20220428-204527-testing-default-smithi/6817534