2022-06-28T22:00:34.580 INFO:root:teuthology version: 1.1.1.dev379+gf58709e3 2022-06-28T22:00:34.740 INFO:teuthology.lock.ops:Start node 'smithi111.front.sepia.ceph.com' reimaging 2022-06-28T22:00:34.742 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: reset os type and version on server 2022-06-28T22:00:34.742 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2022-06-28T22:00:34.766 INFO:teuthology.lock.ops:Node 'smithi111.front.sepia.ceph.com' reimaging is complete 2022-06-28T22:00:34.766 INFO:teuthology.lock.ops:Start node 'smithi155.front.sepia.ceph.com' reimaging 2022-06-28T22:00:34.766 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: reset os type and version on server 2022-06-28T22:00:34.767 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2022-06-28T22:00:34.786 INFO:teuthology.lock.ops:Node 'smithi155.front.sepia.ceph.com' reimaging is complete 2022-06-28T22:00:34.981 INFO:teuthology.provision.fog.smithi111:Scheduling deploy of ubuntu 20.04 2022-06-28T22:00:35.003 INFO:teuthology.provision.fog.smithi155:Scheduling deploy of ubuntu 20.04 2022-06-28T22:00:35.410 INFO:teuthology.orchestra.console:Power off smithi155 2022-06-28T22:00:35.449 INFO:teuthology.orchestra.console:Power off smithi111 2022-06-28T22:00:43.824 INFO:teuthology.orchestra.console:Power off for smithi155 completed 2022-06-28T22:00:43.926 INFO:teuthology.orchestra.console:Power on smithi155 2022-06-28T22:00:47.963 INFO:teuthology.orchestra.console:Power off for smithi111 completed 2022-06-28T22:00:48.065 INFO:teuthology.orchestra.console:Power on smithi111 2022-06-28T22:00:48.204 INFO:teuthology.orchestra.console:Power on for smithi155 completed 2022-06-28T22:00:48.305 INFO:teuthology.provision.fog.smithi155:Waiting for deploy to finish 2022-06-28T22:00:52.337 INFO:teuthology.orchestra.console:Power on for smithi111 completed 2022-06-28T22:00:52.441 INFO:teuthology.provision.fog.smithi111:Waiting for deploy to finish 2022-06-28T22:04:50.008 ERROR:teuthology.orchestra.connection:Error authenticating with smithi155.front.sepia.ceph.com: Authentication timeout. 2022-06-28T22:05:41.501 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2022-06-28T22:06:03.366 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-06-28T22:06:03.925 INFO:teuthology.provision.fog.smithi155:Node is ready 2022-06-28T22:06:03.976 INFO:teuthology.orchestra.run.smithi155.stdout:smithi155.front.sepia.ceph.com 2022-06-28T22:06:03.985 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155 smithi155.front.sepia.ceph.com smithi155 2022-06-28T22:06:04.206 INFO:teuthology.provision.fog.smithi155:Deploy complete! 2022-06-28T22:06:26.320 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-06-28T22:06:26.887 INFO:teuthology.provision.fog.smithi111:Node is ready 2022-06-28T22:06:26.908 INFO:teuthology.orchestra.run.smithi111.stdout:smithi111.front.sepia.ceph.com 2022-06-28T22:06:26.964 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111 smithi111.front.sepia.ceph.com smithi111 2022-06-28T22:06:27.337 INFO:teuthology.provision.fog.smithi111:Deploy complete! 2022-06-28T22:06:27.634 INFO:teuthology.lock.ops:Checking smithi111.front.sepia.ceph.com 2022-06-28T22:06:27.635 INFO:teuthology.lock.ops:New key found. Updating... 2022-06-28T22:06:27.685 INFO:teuthology.lock.ops:Checking smithi155.front.sepia.ceph.com 2022-06-28T22:06:27.686 INFO:teuthology.lock.ops:New key found. Updating... 2022-06-28T22:06:27.720 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: set os type and version on server 2022-06-28T22:06:27.720 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2022-06-28T22:06:28.027 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64 2022-06-28T22:06:28.035 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Ubuntu" 2022-06-28T22:06:28.036 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2022-06-28T22:06:28.036 INFO:teuthology.orchestra.run.smithi111.stdout:ID=ubuntu 2022-06-28T22:06:28.036 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE=debian 2022-06-28T22:06:28.037 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2022-06-28T22:06:28.037 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="20.04" 2022-06-28T22:06:28.037 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.ubuntu.com/" 2022-06-28T22:06:28.038 INFO:teuthology.orchestra.run.smithi111.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-06-28T22:06:28.038 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-06-28T22:06:28.039 INFO:teuthology.orchestra.run.smithi111.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-06-28T22:06:28.039 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_CODENAME=focal 2022-06-28T22:06:28.039 INFO:teuthology.orchestra.run.smithi111.stdout:UBUNTU_CODENAME=focal 2022-06-28T22:06:28.042 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2022-06-28T22:06:28.099 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: set os type and version on server 2022-06-28T22:06:28.100 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2022-06-28T22:06:28.355 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64 2022-06-28T22:06:28.362 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="Ubuntu" 2022-06-28T22:06:28.363 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2022-06-28T22:06:28.363 INFO:teuthology.orchestra.run.smithi155.stdout:ID=ubuntu 2022-06-28T22:06:28.363 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE=debian 2022-06-28T22:06:28.364 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2022-06-28T22:06:28.364 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="20.04" 2022-06-28T22:06:28.365 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://www.ubuntu.com/" 2022-06-28T22:06:28.365 INFO:teuthology.orchestra.run.smithi155.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-06-28T22:06:28.365 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-06-28T22:06:28.366 INFO:teuthology.orchestra.run.smithi155.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-06-28T22:06:28.366 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_CODENAME=focal 2022-06-28T22:06:28.367 INFO:teuthology.orchestra.run.smithi155.stdout:UBUNTU_CODENAME=focal 2022-06-28T22:06:28.367 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2022-06-28T22:06:28.492 INFO:teuthology.dispatcher.supervisor:Running job 6903967 2022-06-28T22:06:28.493 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/bin/teuthology -v --owner scheduled_lflores@teuthology --archive /home/teuthworker/archive/lflores-2022-06-28_19:36:24-rados:thrash-erasure-code-wip-yuri5-testing-2022-06-27-0923-octopus-distro-default-smithi/6903967 --name lflores-2022-06-28_19:36:24-rados:thrash-erasure-code-wip-yuri5-testing-2022-06-27-0923-octopus-distro-default-smithi --description rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced} -- /home/teuthworker/archive/lflores-2022-06-28_19:36:24-rados:thrash-erasure-code-wip-yuri5-testing-2022-06-27-0923-octopus-distro-default-smithi/6903967/orig.config.yaml 2022-06-28T22:06:28.498 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/lflores-2022-06-28_19:36:24-rados:thrash-erasure-code-wip-yuri5-testing-2022-06-27-0923-octopus-distro-default-smithi/6903967 2022-06-28T22:06:28.498 INFO:teuthology.dispatcher.supervisor:Job PID: 24474 2022-06-28T22:06:28.499 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-06-29T10:07:31.479 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-06-29T10:07:31.678 INFO:teuthology.kill:Killing Pids: {24474} 2022-06-29T10:07:33.169 INFO:teuthology.task.internal:roles: ubuntu@smithi111.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-06-29T10:07:33.170 INFO:teuthology.task.internal:roles: ubuntu@smithi155.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-06-29T10:07:33.170 INFO:teuthology.misc:Compressing logs... 2022-06-29T10:07:33.171 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2022-06-29T10:07:33.449 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2022-06-29T10:07:33.768 INFO:teuthology.misc:Compressing logs... 2022-06-29T10:07:34.628 INFO:teuthology.misc:Compressing logs... 2022-06-29T10:12:20.705 INFO:teuthology.kill:No teuthology processes running 2022-06-29T10:12:22.062 INFO:teuthology.kill:Nuking machines: ['smithi111', 'smithi155'] 2022-06-29T10:12:23.251 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-06-29T10:12:23.252 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-06-29T10:12:23.252 INFO:teuthology.kill:2022-06-29 10:12:23,250.250 INFO:teuthology.nuke:targets: 2022-06-29T10:12:23.252 INFO:teuthology.kill: smithi111.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3AZpHnFyGMgQo6vrKapvUMqPjiU/waH8GcO7W92AZqixgjc4bYDkVf15vCS6T+lQ39j763iuerpUCTjJucYT82SsiToyYGWDQ8TGngGhDfRyX43Knq7042KrCDrQY0vDKxa1gEEDSaOnR2seQ3MORHJsKivo7xuUjHYxts+CJAhKpcNKZ4sILndTGegf2L3VLnVvxco/5tnPA2gl/e5ZUYh8j/JTrjBAC4P1UQ/ZZoJEfbgCQJCWtP7Tnn29F2UQ9QeLLv/aGNnHQoJsewaWkyD6Dm/HiHj1FVcjWIfLfJHDXCZOhg+cvNd0FuGKh2UpJDDzhLxWHUy6Cs1grH1hYsAr3I2rxMPeYRKSJ7L6AsEBvcyNZcMn/NfLjYsHFdhlU9BnD54ghRdhwkOEX5sU4RRp4WiYoBhSJ7cG6siemU8YfUKn1GkRK1nCGfhuacMqTyIDSAC8+nmxbeV/d9dwvF2YwZq/zutvlIWZP5afv9nIJQjg0rWcTia9FKvIJ5Bs= 2022-06-29T10:12:23.252 INFO:teuthology.kill: smithi155.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC31/ce449+ZbzVAIzxDORRU1m6Wj8BXno/xKXrGnowv+byjEKYkrYde24kYDbz5UqJz6a0cp2HslzM8WH9h6+4DsDaA1yBu4cNEdKI3QrdhUtK6mvhnN9MFQWGl/+1GhAeGpL8SV8pfar3xXjU7aieLjklQOPcc0RvqweXgjUpVXN4/6Xv0DQhGjEkFsleognQVINgFDehZeE2yfJbpBRXtl1TL31SR4zXBmINrz60uemHbvzdsb3u3vR8kbbuhQ2O8Fi0L6ELS8EhRHqlDY+UNLB8yVvLPiTgPXhR8u38/Xk9J6yKkz/NKzg7Cx5R7f7hcTFeD1kluX8f/HDp8bCm2Mv6F39J9fTrndziXGYY6WiJP78pRYmN9WUefyP7yzoMfW/OrLsCTv6a0CAeRPTjDwRVr+HaN+rtOqhsuoKNtV1qcs96qmYhi/4F+c32VNh3RJpEz2tj2tcLSbh0b/cEZe08pFBdQX39u6rLF1JOeNVWt6NFVjKsY3h9NVItYjk= 2022-06-29T10:12:23.253 INFO:teuthology.kill:2022-06-29 10:12:23,250.250 INFO:teuthology.nuke:Checking targets against current locks 2022-06-29T10:12:23.311 INFO:teuthology.kill:2022-06-29 10:12:23,310.310 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-06-29T10:12:23.345 INFO:teuthology.kill:2022-06-29 10:12:23,344.344 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-06-29T10:12:23.422 INFO:teuthology.kill:2022-06-29 10:12:23,422.422 INFO:teuthology.orchestra.console:Power off smithi111 2022-06-29T10:12:23.471 INFO:teuthology.kill:2022-06-29 10:12:23,471.471 INFO:teuthology.orchestra.console:Power off smithi155 2022-06-29T10:12:35.921 INFO:teuthology.kill:2022-06-29 10:12:35,920.920 INFO:teuthology.orchestra.console:Power off for smithi111 completed 2022-06-29T10:12:35.947 INFO:teuthology.kill:2022-06-29 10:12:35,947.947 INFO:teuthology.orchestra.console:Power off for smithi155 completed 2022-06-29T10:12:36.090 INFO:teuthology.kill:2022-06-29 10:12:36,089.089 INFO:teuthology.lock.ops:unlocked: smithi111.front.sepia.ceph.com 2022-06-29T10:12:36.106 INFO:teuthology.kill:2022-06-29 10:12:36,106.106 INFO:teuthology.lock.ops:unlocked: smithi155.front.sepia.ceph.com 2022-06-29T10:14:36.519 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-06-29T10:14:36.641 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi111 but it was locked by another job: /home/teuthworker/archive/dis-2022-06-29_07:05:22-rbd-wip-dis-testing-2-distro-default-smithi/6904852 2022-06-29T10:14:36.641 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi155 but it was locked by another job: /home/teuthworker/archive/dis-2022-06-29_07:05:22-rbd-wip-dis-testing-2-distro-default-smithi/6904852