2022-09-29T23:10:04.311 INFO:root:teuthology version: 1.1.1.dev427+g35ea38a9 2022-09-29T23:10:04.505 INFO:teuthology.lock.ops:Start node 'smithi012.front.sepia.ceph.com' reimaging 2022-09-29T23:10:04.507 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: reset os type and version on server 2022-09-29T23:10:04.507 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2022-09-29T23:10:04.531 INFO:teuthology.lock.ops:Node 'smithi012.front.sepia.ceph.com' reimaging is complete 2022-09-29T23:10:04.531 INFO:teuthology.lock.ops:Start node 'smithi055.front.sepia.ceph.com' reimaging 2022-09-29T23:10:04.532 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: reset os type and version on server 2022-09-29T23:10:04.533 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2022-09-29T23:10:04.556 INFO:teuthology.lock.ops:Node 'smithi055.front.sepia.ceph.com' reimaging is complete 2022-09-29T23:10:04.557 INFO:teuthology.lock.ops:Start node 'smithi133.front.sepia.ceph.com' reimaging 2022-09-29T23:10:04.557 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: reset os type and version on server 2022-09-29T23:10:04.558 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2022-09-29T23:10:04.582 INFO:teuthology.lock.ops:Node 'smithi133.front.sepia.ceph.com' reimaging is complete 2022-09-29T23:10:04.745 INFO:teuthology.provision.fog.smithi012:Scheduling deploy of ubuntu 20.04 2022-09-29T23:10:04.781 INFO:teuthology.provision.fog.smithi055:Scheduling deploy of ubuntu 20.04 2022-09-29T23:10:04.790 INFO:teuthology.provision.fog.smithi133:Scheduling deploy of ubuntu 20.04 2022-09-29T23:10:05.076 INFO:teuthology.orchestra.console:Power off smithi012 2022-09-29T23:10:05.123 INFO:teuthology.orchestra.console:Power off smithi055 2022-09-29T23:10:05.141 INFO:teuthology.orchestra.console:Power off smithi133 2022-09-29T23:10:13.472 INFO:teuthology.orchestra.console:Power off for smithi012 completed 2022-09-29T23:10:13.516 INFO:teuthology.orchestra.console:Power off for smithi133 completed 2022-09-29T23:10:13.574 INFO:teuthology.orchestra.console:Power on smithi012 2022-09-29T23:10:13.619 INFO:teuthology.orchestra.console:Power on smithi133 2022-09-29T23:10:17.625 INFO:teuthology.orchestra.console:Power off for smithi055 completed 2022-09-29T23:10:17.727 INFO:teuthology.orchestra.console:Power on smithi055 2022-09-29T23:10:21.947 INFO:teuthology.orchestra.console:Power on for smithi012 completed 2022-09-29T23:10:21.979 INFO:teuthology.orchestra.console:Power on for smithi055 completed 2022-09-29T23:10:21.984 INFO:teuthology.orchestra.console:Power on for smithi133 completed 2022-09-29T23:10:22.049 INFO:teuthology.provision.fog.smithi012:Waiting for deploy to finish 2022-09-29T23:10:22.080 INFO:teuthology.provision.fog.smithi055:Waiting for deploy to finish 2022-09-29T23:10:22.085 INFO:teuthology.provision.fog.smithi133:Waiting for deploy to finish 2022-09-29T23:14:55.781 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-09-29T23:14:56.228 INFO:teuthology.provision.fog.smithi055:Node is ready 2022-09-29T23:14:56.235 INFO:teuthology.orchestra.run.smithi055.stdout:smithi055.front.sepia.ceph.com 2022-09-29T23:14:56.244 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55 smithi055.front.sepia.ceph.com smithi055 2022-09-29T23:14:56.502 INFO:teuthology.provision.fog.smithi055:Deploy complete! 2022-09-29T23:15:21.219 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-09-29T23:15:21.678 INFO:teuthology.provision.fog.smithi133:Node is ready 2022-09-29T23:15:21.685 INFO:teuthology.orchestra.run.smithi133.stdout:smithi133.front.sepia.ceph.com 2022-09-29T23:15:21.734 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.15.133 smithi133.front.sepia.ceph.com smithi133 2022-09-29T23:15:21.938 INFO:teuthology.provision.fog.smithi133:Deploy complete! 2022-09-29T23:15:58.960 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-09-29T23:15:59.438 INFO:teuthology.provision.fog.smithi012:Node is ready 2022-09-29T23:15:59.445 INFO:teuthology.orchestra.run.smithi012.stdout:smithi012.front.sepia.ceph.com 2022-09-29T23:15:59.452 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12 smithi012.front.sepia.ceph.com smithi012 2022-09-29T23:15:59.696 INFO:teuthology.provision.fog.smithi012:Deploy complete! 2022-09-29T23:16:00.012 INFO:teuthology.lock.ops:Checking smithi012.front.sepia.ceph.com 2022-09-29T23:16:00.013 INFO:teuthology.lock.ops:New key found. Updating... 2022-09-29T23:16:00.035 INFO:teuthology.lock.ops:Checking smithi055.front.sepia.ceph.com 2022-09-29T23:16:00.036 INFO:teuthology.lock.ops:New key found. Updating... 2022-09-29T23:16:00.055 INFO:teuthology.lock.ops:Checking smithi133.front.sepia.ceph.com 2022-09-29T23:16:00.055 INFO:teuthology.lock.ops:New key found. Updating... 2022-09-29T23:16:00.082 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: set os type and version on server 2022-09-29T23:16:00.083 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2022-09-29T23:16:00.326 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64 2022-09-29T23:16:00.333 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="Ubuntu" 2022-09-29T23:16:00.333 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="20.04.5 LTS (Focal Fossa)" 2022-09-29T23:16:00.333 INFO:teuthology.orchestra.run.smithi012.stdout:ID=ubuntu 2022-09-29T23:16:00.333 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE=debian 2022-09-29T23:16:00.334 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="Ubuntu 20.04.5 LTS" 2022-09-29T23:16:00.334 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="20.04" 2022-09-29T23:16:00.334 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://www.ubuntu.com/" 2022-09-29T23:16:00.335 INFO:teuthology.orchestra.run.smithi012.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-09-29T23:16:00.335 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-09-29T23:16:00.335 INFO:teuthology.orchestra.run.smithi012.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-09-29T23:16:00.336 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_CODENAME=focal 2022-09-29T23:16:00.336 INFO:teuthology.orchestra.run.smithi012.stdout:UBUNTU_CODENAME=focal 2022-09-29T23:16:00.338 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2022-09-29T23:16:00.359 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: set os type and version on server 2022-09-29T23:16:00.360 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2022-09-29T23:16:00.679 INFO:teuthology.orchestra.run.smithi055.stdout:x86_64 2022-09-29T23:16:00.684 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="Ubuntu" 2022-09-29T23:16:00.685 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="20.04.5 LTS (Focal Fossa)" 2022-09-29T23:16:00.685 INFO:teuthology.orchestra.run.smithi055.stdout:ID=ubuntu 2022-09-29T23:16:00.686 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE=debian 2022-09-29T23:16:00.686 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="Ubuntu 20.04.5 LTS" 2022-09-29T23:16:00.687 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="20.04" 2022-09-29T23:16:00.687 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://www.ubuntu.com/" 2022-09-29T23:16:00.687 INFO:teuthology.orchestra.run.smithi055.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-09-29T23:16:00.688 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-09-29T23:16:00.688 INFO:teuthology.orchestra.run.smithi055.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-09-29T23:16:00.689 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_CODENAME=focal 2022-09-29T23:16:00.689 INFO:teuthology.orchestra.run.smithi055.stdout:UBUNTU_CODENAME=focal 2022-09-29T23:16:00.690 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2022-09-29T23:16:00.713 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: set os type and version on server 2022-09-29T23:16:00.714 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2022-09-29T23:16:01.081 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2022-09-29T23:16:01.089 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="Ubuntu" 2022-09-29T23:16:01.089 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="20.04.5 LTS (Focal Fossa)" 2022-09-29T23:16:01.090 INFO:teuthology.orchestra.run.smithi133.stdout:ID=ubuntu 2022-09-29T23:16:01.090 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE=debian 2022-09-29T23:16:01.090 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="Ubuntu 20.04.5 LTS" 2022-09-29T23:16:01.091 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="20.04" 2022-09-29T23:16:01.091 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://www.ubuntu.com/" 2022-09-29T23:16:01.091 INFO:teuthology.orchestra.run.smithi133.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-09-29T23:16:01.092 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-09-29T23:16:01.092 INFO:teuthology.orchestra.run.smithi133.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-09-29T23:16:01.092 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_CODENAME=focal 2022-09-29T23:16:01.093 INFO:teuthology.orchestra.run.smithi133.stdout:UBUNTU_CODENAME=focal 2022-09-29T23:16:01.093 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2022-09-29T23:16:01.209 INFO:teuthology.dispatcher.supervisor:Running job 7048173 2022-09-29T23:16:01.210 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_35ea38a9840006713a3d42472a2c536a25e88c15/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-09-29_16:44:24-rados-wip-lflores-testing-distro-default-smithi/7048173 --name yuriw-2022-09-29_16:44:24-rados-wip-lflores-testing-distro-default-smithi --description rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} -- /home/teuthworker/archive/yuriw-2022-09-29_16:44:24-rados-wip-lflores-testing-distro-default-smithi/7048173/orig.config.yaml 2022-09-29T23:16:01.216 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-09-29_16:44:24-rados-wip-lflores-testing-distro-default-smithi/7048173 2022-09-29T23:16:01.217 INFO:teuthology.dispatcher.supervisor:Job PID: 19639 2022-09-29T23:16:01.217 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-09-30T11:16:25.905 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-09-30T11:16:26.541 INFO:teuthology.kill:Killing Pids: {19639} 2022-09-30T11:16:28.299 INFO:teuthology.task.internal:roles: ubuntu@smithi012.front.sepia.ceph.com - ['osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'mon.a'] 2022-09-30T11:16:28.303 INFO:teuthology.task.internal:roles: ubuntu@smithi055.front.sepia.ceph.com - ['osd.4', 'osd.5', 'osd.6', 'osd.7', 'mon.b', 'mgr.x'] 2022-09-30T11:16:28.304 INFO:teuthology.task.internal:roles: ubuntu@smithi133.front.sepia.ceph.com - ['osd.8', 'osd.9', 'osd.10', 'osd.11', 'mon.c'] 2022-09-30T11:16:28.311 INFO:teuthology.misc:Compressing logs... 2022-09-30T11:16:28.327 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2022-09-30T11:16:29.241 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2022-09-30T11:16:29.499 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2022-09-30T11:16:30.069 INFO:teuthology.misc:Compressing logs... 2022-09-30T11:17:10.400 INFO:teuthology.misc:Compressing logs... 2022-09-30T11:18:42.038 INFO:teuthology.kill:No teuthology processes running 2022-09-30T11:18:43.519 INFO:teuthology.kill:Nuking machines: ['smithi012', 'smithi055', 'smithi133'] 2022-09-30T11:18:44.689 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_35ea38a9840006713a3d42472a2c536a25e88c15/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-09-30T11:18:44.690 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-09-30T11:18:44.691 INFO:teuthology.kill:2022-09-30 11:18:44,689.689 INFO:teuthology.nuke:targets: 2022-09-30T11:18:44.691 INFO:teuthology.kill: smithi012.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6L9P1ubIXPuA3H/4H+mA1EJHwBp49Mj6DPYx0E71iHUDU1WABLwCsgNCRT1gJumu+mExMPPOpkPgmM1vwl4zoj5iyCz4WDNMYG/ibxATNuhZWEVx9+yGsETQckuRkI/1FNVnKjzt5A22GZShm12dAdCiO0FtSaDseGKPiCY/e4eMAzRuCNfiyl3kYExKu6Dl7mtx57IjyxCZnC3PJiTvA3aU7xfUhKQqkUKdAbYruFaPq2q2XoaSw7eN0ytR4gWqZYfGB/IpkP4VcKoMS8Jr5Z0gRUYtq2ZB/4AkMRJ0nSMouBOCSM6Q31vjtVJTUCzcI2v56lsvSOcNel8LQIZMKZ7LVpVJz2/EwpKjwVGFAdoBW+q3cyIgUlc2wugqbV4jI+IdFG7nKGDYsrKTVHhPvzqSbpkF2s6DBHpo+r0as8HkRgxRk0e2ktl5iKgfUzVfPV5DATSgg7sDFEoB+dsVE7UpDljMcfKbkIKlkw4vzrlFV6bJUBenXhOiN2PemJHs= 2022-09-30T11:18:44.691 INFO:teuthology.kill: smithi055.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPXfjrpyxn+mw1pVxqbWOi2++voqWzs0CoKpNKg39/zaCOjXTeUiyGAjztORgmY/jqQSpxrJTAHp3MDKmFwYDNE= 2022-09-30T11:18:44.692 INFO:teuthology.kill: smithi133.front.sepia.ceph.com: ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEt3ykmWdo3qpwaTFkvidPHvAKDY0CLVdcsRcGxmCwqV 2022-09-30T11:18:44.692 INFO:teuthology.kill:2022-09-30 11:18:44,689.689 INFO:teuthology.nuke:Checking targets against current locks 2022-09-30T11:18:44.748 INFO:teuthology.kill:2022-09-30 11:18:44,747.747 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-09-30T11:18:44.783 INFO:teuthology.kill:2022-09-30 11:18:44,783.783 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-09-30T11:18:44.820 INFO:teuthology.kill:2022-09-30 11:18:44,820.820 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-09-30T11:18:44.844 INFO:teuthology.kill:2022-09-30 11:18:44,844.844 INFO:teuthology.orchestra.console:Power off smithi012 2022-09-30T11:18:44.887 INFO:teuthology.kill:2022-09-30 11:18:44,887.887 INFO:teuthology.orchestra.console:Power off smithi055 2022-09-30T11:18:44.924 INFO:teuthology.kill:2022-09-30 11:18:44,924.924 INFO:teuthology.orchestra.console:Power off smithi133 2022-09-30T11:18:57.333 INFO:teuthology.kill:2022-09-30 11:18:57,332.332 INFO:teuthology.orchestra.console:Power off for smithi012 completed 2022-09-30T11:18:57.361 INFO:teuthology.kill:2022-09-30 11:18:57,361.361 INFO:teuthology.orchestra.console:Power off for smithi055 completed 2022-09-30T11:18:57.395 INFO:teuthology.kill:2022-09-30 11:18:57,395.395 INFO:teuthology.orchestra.console:Power off for smithi133 completed 2022-09-30T11:18:57.485 INFO:teuthology.kill:2022-09-30 11:18:57,484.484 INFO:teuthology.lock.ops:unlocked: smithi012.front.sepia.ceph.com 2022-09-30T11:18:57.506 INFO:teuthology.kill:2022-09-30 11:18:57,506.506 INFO:teuthology.lock.ops:unlocked: smithi055.front.sepia.ceph.com 2022-09-30T11:18:57.538 INFO:teuthology.kill:2022-09-30 11:18:57,538.538 INFO:teuthology.lock.ops:unlocked: smithi133.front.sepia.ceph.com 2022-09-30T11:20:57.859 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-09-30T11:20:58.000 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi133 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-09-30_05:17:03-krbd-pacific-testing-default-smithi/7049154