2022-06-28T05:58:02.932 INFO:root:teuthology version: 1.1.1.dev376+g082ae7ef 2022-06-28T05:58:03.105 INFO:teuthology.lock.ops:Start node 'smithi008.front.sepia.ceph.com' reimaging 2022-06-28T05:58:03.107 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: reset os type and version on server 2022-06-28T05:58:03.107 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2022-06-28T05:58:03.132 INFO:teuthology.lock.ops:Node 'smithi008.front.sepia.ceph.com' reimaging is complete 2022-06-28T05:58:03.132 INFO:teuthology.lock.ops:Start node 'smithi035.front.sepia.ceph.com' reimaging 2022-06-28T05:58:03.133 INFO:teuthology.lock.ops:Updating [smithi035.front.sepia.ceph.com]: reset os type and version on server 2022-06-28T05:58:03.133 INFO:teuthology.lock.ops:Updating smithi035.front.sepia.ceph.com on lock server 2022-06-28T05:58:03.159 INFO:teuthology.lock.ops:Node 'smithi035.front.sepia.ceph.com' reimaging is complete 2022-06-28T05:58:03.358 INFO:teuthology.provision.fog.smithi008:Scheduling deploy of centos 8.stream 2022-06-28T05:58:03.385 INFO:teuthology.provision.fog.smithi035:Scheduling deploy of centos 8.stream 2022-06-28T05:58:03.689 INFO:teuthology.orchestra.console:Power off smithi008 2022-06-28T05:58:03.703 INFO:teuthology.orchestra.console:Power off smithi035 2022-06-28T05:58:03.836 INFO:teuthology.orchestra.console:Power off for smithi008 completed 2022-06-28T05:58:03.847 INFO:teuthology.orchestra.console:Power off for smithi035 completed 2022-06-28T05:58:03.938 INFO:teuthology.orchestra.console:Power on smithi008 2022-06-28T05:58:03.949 INFO:teuthology.orchestra.console:Power on smithi035 2022-06-28T05:58:12.312 INFO:teuthology.orchestra.console:Power on for smithi008 completed 2022-06-28T05:58:12.316 INFO:teuthology.orchestra.console:Power on for smithi035 completed 2022-06-28T05:58:12.414 INFO:teuthology.provision.fog.smithi008:Waiting for deploy to finish 2022-06-28T05:58:12.418 INFO:teuthology.provision.fog.smithi035:Waiting for deploy to finish 2022-06-28T06:01:51.944 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-06-28T06:02:12.324 INFO:teuthology.provision.fog.smithi035:Node is ready 2022-06-28T06:02:12.348 INFO:teuthology.orchestra.run.smithi035.stdout:smithi035.front.sepia.ceph.com 2022-06-28T06:02:12.409 INFO:teuthology.orchestra.run.smithi035.stdout:172.21.15.35 smithi035.front.sepia.ceph.com smithi035 2022-06-28T06:02:12.794 INFO:teuthology.provision.fog.smithi035:Deploy complete! 2022-06-28T06:02:41.437 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-06-28T06:02:41.729 INFO:teuthology.provision.fog.smithi008:Node is ready 2022-06-28T06:02:41.750 INFO:teuthology.orchestra.run.smithi008.stdout:smithi008.front.sepia.ceph.com 2022-06-28T06:02:41.810 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8 smithi008.front.sepia.ceph.com smithi008 2022-06-28T06:02:42.205 INFO:teuthology.provision.fog.smithi008:Deploy complete! 2022-06-28T06:02:42.378 INFO:teuthology.lock.ops:Checking smithi008.front.sepia.ceph.com 2022-06-28T06:02:42.379 INFO:teuthology.lock.ops:New key found. Updating... 2022-06-28T06:02:42.400 INFO:teuthology.lock.ops:Checking smithi035.front.sepia.ceph.com 2022-06-28T06:02:42.401 INFO:teuthology.lock.ops:New key found. Updating... 2022-06-28T06:02:42.420 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: set os type and version on server 2022-06-28T06:02:42.421 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2022-06-28T06:02:42.623 INFO:teuthology.orchestra.run.smithi008.stdout:x86_64 2022-06-28T06:02:42.682 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="CentOS Stream" 2022-06-28T06:02:42.683 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="8" 2022-06-28T06:02:42.683 INFO:teuthology.orchestra.run.smithi008.stdout:ID="centos" 2022-06-28T06:02:42.683 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="rhel fedora" 2022-06-28T06:02:42.684 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="8" 2022-06-28T06:02:42.684 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el8" 2022-06-28T06:02:42.684 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="CentOS Stream 8" 2022-06-28T06:02:42.684 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2022-06-28T06:02:42.685 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-06-28T06:02:42.685 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://centos.org/" 2022-06-28T06:02:42.685 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-06-28T06:02:42.685 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-06-28T06:02:42.686 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-06-28T06:02:42.687 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2022-06-28T06:02:42.707 INFO:teuthology.lock.ops:Updating [smithi035.front.sepia.ceph.com]: set os type and version on server 2022-06-28T06:02:42.707 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi035.front.sepia.ceph.com' 2022-06-28T06:02:42.962 INFO:teuthology.orchestra.run.smithi035.stdout:x86_64 2022-06-28T06:02:43.020 INFO:teuthology.orchestra.run.smithi035.stdout:NAME="CentOS Stream" 2022-06-28T06:02:43.020 INFO:teuthology.orchestra.run.smithi035.stdout:VERSION="8" 2022-06-28T06:02:43.021 INFO:teuthology.orchestra.run.smithi035.stdout:ID="centos" 2022-06-28T06:02:43.021 INFO:teuthology.orchestra.run.smithi035.stdout:ID_LIKE="rhel fedora" 2022-06-28T06:02:43.021 INFO:teuthology.orchestra.run.smithi035.stdout:VERSION_ID="8" 2022-06-28T06:02:43.022 INFO:teuthology.orchestra.run.smithi035.stdout:PLATFORM_ID="platform:el8" 2022-06-28T06:02:43.022 INFO:teuthology.orchestra.run.smithi035.stdout:PRETTY_NAME="CentOS Stream 8" 2022-06-28T06:02:43.023 INFO:teuthology.orchestra.run.smithi035.stdout:ANSI_COLOR="0;31" 2022-06-28T06:02:43.023 INFO:teuthology.orchestra.run.smithi035.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-06-28T06:02:43.023 INFO:teuthology.orchestra.run.smithi035.stdout:HOME_URL="https://centos.org/" 2022-06-28T06:02:43.024 INFO:teuthology.orchestra.run.smithi035.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-06-28T06:02:43.024 INFO:teuthology.orchestra.run.smithi035.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-06-28T06:02:43.025 INFO:teuthology.orchestra.run.smithi035.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-06-28T06:02:43.026 INFO:teuthology.lock.ops:Updating smithi035.front.sepia.ceph.com on lock server 2022-06-28T06:02:43.138 INFO:teuthology.dispatcher.supervisor:Running job 6901531 2022-06-28T06:02:43.139 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_082ae7ef4302fa54665ed0a2535e8e254118dcfd/virtualenv/bin/teuthology -v --owner scheduled_lflores@teuthology --archive /home/teuthworker/archive/lflores-2022-06-27_23:44:12-rados:thrash-erasure-code-wip-yuri2-testing-2022-04-26-1132-octopus-distro-default-smithi/6901531 --name lflores-2022-06-27_23:44:12-rados:thrash-erasure-code-wip-yuri2-testing-2022-04-26-1132-octopus-distro-default-smithi --description rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced} -- /home/teuthworker/archive/lflores-2022-06-27_23:44:12-rados:thrash-erasure-code-wip-yuri2-testing-2022-04-26-1132-octopus-distro-default-smithi/6901531/orig.config.yaml 2022-06-28T06:02:43.144 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/lflores-2022-06-27_23:44:12-rados:thrash-erasure-code-wip-yuri2-testing-2022-04-26-1132-octopus-distro-default-smithi/6901531 2022-06-28T06:02:43.145 INFO:teuthology.dispatcher.supervisor:Job PID: 6439 2022-06-28T06:02:43.145 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-06-28T18:03:41.899 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-06-28T18:03:42.074 INFO:teuthology.kill:Killing Pids: {6439} 2022-06-28T18:03:43.872 INFO:teuthology.task.internal:roles: ubuntu@smithi008.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-06-28T18:03:43.873 INFO:teuthology.task.internal:roles: ubuntu@smithi035.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-06-28T18:03:43.874 INFO:teuthology.misc:Compressing logs... 2022-06-28T18:03:43.874 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2022-06-28T18:03:44.093 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi035.front.sepia.ceph.com' 2022-06-28T18:03:44.958 INFO:teuthology.orchestra.run.smithi035.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-06-28T18:03:45.176 INFO:teuthology.orchestra.run.smithi008.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-06-28T18:03:45.763 INFO:teuthology.kill:No teuthology processes running 2022-06-28T18:03:47.308 INFO:teuthology.kill:Nuking machines: ['smithi008', 'smithi035'] 2022-06-28T18:03:48.534 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_082ae7ef4302fa54665ed0a2535e8e254118dcfd/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-06-28T18:03:48.535 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-06-28T18:03:48.536 INFO:teuthology.kill:2022-06-28 18:03:48,533.533 INFO:teuthology.nuke:targets: 2022-06-28T18:03:48.536 INFO:teuthology.kill: smithi008.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDdJeaUVqSP+mfCEUQm3rwkfun1ZHaxBuPGlTeVXcCYUFJOYa3UXxgsBOdczg1VsuuIzcPVlzYdEAeJ73BJIDl7kwAfmmNQ7PIT54bj5EmmwV8KlNI3rbxfkMNZloIW7GenObyWPAN+NBgwwOlB9bsE2ct3rnKYu8poCpjJGVSKPlwH1e+UwETSIu2EvswtjC6QAblgMj3AVJA6/PxKVjxkdPUJxNQHI+aczchek4qagolBgDMA8x608LV7VUzcFAeWx5yR657vb9uVB0jg4UK3Jb3DaAbC3r9ACc2wbwhGoafbgx+EL4gt+NbJthBMfbMViDV/1uSDtsYJ4uitL6lqFjxVpDkny3NDTwC8NcZQapwaIfVN4g1j0VyKf+CVAV6fixsX6LL3dVepw/1KTG7jpqeXGd3/IHNVtAN+g1rGBaYpNh4DG9ssgMY5o8DqiS+AjYPokk1MTtEsSw8aUCfEZJzMZWXwBpHJUrgoFZh/NLNTWtV7yf0QZnbU3P1Vfms= 2022-06-28T18:03:48.536 INFO:teuthology.kill: smithi035.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC7qG+yd3fCKEqjfaldFerEWhhgmUx+RRZCigmYmXt4/F6e8fdD44SCUI2PoAH5xOKV1ekejWBQ0cthMpbSEZZpt+NpGwtsJU6e2qC4QDm6bbvQUAAUF96x1QaNo5PzbVLV3iuAi2BazzVYo5T/GlpJKF3N2NaetiS2viN+x6VI7hn/KBgDyHQRPD7sOTNizu6WzM6VdcrBOUPUEqMLiAEMkEBuQcGE4xLHzMpM4WApoiLG8uQXe5IHf63O8paASoxxKxYZhj8mhCw+Qu6/DMgyqnhnlRJmgkEzw5O4B27aHE1JeANl8uFQ8lB7wtM3iz1sQ4mXHRI2RKhUIEggrTa/TihASIxLbdG676u5WNsm2u3RCW2VOkSrIMO8Ou8qNYTsIMXYf7DbXCmEg2ViNWrHNHYv/EJ5BWNLCX2m8R+ygjaEt1U6h0OUsOGg7f0j7T6NwDl1xJrxbmGcEGf5CRYYNYAcG51U3vZIOAwennPi2h4JcLkaAPIRoLL0sZsJfQc= 2022-06-28T18:03:48.537 INFO:teuthology.kill:2022-06-28 18:03:48,535.535 INFO:teuthology.nuke:Checking targets against current locks 2022-06-28T18:03:48.596 INFO:teuthology.kill:2022-06-28 18:03:48,595.595 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-06-28T18:03:48.633 INFO:teuthology.kill:2022-06-28 18:03:48,632.632 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-06-28T18:03:48.695 INFO:teuthology.kill:2022-06-28 18:03:48,694.694 INFO:teuthology.orchestra.console:Power off smithi008 2022-06-28T18:03:48.735 INFO:teuthology.kill:2022-06-28 18:03:48,735.735 INFO:teuthology.orchestra.console:Power off smithi035 2022-06-28T18:03:57.082 INFO:teuthology.kill:2022-06-28 18:03:57,082.082 INFO:teuthology.orchestra.console:Power off for smithi008 completed 2022-06-28T18:03:57.115 INFO:teuthology.kill:2022-06-28 18:03:57,114.114 INFO:teuthology.orchestra.console:Power off for smithi035 completed 2022-06-28T18:03:57.252 INFO:teuthology.kill:2022-06-28 18:03:57,251.251 INFO:teuthology.lock.ops:unlocked: smithi008.front.sepia.ceph.com 2022-06-28T18:03:57.273 INFO:teuthology.kill:2022-06-28 18:03:57,272.272 INFO:teuthology.lock.ops:unlocked: smithi035.front.sepia.ceph.com 2022-06-28T18:05:57.634 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-06-28T18:05:57.751 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi008 but it was locked by another job: /home/teuthworker/archive/lflores-2022-06-27_23:44:12-rados:thrash-erasure-code-wip-yuri2-testing-2022-04-26-1132-octopus-distro-default-smithi/6901666 2022-06-28T18:05:57.751 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi035 but it was locked by another job: /home/teuthworker/archive/lflores-2022-06-27_23:44:12-rados:thrash-erasure-code-wip-yuri2-testing-2022-04-26-1132-octopus-distro-default-smithi/6901666