2022-06-28T12:26:26.478 INFO:root:teuthology version: 1.1.1.dev376+g082ae7ef 2022-06-28T12:26:26.656 INFO:teuthology.lock.ops:Start node 'smithi074.front.sepia.ceph.com' reimaging 2022-06-28T12:26:26.657 INFO:teuthology.lock.ops:Updating [smithi074.front.sepia.ceph.com]: reset os type and version on server 2022-06-28T12:26:26.658 INFO:teuthology.lock.ops:Updating smithi074.front.sepia.ceph.com on lock server 2022-06-28T12:26:26.680 INFO:teuthology.lock.ops:Node 'smithi074.front.sepia.ceph.com' reimaging is complete 2022-06-28T12:26:26.681 INFO:teuthology.lock.ops:Start node 'smithi096.front.sepia.ceph.com' reimaging 2022-06-28T12:26:26.684 INFO:teuthology.lock.ops:Updating [smithi096.front.sepia.ceph.com]: reset os type and version on server 2022-06-28T12:26:26.684 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server 2022-06-28T12:26:26.713 INFO:teuthology.lock.ops:Node 'smithi096.front.sepia.ceph.com' reimaging is complete 2022-06-28T12:26:26.911 INFO:teuthology.provision.fog.smithi074:Scheduling deploy of centos 8.stream 2022-06-28T12:26:26.936 INFO:teuthology.provision.fog.smithi096:Scheduling deploy of centos 8.stream 2022-06-28T12:26:27.251 INFO:teuthology.orchestra.console:Power off smithi074 2022-06-28T12:26:27.281 INFO:teuthology.orchestra.console:Power off smithi096 2022-06-28T12:26:35.649 INFO:teuthology.orchestra.console:Power off for smithi074 completed 2022-06-28T12:26:35.654 INFO:teuthology.orchestra.console:Power off for smithi096 completed 2022-06-28T12:26:35.752 INFO:teuthology.orchestra.console:Power on smithi074 2022-06-28T12:26:35.761 INFO:teuthology.orchestra.console:Power on smithi096 2022-06-28T12:26:44.115 INFO:teuthology.orchestra.console:Power on for smithi074 completed 2022-06-28T12:26:44.123 INFO:teuthology.orchestra.console:Power on for smithi096 completed 2022-06-28T12:26:44.217 INFO:teuthology.provision.fog.smithi074:Waiting for deploy to finish 2022-06-28T12:26:44.224 INFO:teuthology.provision.fog.smithi096:Waiting for deploy to finish 2022-06-28T12:31:13.328 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-06-28T12:31:13.629 INFO:teuthology.provision.fog.smithi096:Node is ready 2022-06-28T12:31:13.647 INFO:teuthology.orchestra.run.smithi096.stdout:smithi096.front.sepia.ceph.com 2022-06-28T12:31:13.707 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96 smithi096.front.sepia.ceph.com smithi096 2022-06-28T12:31:14.106 INFO:teuthology.provision.fog.smithi096:Deploy complete! 2022-06-28T12:31:22.161 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-06-28T12:31:22.477 INFO:teuthology.provision.fog.smithi074:Node is ready 2022-06-28T12:31:22.496 INFO:teuthology.orchestra.run.smithi074.stdout:smithi074.front.sepia.ceph.com 2022-06-28T12:31:22.555 INFO:teuthology.orchestra.run.smithi074.stdout:172.21.15.74 smithi074.front.sepia.ceph.com smithi074 2022-06-28T12:31:22.923 INFO:teuthology.provision.fog.smithi074:Deploy complete! 2022-06-28T12:31:23.094 INFO:teuthology.lock.ops:Checking smithi074.front.sepia.ceph.com 2022-06-28T12:31:23.095 INFO:teuthology.lock.ops:New key found. Updating... 2022-06-28T12:31:23.115 INFO:teuthology.lock.ops:Checking smithi096.front.sepia.ceph.com 2022-06-28T12:31:23.115 INFO:teuthology.lock.ops:New key found. Updating... 2022-06-28T12:31:23.140 INFO:teuthology.lock.ops:Updating [smithi074.front.sepia.ceph.com]: set os type and version on server 2022-06-28T12:31:23.141 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi074.front.sepia.ceph.com' 2022-06-28T12:31:23.340 INFO:teuthology.orchestra.run.smithi074.stdout:x86_64 2022-06-28T12:31:23.398 INFO:teuthology.orchestra.run.smithi074.stdout:NAME="CentOS Stream" 2022-06-28T12:31:23.398 INFO:teuthology.orchestra.run.smithi074.stdout:VERSION="8" 2022-06-28T12:31:23.398 INFO:teuthology.orchestra.run.smithi074.stdout:ID="centos" 2022-06-28T12:31:23.399 INFO:teuthology.orchestra.run.smithi074.stdout:ID_LIKE="rhel fedora" 2022-06-28T12:31:23.399 INFO:teuthology.orchestra.run.smithi074.stdout:VERSION_ID="8" 2022-06-28T12:31:23.400 INFO:teuthology.orchestra.run.smithi074.stdout:PLATFORM_ID="platform:el8" 2022-06-28T12:31:23.400 INFO:teuthology.orchestra.run.smithi074.stdout:PRETTY_NAME="CentOS Stream 8" 2022-06-28T12:31:23.401 INFO:teuthology.orchestra.run.smithi074.stdout:ANSI_COLOR="0;31" 2022-06-28T12:31:23.401 INFO:teuthology.orchestra.run.smithi074.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-06-28T12:31:23.402 INFO:teuthology.orchestra.run.smithi074.stdout:HOME_URL="https://centos.org/" 2022-06-28T12:31:23.402 INFO:teuthology.orchestra.run.smithi074.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-06-28T12:31:23.402 INFO:teuthology.orchestra.run.smithi074.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-06-28T12:31:23.403 INFO:teuthology.orchestra.run.smithi074.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-06-28T12:31:23.405 INFO:teuthology.lock.ops:Updating smithi074.front.sepia.ceph.com on lock server 2022-06-28T12:31:23.427 INFO:teuthology.lock.ops:Updating [smithi096.front.sepia.ceph.com]: set os type and version on server 2022-06-28T12:31:23.428 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2022-06-28T12:31:23.641 INFO:teuthology.orchestra.run.smithi096.stdout:x86_64 2022-06-28T12:31:23.699 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="CentOS Stream" 2022-06-28T12:31:23.700 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="8" 2022-06-28T12:31:23.700 INFO:teuthology.orchestra.run.smithi096.stdout:ID="centos" 2022-06-28T12:31:23.700 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE="rhel fedora" 2022-06-28T12:31:23.700 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="8" 2022-06-28T12:31:23.701 INFO:teuthology.orchestra.run.smithi096.stdout:PLATFORM_ID="platform:el8" 2022-06-28T12:31:23.701 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="CentOS Stream 8" 2022-06-28T12:31:23.701 INFO:teuthology.orchestra.run.smithi096.stdout:ANSI_COLOR="0;31" 2022-06-28T12:31:23.701 INFO:teuthology.orchestra.run.smithi096.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-06-28T12:31:23.701 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://centos.org/" 2022-06-28T12:31:23.702 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-06-28T12:31:23.702 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-06-28T12:31:23.702 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-06-28T12:31:23.703 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server 2022-06-28T12:31:23.817 INFO:teuthology.dispatcher.supervisor:Running job 6901594 2022-06-28T12:31:23.817 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_082ae7ef4302fa54665ed0a2535e8e254118dcfd/virtualenv/bin/teuthology -v --owner scheduled_lflores@teuthology --archive /home/teuthworker/archive/lflores-2022-06-27_23:44:12-rados:thrash-erasure-code-wip-yuri2-testing-2022-04-26-1132-octopus-distro-default-smithi/6901594 --name lflores-2022-06-27_23:44:12-rados:thrash-erasure-code-wip-yuri2-testing-2022-04-26-1132-octopus-distro-default-smithi --description rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced} -- /home/teuthworker/archive/lflores-2022-06-27_23:44:12-rados:thrash-erasure-code-wip-yuri2-testing-2022-04-26-1132-octopus-distro-default-smithi/6901594/orig.config.yaml 2022-06-28T12:31:23.824 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/lflores-2022-06-27_23:44:12-rados:thrash-erasure-code-wip-yuri2-testing-2022-04-26-1132-octopus-distro-default-smithi/6901594 2022-06-28T12:31:23.825 INFO:teuthology.dispatcher.supervisor:Job PID: 1663 2022-06-28T12:31:23.825 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-06-29T00:32:38.470 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-06-29T00:32:39.144 INFO:teuthology.kill:Killing Pids: {1663} 2022-06-29T00:32:41.299 INFO:teuthology.task.internal:roles: ubuntu@smithi074.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-06-29T00:32:41.305 INFO:teuthology.task.internal:roles: ubuntu@smithi096.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-06-29T00:32:41.314 INFO:teuthology.misc:Compressing logs... 2022-06-29T00:32:41.338 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi074.front.sepia.ceph.com' 2022-06-29T00:32:42.595 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2022-06-29T00:32:43.428 INFO:teuthology.orchestra.run.smithi096.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-06-29T00:32:43.620 INFO:teuthology.orchestra.run.smithi074.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-06-29T00:32:44.674 INFO:teuthology.kill:No teuthology processes running 2022-06-29T00:32:46.445 INFO:teuthology.kill:Nuking machines: ['smithi074', 'smithi096'] 2022-06-29T00:32:47.671 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_082ae7ef4302fa54665ed0a2535e8e254118dcfd/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-06-29T00:32:47.672 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-06-29T00:32:47.672 INFO:teuthology.kill:2022-06-29 00:32:47,670.670 INFO:teuthology.nuke:targets: 2022-06-29T00:32:47.672 INFO:teuthology.kill: smithi074.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCbkbd2PjBodiFTf8LamTOdjg917mZmSk2eIY9AJuJN0WEu8EgoEyJz36HQZaVXDEi/BLdbP+Z8AB0t4JF+u6WjFR4OuP8Idsd6bAk1ewRL6ETki5KCeGnQeaefuDyrvvDiLkRWtFixgHPADQjB3R4rpA6sInVrr37+rfl9OO+924ib5tK8uht7tioSm4t3/zN9LPzJknZD80U+yehPCozsFgegafwzQEz/dWERcPqOy3Jk7PSuWEHxcP3kpY4dRISjSdlz2e5/T6Bd6h2Ik8bJXixhxp2EkH1j2OFDSQwItgpzhGBrCOhsvB8BA8p2bxxAHKFcfmn63qk0BBqO6RPxfdMkP4UnC8dJFbOAzh8LhZRaX3hOrBs2jks0i5+xxPlv14w9sT8o0NjzJPj7eN3+srGy3muPs+sYTDe6+9Vnd4bPayie0+MhwnToNJJGYPW6O7sv2iN42BOe+fYxYvq/csjc9zeR7JJiK6VnJ0PlFdoJpYRQrHQt59ZJd9k/6iU= 2022-06-29T00:32:47.673 INFO:teuthology.kill: smithi096.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEhG+tjNMUcQTBYobmXDJZtsvRQe0kEUY0OXdzTmjeifRFnN1gbtmerP2+VcYkenly3yWV+WJ/8yl1cE/TJDMqQ6/7VwknGJfkojB02ASrQg8G3ob/e861IcBQFG5HqClpS7OOY0K3TkSfNgWOW/CZeyWY4qg/MyxGAH7csmuuXljTdLRyIQPG/AupiJu9zV4rD2Tw2UPpP9ToCFpgZV1df6Y2A4xJufRhCY6uEggkowU2uMnG+Y28unxChYZfDYBJFYGPtQUZWiZtpvmyBet0/2/lBOx7z2FCctYiX1JyodFTLtPp73FbD/60zmuRg+3e+OEyVoXQI4m+Zlszoa3n4L5/tUNk3oVfBssBL/hCk2yhn/hBgMrU8F9ZmEr2QWXLfTBAsaI38xsxlUvIXG2EH1BJ85Mq+yAjIKE0eBha6q5WPYRvCJubK21xlAehn7/kuGMLxTN4UATgO0ibtWL6pZ40ky0H9xfLsFmGRngy7b/qnP60h9yg2FZX+zX2qHU= 2022-06-29T00:32:47.673 INFO:teuthology.kill:2022-06-29 00:32:47,671.671 INFO:teuthology.nuke:Checking targets against current locks 2022-06-29T00:32:47.736 INFO:teuthology.kill:2022-06-29 00:32:47,736.736 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-06-29T00:32:47.768 INFO:teuthology.kill:2022-06-29 00:32:47,768.768 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-06-29T00:32:47.827 INFO:teuthology.kill:2022-06-29 00:32:47,827.827 INFO:teuthology.orchestra.console:Power off smithi074 2022-06-29T00:32:47.876 INFO:teuthology.kill:2022-06-29 00:32:47,875.875 INFO:teuthology.orchestra.console:Power off smithi096 2022-06-29T00:32:56.271 INFO:teuthology.kill:2022-06-29 00:32:56,271.271 INFO:teuthology.orchestra.console:Power off for smithi096 completed 2022-06-29T00:32:56.461 INFO:teuthology.kill:2022-06-29 00:32:56,460.460 INFO:teuthology.lock.ops:unlocked: smithi096.front.sepia.ceph.com 2022-06-29T00:33:00.333 INFO:teuthology.kill:2022-06-29 00:33:00,332.332 INFO:teuthology.orchestra.console:Power off for smithi074 completed 2022-06-29T00:33:00.484 INFO:teuthology.kill:2022-06-29 00:33:00,484.484 INFO:teuthology.lock.ops:unlocked: smithi074.front.sepia.ceph.com 2022-06-29T00:35:00.883 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-06-29T00:35:01.019 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi074 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-06-28_04:17:04-fs-pacific-distro-default-smithi/6902200 2022-06-29T00:35:01.020 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi096 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-06-28_04:17:04-fs-pacific-distro-default-smithi/6902200