2022-09-14T17:53:06.451 INFO:root:teuthology version: 1.1.1.dev418+gb58f2c18 2022-09-14T17:53:06.602 INFO:teuthology.lock.ops:Start node 'smithi055.front.sepia.ceph.com' reimaging 2022-09-14T17:53:06.603 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: reset os type and version on server 2022-09-14T17:53:06.604 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2022-09-14T17:53:06.625 INFO:teuthology.lock.ops:Node 'smithi055.front.sepia.ceph.com' reimaging is complete 2022-09-14T17:53:06.625 INFO:teuthology.lock.ops:Start node 'smithi142.front.sepia.ceph.com' reimaging 2022-09-14T17:53:06.627 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: reset os type and version on server 2022-09-14T17:53:06.627 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2022-09-14T17:53:06.650 INFO:teuthology.lock.ops:Node 'smithi142.front.sepia.ceph.com' reimaging is complete 2022-09-14T17:53:06.841 INFO:teuthology.provision.fog.smithi055:Scheduling deploy of rhel 8.4 2022-09-14T17:53:06.853 INFO:teuthology.provision.fog.smithi142:Scheduling deploy of rhel 8.4 2022-09-14T17:53:07.142 INFO:teuthology.orchestra.console:Power off smithi142 2022-09-14T17:53:07.160 INFO:teuthology.orchestra.console:Power off smithi055 2022-09-14T17:53:07.294 INFO:teuthology.orchestra.console:Power off for smithi142 completed 2022-09-14T17:53:07.306 INFO:teuthology.orchestra.console:Power off for smithi055 completed 2022-09-14T17:53:07.396 INFO:teuthology.orchestra.console:Power on smithi142 2022-09-14T17:53:07.408 INFO:teuthology.orchestra.console:Power on smithi055 2022-09-14T17:53:11.661 INFO:teuthology.orchestra.console:Power on for smithi055 completed 2022-09-14T17:53:11.763 INFO:teuthology.provision.fog.smithi055:Waiting for deploy to finish 2022-09-14T17:53:15.770 INFO:teuthology.orchestra.console:Power on for smithi142 completed 2022-09-14T17:53:15.872 INFO:teuthology.provision.fog.smithi142:Waiting for deploy to finish 2022-09-14T17:57:31.635 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-09-14T17:57:31.869 INFO:teuthology.provision.fog.smithi055:Node is ready 2022-09-14T17:57:31.885 INFO:teuthology.orchestra.run.smithi055.stdout:smithi055.front.sepia.ceph.com 2022-09-14T17:57:31.941 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55 smithi055.front.sepia.ceph.com smithi055 2022-09-14T17:57:32.295 INFO:teuthology.provision.fog.smithi055:Deploy complete! 2022-09-14T17:57:53.809 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-09-14T17:57:54.016 INFO:teuthology.provision.fog.smithi142:Node is ready 2022-09-14T17:57:54.032 INFO:teuthology.orchestra.run.smithi142.stdout:smithi142.front.sepia.ceph.com 2022-09-14T17:57:54.091 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142 smithi142.front.sepia.ceph.com smithi142 2022-09-14T17:57:54.418 INFO:teuthology.provision.fog.smithi142:Deploy complete! 2022-09-14T17:57:54.636 INFO:teuthology.lock.ops:Checking smithi055.front.sepia.ceph.com 2022-09-14T17:57:54.638 INFO:teuthology.lock.ops:New key found. Updating... 2022-09-14T17:57:54.674 INFO:teuthology.lock.ops:Checking smithi142.front.sepia.ceph.com 2022-09-14T17:57:54.675 INFO:teuthology.lock.ops:New key found. Updating... 2022-09-14T17:57:54.696 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: set os type and version on server 2022-09-14T17:57:54.697 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2022-09-14T17:57:54.953 INFO:teuthology.orchestra.run.smithi055.stdout:x86_64 2022-09-14T17:57:55.010 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="Red Hat Enterprise Linux" 2022-09-14T17:57:55.011 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="8.4 (Ootpa)" 2022-09-14T17:57:55.013 INFO:teuthology.orchestra.run.smithi055.stdout:ID="rhel" 2022-09-14T17:57:55.013 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE="fedora" 2022-09-14T17:57:55.014 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="8.4" 2022-09-14T17:57:55.014 INFO:teuthology.orchestra.run.smithi055.stdout:PLATFORM_ID="platform:el8" 2022-09-14T17:57:55.015 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-09-14T17:57:55.015 INFO:teuthology.orchestra.run.smithi055.stdout:ANSI_COLOR="0;31" 2022-09-14T17:57:55.016 INFO:teuthology.orchestra.run.smithi055.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-09-14T17:57:55.016 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://www.redhat.com/" 2022-09-14T17:57:55.016 INFO:teuthology.orchestra.run.smithi055.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-09-14T17:57:55.017 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-09-14T17:57:55.017 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-09-14T17:57:55.018 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-09-14T17:57:55.018 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-09-14T17:57:55.019 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-09-14T17:57:55.019 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-09-14T17:57:55.022 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2022-09-14T17:57:55.050 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: set os type and version on server 2022-09-14T17:57:55.051 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2022-09-14T17:57:55.309 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2022-09-14T17:57:55.365 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="Red Hat Enterprise Linux" 2022-09-14T17:57:55.366 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="8.4 (Ootpa)" 2022-09-14T17:57:55.366 INFO:teuthology.orchestra.run.smithi142.stdout:ID="rhel" 2022-09-14T17:57:55.367 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="fedora" 2022-09-14T17:57:55.367 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="8.4" 2022-09-14T17:57:55.368 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el8" 2022-09-14T17:57:55.368 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-09-14T17:57:55.368 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2022-09-14T17:57:55.369 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-09-14T17:57:55.369 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://www.redhat.com/" 2022-09-14T17:57:55.370 INFO:teuthology.orchestra.run.smithi142.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-09-14T17:57:55.370 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-09-14T17:57:55.370 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-09-14T17:57:55.370 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-09-14T17:57:55.371 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-09-14T17:57:55.371 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-09-14T17:57:55.372 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-09-14T17:57:55.373 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2022-09-14T17:57:55.480 INFO:teuthology.dispatcher.supervisor:Running job 7032626 2022-09-14T17:57:55.480 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/bin/teuthology -v --owner scheduled_lflores@teuthology --archive /home/teuthworker/archive/lflores-2022-09-14_15:11:39-rados-quincy-release-distro-default-smithi/7032626 --name lflores-2022-09-14_15:11:39-rados-quincy-release-distro-default-smithi --description rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} -- /home/teuthworker/archive/lflores-2022-09-14_15:11:39-rados-quincy-release-distro-default-smithi/7032626/orig.config.yaml 2022-09-14T17:57:55.487 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/lflores-2022-09-14_15:11:39-rados-quincy-release-distro-default-smithi/7032626 2022-09-14T17:57:55.488 INFO:teuthology.dispatcher.supervisor:Job PID: 10151 2022-09-14T17:57:55.488 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-09-15T05:58:54.186 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-09-15T05:58:54.468 INFO:teuthology.kill:Killing Pids: {10151} 2022-09-15T05:58:57.350 INFO:teuthology.task.internal:roles: ubuntu@smithi055.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-09-15T05:58:57.353 INFO:teuthology.task.internal:roles: ubuntu@smithi142.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-09-15T05:58:57.353 INFO:teuthology.misc:Compressing logs... 2022-09-15T05:58:57.355 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2022-09-15T05:58:57.610 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2022-09-15T05:58:58.116 INFO:teuthology.misc:Compressing logs... 2022-09-15T05:58:59.229 INFO:teuthology.orchestra.run.smithi142.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-09-15T05:58:59.316 INFO:teuthology.orchestra.run.smithi055.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-09-15T05:59:00.154 INFO:teuthology.misc:Compressing logs... 2022-09-15T05:59:27.609 INFO:teuthology.kill:No teuthology processes running 2022-09-15T05:59:30.286 INFO:teuthology.kill:Nuking machines: ['smithi055', 'smithi142'] 2022-09-15T05:59:33.576 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-09-15T05:59:33.577 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-09-15T05:59:33.578 INFO:teuthology.kill:2022-09-15 05:59:33,576.576 INFO:teuthology.nuke:targets: 2022-09-15T05:59:33.578 INFO:teuthology.kill: smithi055.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTGfu8uxoD5RRFHY4bHPxdddRK4IwlUva3oYXOH1BN7tFPgMrNBid92QGxZ/r7a1ZLx55RLI+SjO2/eypJVBG9NZQ3g5Ze5NOwsFWYzX7OzX6ES4zVu1sZzP686wju0GHea27vB5ztBUKjCro1iCI6vVuDA7LovGbL8FqD9JZeRj6ylYa1M2+IsOk420K0j0P2XLLYn92ywMXVR+33H01xBSZj0WukuBmYPOdFOuRyKCPm36o5KQ9fOfNEIunVw8VG44C3YvqkgHnO0FIXLATda1ipAADU7dMoQppfTtTL1yKJkque4zmzgf+TwWu3YjIPJNc1Nh2zbdGJlJOJYzk5jw/0mFGkTqZEvvHqiw3Wu2VA7oQiimC95oZmIx6CBKgLhZ8bsnRskhhq7xhCH2cNIjWXdQMLUhtoFjOARF2sT03pSystz41EHRX7unw/Ry0+15tCp6tOuBPuMCt/JyC0C7PjyCbwqFhL4EhqiTeWPNx1g59XjR96LsWtbBCnnwk= 2022-09-15T05:59:33.579 INFO:teuthology.kill: smithi142.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+g3p/ZKwm5i2qUSeF0LvtbjIojx1eGhLj31vxojqFpq1WCBw/a/9qV3PY+npKn468hv+CLCo0hzJyQKkXnFz4c3vg/uDQkBZ0/qdU10SUFtdgeGFOSSX6fF1XCiXlFvrGBsLXu0BzcojqVnVs7jOosVSOIgFk6VHMfMUd9l7SiIUT/lkcKR3cOGLQHVFvjqjEYslXD7DvfjA/vt5t+C/SoomMd3eXNAovq9zWBFMhOcXnjhMvwRg82Nc5wmOOZy05uj2DvR5xE68YIJsQIema802OUxVig4yn5z3LKyXBep49sFPg0nfNjVxI2EDCWWmsluhI2Y9vuP0ADXuddunGQTUxik9qTM8lswkTbZ3aLWRUBErz6t/y7OH8xUayjgR+610SIZVx3kVhXuqL1tifv59WouoZ2e3iexwxZmSBLzVmWAfNx0vym/Vh+YwIQoCpNZKEgtndkaW9yfTc3XH3jo6dMQWazaYJzM792/dTvHg+CCAk0cJdycMUp9eVHlE= 2022-09-15T05:59:33.579 INFO:teuthology.kill:2022-09-15 05:59:33,576.576 INFO:teuthology.nuke:Checking targets against current locks 2022-09-15T05:59:33.683 INFO:teuthology.kill:2022-09-15 05:59:33,683.683 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-09-15T05:59:33.744 INFO:teuthology.kill:2022-09-15 05:59:33,743.743 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-09-15T05:59:33.866 INFO:teuthology.kill:2022-09-15 05:59:33,858.858 INFO:teuthology.orchestra.console:Power off smithi055 2022-09-15T05:59:33.931 INFO:teuthology.kill:2022-09-15 05:59:33,931.931 INFO:teuthology.orchestra.console:Power off smithi142 2022-09-15T05:59:42.357 INFO:teuthology.kill:2022-09-15 05:59:42,357.357 INFO:teuthology.orchestra.console:Power off for smithi142 completed 2022-09-15T05:59:42.516 INFO:teuthology.kill:2022-09-15 05:59:42,516.516 INFO:teuthology.lock.ops:unlocked: smithi142.front.sepia.ceph.com 2022-09-15T05:59:46.462 INFO:teuthology.kill:2022-09-15 05:59:46,461.461 INFO:teuthology.orchestra.console:Power off for smithi055 completed 2022-09-15T05:59:46.628 INFO:teuthology.kill:2022-09-15 05:59:46,627.627 INFO:teuthology.lock.ops:unlocked: smithi055.front.sepia.ceph.com 2022-09-15T06:01:47.102 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-09-15T06:01:47.312 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi055 but it was locked by another job: /home/teuthworker/archive/pdhange-2022-09-15_04:10:46-rados-wip-pdhange-testing-distro-default-smithi/7033553 2022-09-15T06:01:47.312 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi142 but it was locked by another job: /home/teuthworker/archive/pdhange-2022-09-15_04:10:46-rados-wip-pdhange-testing-distro-default-smithi/7033552