2022-08-18T19:12:06.589 INFO:root:teuthology version: 1.1.1.dev412+gb1d387f1
2022-08-18T19:12:06.758 INFO:teuthology.lock.ops:Start node 'smithi117.front.sepia.ceph.com' reimaging
2022-08-18T19:12:06.760 INFO:teuthology.lock.ops:Updating [smithi117.front.sepia.ceph.com]: reset os type and version on server
2022-08-18T19:12:06.760 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server
2022-08-18T19:12:06.782 INFO:teuthology.lock.ops:Node 'smithi117.front.sepia.ceph.com' reimaging is complete
2022-08-18T19:12:06.783 INFO:teuthology.lock.ops:Start node 'smithi123.front.sepia.ceph.com' reimaging
2022-08-18T19:12:06.784 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: reset os type and version on server
2022-08-18T19:12:06.784 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server
2022-08-18T19:12:06.815 INFO:teuthology.lock.ops:Node 'smithi123.front.sepia.ceph.com' reimaging is complete
2022-08-18T19:12:07.035 INFO:teuthology.provision.fog.smithi117:Scheduling deploy of rhel 8.6
2022-08-18T19:12:07.091 INFO:teuthology.provision.fog.smithi123:Scheduling deploy of rhel 8.6
2022-08-18T19:12:07.448 INFO:teuthology.orchestra.console:Power off smithi117
2022-08-18T19:12:07.528 INFO:teuthology.orchestra.console:Power off smithi123
2022-08-18T19:12:07.592 INFO:teuthology.orchestra.console:Power off for smithi117 completed
2022-08-18T19:12:07.670 INFO:teuthology.orchestra.console:Power off for smithi123 completed
2022-08-18T19:12:07.694 INFO:teuthology.orchestra.console:Power on smithi117
2022-08-18T19:12:07.772 INFO:teuthology.orchestra.console:Power on smithi123
2022-08-18T19:12:12.020 INFO:teuthology.orchestra.console:Power on for smithi123 completed
2022-08-18T19:12:12.121 INFO:teuthology.provision.fog.smithi123:Waiting for deploy to finish
2022-08-18T19:12:16.061 INFO:teuthology.orchestra.console:Power on for smithi117 completed
2022-08-18T19:12:16.162 INFO:teuthology.provision.fog.smithi117:Waiting for deploy to finish
2022-08-18T19:14:43.844 ERROR:teuthology.orchestra.connection:Error authenticating with smithi123.front.sepia.ceph.com: Authentication failed.
2022-08-18T19:16:22.675 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-08-18T19:16:47.958 INFO:teuthology.provision.fog.smithi123:Node is ready
2022-08-18T19:16:47.983 INFO:teuthology.orchestra.run.smithi123.stdout:smithi123.front.sepia.ceph.com
2022-08-18T19:16:48.047 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123 smithi123.front.sepia.ceph.com smithi123
2022-08-18T19:16:48.425 INFO:teuthology.provision.fog.smithi123:Deploy complete!
2022-08-18T19:16:57.334 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-08-18T19:16:57.591 INFO:teuthology.provision.fog.smithi117:Node is ready
2022-08-18T19:16:57.611 INFO:teuthology.orchestra.run.smithi117.stdout:smithi117
2022-08-18T19:16:57.669 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117 smithi117.front.sepia.ceph.com smithi117
2022-08-18T19:16:58.013 INFO:teuthology.provision.fog.smithi117:Deploy complete!
2022-08-18T19:16:58.228 INFO:teuthology.lock.ops:Checking smithi117.front.sepia.ceph.com
2022-08-18T19:16:58.229 INFO:teuthology.lock.ops:New key found. Updating...
2022-08-18T19:16:58.252 INFO:teuthology.lock.ops:Checking smithi123.front.sepia.ceph.com
2022-08-18T19:16:58.252 INFO:teuthology.lock.ops:New key found. Updating...
2022-08-18T19:16:58.273 INFO:teuthology.lock.ops:Updating [smithi117.front.sepia.ceph.com]: set os type and version on server
2022-08-18T19:16:58.274 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com'
2022-08-18T19:16:58.495 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64
2022-08-18T19:16:58.556 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="Red Hat Enterprise Linux"
2022-08-18T19:16:58.557 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="8.6 (Ootpa)"
2022-08-18T19:16:58.558 INFO:teuthology.orchestra.run.smithi117.stdout:ID="rhel"
2022-08-18T19:16:58.558 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="fedora"
2022-08-18T19:16:58.562 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="8.6"
2022-08-18T19:16:58.563 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el8"
2022-08-18T19:16:58.563 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2022-08-18T19:16:58.563 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31"
2022-08-18T19:16:58.564 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2022-08-18T19:16:58.564 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://www.redhat.com/"
2022-08-18T19:16:58.565 INFO:teuthology.orchestra.run.smithi117.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-08-18T19:16:58.566 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-08-18T19:16:58.566 INFO:teuthology.orchestra.run.smithi117.stdout:
2022-08-18T19:16:58.566 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-08-18T19:16:58.567 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2022-08-18T19:16:58.567 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-08-18T19:16:58.568 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2022-08-18T19:16:58.572 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server
2022-08-18T19:16:58.595 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: set os type and version on server
2022-08-18T19:16:58.596 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com'
2022-08-18T19:16:58.890 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64
2022-08-18T19:16:58.949 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="Red Hat Enterprise Linux"
2022-08-18T19:16:58.950 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="8.6 (Ootpa)"
2022-08-18T19:16:58.950 INFO:teuthology.orchestra.run.smithi123.stdout:ID="rhel"
2022-08-18T19:16:58.950 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="fedora"
2022-08-18T19:16:58.951 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="8.6"
2022-08-18T19:16:58.951 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el8"
2022-08-18T19:16:58.951 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2022-08-18T19:16:58.951 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31"
2022-08-18T19:16:58.952 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2022-08-18T19:16:58.952 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://www.redhat.com/"
2022-08-18T19:16:58.952 INFO:teuthology.orchestra.run.smithi123.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-08-18T19:16:58.952 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-08-18T19:16:58.953 INFO:teuthology.orchestra.run.smithi123.stdout:
2022-08-18T19:16:58.953 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-08-18T19:16:58.953 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2022-08-18T19:16:58.954 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-08-18T19:16:58.954 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2022-08-18T19:16:58.954 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server
2022-08-18T19:16:59.091 INFO:teuthology.dispatcher.supervisor:Running job 6978985
2022-08-18T19:16:59.092 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b1d387f12b117399cb87c86aaa341398fa0c0919/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-08-18_17:36:35-rados-wip-yuri5-testing-2022-08-18-0812-distro-default-smithi/6978985 --name yuriw-2022-08-18_17:36:35-rados-wip-yuri5-testing-2022-08-18-0812-distro-default-smithi --description rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} -- /home/teuthworker/archive/yuriw-2022-08-18_17:36:35-rados-wip-yuri5-testing-2022-08-18-0812-distro-default-smithi/6978985/orig.config.yaml
2022-08-18T19:16:59.097 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-08-18_17:36:35-rados-wip-yuri5-testing-2022-08-18-0812-distro-default-smithi/6978985
2022-08-18T19:16:59.099 INFO:teuthology.dispatcher.supervisor:Job PID: 29111
2022-08-18T19:16:59.099 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-08-19T07:17:22.171 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-08-19T07:17:22.377 INFO:teuthology.kill:Killing Pids: {29111}
2022-08-19T07:17:23.776 INFO:teuthology.task.internal:roles: ubuntu@smithi117.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2022-08-19T07:17:23.777 INFO:teuthology.task.internal:roles: ubuntu@smithi123.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2022-08-19T07:17:23.778 INFO:teuthology.misc:Compressing logs...
2022-08-19T07:17:23.778 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com'
2022-08-19T07:17:23.981 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com'
2022-08-19T07:17:24.324 INFO:teuthology.misc:Compressing logs...
2022-08-19T07:17:25.286 INFO:teuthology.orchestra.run.smithi123.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-08-19T07:17:25.535 INFO:teuthology.orchestra.run.smithi117.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-08-19T07:17:26.176 INFO:teuthology.misc:Compressing logs...
2022-08-19T07:18:30.659 INFO:teuthology.kill:No teuthology processes running
2022-08-19T07:18:32.011 INFO:teuthology.kill:Nuking machines: ['smithi117', 'smithi123']
2022-08-19T07:18:33.178 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b1d387f12b117399cb87c86aaa341398fa0c0919/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2022-08-19T07:18:33.179 INFO:teuthology.kill:  from cryptography.hazmat.backends import default_backend
2022-08-19T07:18:33.179 INFO:teuthology.kill:2022-08-19 07:18:33,178.178 INFO:teuthology.nuke:targets:
2022-08-19T07:18:33.180 INFO:teuthology.kill:  smithi117.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD0dDrfrwtV/txsELAxCSs8DNz5RkDnpGDO6rCIT87hk4lT6kVBO6Xl/HzJiUM80l6PrGofwBLw+oIAaYGKJyNFNnvm/seDE5aM+ZOVRAz+nDN+HfME/kUwPanIzBjT6EyTfG7cV9K17+0+O31sjGXRzTQCVC36Oek+t8u1HWFf4T7FuFNjTewCM62riLN9nJKqK3dLdIK0EP/TDHKhkBYQ42hft/7NHuhCIDwdmpAtsGL+M7biC9v9NyhtyyyePulElXHutLfax6viy3JxFSfsZ+Efd2XhMIToQbO7mTlKF5PYI2vg0dLeFOEtJiXeSlcUcSVaIwdCR/gW11boPYATbHZVzwAUqCHWaJYAgedW7iE6igwe8dOzxIiL9sTUMv20K8LvTZW4/lkbUSWAA9RT4VrbMuVx8RFqwlARm14L4LulRKDDI8uxFgk4CNOsNtFvPl1yeEKfOFUgjEMnOhLMPcL22qs29LYWSiXCyAfsn1hahLDEfE042UI/1jwiHb0=
2022-08-19T07:18:33.180 INFO:teuthology.kill:  smithi123.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDa3OJORTBqT4sSgwrIxJ/c2lQGufq1IVJ7/hoo1eSDlS6O5pm9HMJ+q1XkpizlhUGvvtjhfCI+4WSNKwFGGwLNHEnQ+XGcP9A707i2KNrfgPTyOdmnqcoWHhYn8M3UFE0sHVxHV7lIj5SPCGHBCrcZjwSN5pOOYEFxptqFV7rx4s6ZF4HQwZ705SJHBCwIBd59BhMsEwtoXeut4z6a7V3vmr2bRb1OQtEUkCVkUPJeoFvX+nzSG79J/ik4zqHf3Lk6+Jlyr/OBvEWTcsc+LYSU9ZuSv3nsAI6xBRDOCAB5hT7fiiObthZT4PuS9DkcNcx1q/7iddiUKtw7LOr8pQO7RxQNrAYMgRRbJTbrfIKMEPXyKsfbT/D3y72P6NKRV5vE9KUYXn4eoGKM8326IJhqClfBiGTFZZMPFSQsXhJ3hVfknyR3EejLjJKFz1yRFeMXXSW+QFieUig+cVU6Sitw2lYiP5BUFbr38eNBeHQdOLSRnwp/Z1HukiYzja9Gz18=
2022-08-19T07:18:33.181 INFO:teuthology.kill:2022-08-19 07:18:33,178.178 INFO:teuthology.nuke:Checking targets against current locks
2022-08-19T07:18:33.240 INFO:teuthology.kill:2022-08-19 07:18:33,240.240 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-08-19T07:18:33.267 INFO:teuthology.kill:2022-08-19 07:18:33,267.267 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-08-19T07:18:33.334 INFO:teuthology.kill:2022-08-19 07:18:33,333.333 INFO:teuthology.orchestra.console:Power off smithi117
2022-08-19T07:18:33.376 INFO:teuthology.kill:2022-08-19 07:18:33,376.376 INFO:teuthology.orchestra.console:Power off smithi123
2022-08-19T07:18:41.711 INFO:teuthology.kill:2022-08-19 07:18:41,710.710 INFO:teuthology.orchestra.console:Power off for smithi117 completed
2022-08-19T07:18:41.861 INFO:teuthology.kill:2022-08-19 07:18:41,860.860 INFO:teuthology.lock.ops:unlocked: smithi117.front.sepia.ceph.com
2022-08-19T07:18:45.854 INFO:teuthology.kill:2022-08-19 07:18:45,854.854 INFO:teuthology.orchestra.console:Power off for smithi123 completed
2022-08-19T07:18:46.011 INFO:teuthology.kill:2022-08-19 07:18:46,011.011 INFO:teuthology.lock.ops:unlocked: smithi123.front.sepia.ceph.com
2022-08-19T07:20:46.264 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-08-19T07:20:46.392 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi117 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-08-18_23:16:33-fs-wip-yuri10-testing-2022-08-18-1400-pacific-distro-default-smithi/6979592
2022-08-19T07:20:46.392 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi123 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-08-18_23:16:33-fs-wip-yuri10-testing-2022-08-18-1400-pacific-distro-default-smithi/6979591