2022-07-24T15:39:46.446 INFO:root:teuthology version: 1.1.1.dev389+g8d598431 2022-07-24T15:39:46.570 INFO:teuthology.lock.ops:Start node 'smithi071.front.sepia.ceph.com' reimaging 2022-07-24T15:39:46.571 INFO:teuthology.lock.ops:Updating [smithi071.front.sepia.ceph.com]: reset os type and version on server 2022-07-24T15:39:46.572 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2022-07-24T15:39:46.591 INFO:teuthology.lock.ops:Node 'smithi071.front.sepia.ceph.com' reimaging is complete 2022-07-24T15:39:46.592 INFO:teuthology.lock.ops:Start node 'smithi117.front.sepia.ceph.com' reimaging 2022-07-24T15:39:46.592 INFO:teuthology.lock.ops:Updating [smithi117.front.sepia.ceph.com]: reset os type and version on server 2022-07-24T15:39:46.592 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2022-07-24T15:39:46.612 INFO:teuthology.lock.ops:Node 'smithi117.front.sepia.ceph.com' reimaging is complete 2022-07-24T15:39:46.800 INFO:teuthology.provision.fog.smithi071:Scheduling deploy of rhel 8.6 2022-07-24T15:39:46.824 INFO:teuthology.provision.fog.smithi117:Scheduling deploy of rhel 8.6 2022-07-24T15:39:47.292 INFO:teuthology.orchestra.console:Power off smithi071 2022-07-24T15:39:47.367 INFO:teuthology.orchestra.console:Power off smithi117 2022-07-24T15:39:47.438 INFO:teuthology.orchestra.console:Power off for smithi071 completed 2022-07-24T15:39:47.508 INFO:teuthology.orchestra.console:Power off for smithi117 completed 2022-07-24T15:39:47.540 INFO:teuthology.orchestra.console:Power on smithi071 2022-07-24T15:39:47.608 INFO:teuthology.orchestra.console:Power on smithi117 2022-07-24T15:39:51.860 INFO:teuthology.orchestra.console:Power on for smithi117 completed 2022-07-24T15:39:51.961 INFO:teuthology.provision.fog.smithi117:Waiting for deploy to finish 2022-07-24T15:39:55.915 INFO:teuthology.orchestra.console:Power on for smithi071 completed 2022-07-24T15:39:56.016 INFO:teuthology.provision.fog.smithi071:Waiting for deploy to finish 2022-07-24T15:46:30.223 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-07-24T15:46:30.457 INFO:teuthology.provision.fog.smithi117:Node is ready 2022-07-24T15:46:30.487 INFO:teuthology.orchestra.run.smithi117.stdout:smithi117 2022-07-24T15:46:30.548 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117 smithi117.front.sepia.ceph.com smithi117 2022-07-24T15:46:30.952 INFO:teuthology.provision.fog.smithi117:Deploy complete! 2022-07-24T15:47:04.355 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-07-24T15:47:04.659 INFO:teuthology.provision.fog.smithi071:Node is ready 2022-07-24T15:47:04.740 INFO:teuthology.orchestra.run.smithi071.stdout:smithi071 2022-07-24T15:47:04.844 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71 smithi071.front.sepia.ceph.com smithi071 2022-07-24T15:47:05.424 INFO:teuthology.provision.fog.smithi071:Deploy complete! 2022-07-24T15:47:06.283 INFO:teuthology.lock.ops:Checking smithi071.front.sepia.ceph.com 2022-07-24T15:47:06.284 INFO:teuthology.lock.ops:New key found. Updating... 2022-07-24T15:47:06.399 INFO:teuthology.lock.ops:Checking smithi117.front.sepia.ceph.com 2022-07-24T15:47:06.400 INFO:teuthology.lock.ops:New key found. Updating... 2022-07-24T15:47:06.459 INFO:teuthology.lock.ops:Updating [smithi071.front.sepia.ceph.com]: set os type and version on server 2022-07-24T15:47:06.460 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2022-07-24T15:47:07.775 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64 2022-07-24T15:47:07.861 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="Red Hat Enterprise Linux" 2022-07-24T15:47:07.862 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="8.6 (Ootpa)" 2022-07-24T15:47:07.863 INFO:teuthology.orchestra.run.smithi071.stdout:ID="rhel" 2022-07-24T15:47:07.867 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="fedora" 2022-07-24T15:47:07.868 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="8.6" 2022-07-24T15:47:07.869 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el8" 2022-07-24T15:47:07.869 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2022-07-24T15:47:07.870 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2022-07-24T15:47:07.871 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2022-07-24T15:47:07.871 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://www.redhat.com/" 2022-07-24T15:47:07.872 INFO:teuthology.orchestra.run.smithi071.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-07-24T15:47:07.872 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-07-24T15:47:07.873 INFO:teuthology.orchestra.run.smithi071.stdout: 2022-07-24T15:47:07.873 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-07-24T15:47:07.873 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2022-07-24T15:47:07.876 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-07-24T15:47:07.882 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2022-07-24T15:47:07.889 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2022-07-24T15:47:08.023 INFO:teuthology.lock.ops:Updating [smithi117.front.sepia.ceph.com]: set os type and version on server 2022-07-24T15:47:08.024 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2022-07-24T15:47:09.595 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64 2022-07-24T15:47:09.716 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="Red Hat Enterprise Linux" 2022-07-24T15:47:09.716 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="8.6 (Ootpa)" 2022-07-24T15:47:09.717 INFO:teuthology.orchestra.run.smithi117.stdout:ID="rhel" 2022-07-24T15:47:09.717 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="fedora" 2022-07-24T15:47:09.717 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="8.6" 2022-07-24T15:47:09.717 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el8" 2022-07-24T15:47:09.718 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2022-07-24T15:47:09.830 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31" 2022-07-24T15:47:09.830 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2022-07-24T15:47:09.831 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://www.redhat.com/" 2022-07-24T15:47:09.831 INFO:teuthology.orchestra.run.smithi117.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-07-24T15:47:09.832 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-07-24T15:47:09.951 INFO:teuthology.orchestra.run.smithi117.stdout: 2022-07-24T15:47:09.951 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-07-24T15:47:09.952 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2022-07-24T15:47:09.952 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-07-24T15:47:09.952 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2022-07-24T15:47:09.953 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2022-07-24T15:47:11.265 INFO:teuthology.dispatcher.supervisor:Running job 6946365 2022-07-24T15:47:11.273 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_8d598431210977f8caccec83230b4bfec7bd5d3f/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-07-24_15:38:21-rados-wip-yuri3-testing-2022-07-21-1604-distro-default-smithi/6946365 --name yuriw-2022-07-24_15:38:21-rados-wip-yuri3-testing-2022-07-21-1604-distro-default-smithi --description rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/redirect_promote_tests} -- /home/teuthworker/archive/yuriw-2022-07-24_15:38:21-rados-wip-yuri3-testing-2022-07-21-1604-distro-default-smithi/6946365/orig.config.yaml 2022-07-24T15:47:11.509 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-07-24_15:38:21-rados-wip-yuri3-testing-2022-07-21-1604-distro-default-smithi/6946365 2022-07-24T15:47:11.526 INFO:teuthology.dispatcher.supervisor:Job PID: 31291 2022-07-24T15:47:11.527 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-07-25T03:48:14.979 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-07-25T03:48:15.127 INFO:teuthology.kill:Killing Pids: {31291} 2022-07-25T03:48:16.494 INFO:teuthology.task.internal:roles: ubuntu@smithi071.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-07-25T03:48:16.495 INFO:teuthology.task.internal:roles: ubuntu@smithi117.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-07-25T03:48:16.495 INFO:teuthology.misc:Compressing logs... 2022-07-25T03:48:16.496 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2022-07-25T03:48:16.701 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2022-07-25T03:48:17.011 INFO:teuthology.misc:Compressing logs... 2022-07-25T03:48:17.974 INFO:teuthology.orchestra.run.smithi117.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-07-25T03:48:18.206 INFO:teuthology.orchestra.run.smithi071.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-07-25T03:48:37.288 INFO:teuthology.misc:Compressing logs... 2022-07-25T03:48:48.119 INFO:teuthology.kill:No teuthology processes running 2022-07-25T03:48:49.428 INFO:teuthology.kill:Nuking machines: ['smithi071', 'smithi117'] 2022-07-25T03:48:50.518 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_8d598431210977f8caccec83230b4bfec7bd5d3f/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-07-25T03:48:50.519 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-07-25T03:48:50.520 INFO:teuthology.kill:2022-07-25 03:48:50,518.518 INFO:teuthology.nuke:targets: 2022-07-25T03:48:50.520 INFO:teuthology.kill: smithi071.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCrvuAmHGdNHfPh71f3QRwJU/5TDGWD043L/r6+ACKKmXmJ+gv6+MuBU+EAianFGJofBFCzSl+ytuwKUijxCSN1i3GdJ3E9lipMbCa6QhQM9bufyjEKN5FWXCTO32GvknTq+/okXkEExA4bYg+ie2B98p3YHyW4TImK5vPxxTZoX4Asw+SDzWAAmpX+MuFUYjmbpan/MSvFnz9I4vM6Z0EhSBd+8WN5BMbXY17Om4SWeXinttVjxiHM7BztpIgpVBg+EcLILkh6imoZUUrYQTlX2gnfIzYA9Lpkm3mxR/ArxOIzsSrfc58Mqz05PKM+iwQcgKlpWl8afMvi33fBaIt5lI8uILk7A8K9+B8InZ08a3koV4b8R3WGmKM9vRYFtrL2SYpAcEwSKeOhXbwP+Z79TT/dN1B0RvkTp+r3bT02WIFUtJ22cRKPLNcMw/1FmJSiWC4os1BZC2ygeAAaRnQCzSgvqL0xNSsxWOtf1kknNIXKe+fMj+fOjl5IMFvlTE= 2022-07-25T03:48:50.520 INFO:teuthology.kill: smithi117.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHnPe7llsgVL6VQQgAsAAoAVnp3+hPKMYG1pWJNYiv6jsdp4uzJU/VL3WbQyCdAnZ1AYFPHe+4EZ9mx8FstbRiGWJKxx4nA36Hwk6mYJlbrJ+Vmu9G0NnEvpzMSP+hSi8Q0kYFzLzmDRGXhh2TjyhCw5y/LzXrkzMbnOyHxN2EDHK2xgxItZafw4KcQdoOCtjZC+YcXdXO3bLUW29UZOoNNwWwkdeF48l89jIl79nW9FaprDSMiNq1qi+ID7ou4lpV8vSNALdN+NDUBcuHZMlfDNSnXvKZYEwSWIim9f/mfwWX0z/8XC+Q+TbGrxM33YTyjKyTrKdQmI1iabxVeK9otz5ysL3McSNijc71Q96Py69AjjHzEzrGew1nmam3AMjVxvZ7CQKl79hipeqQkV3iHh5zR4L+pBxNrMga/IfODGstwwZ68plVEhKZf63Mw/O/gXhIHhQMsAagov5gDsEbq6BKgGnG6DvLEXyIp4WOQIT2OU3Bp3aEgAbTRmy4n/U= 2022-07-25T03:48:50.521 INFO:teuthology.kill:2022-07-25 03:48:50,518.518 INFO:teuthology.nuke:Checking targets against current locks 2022-07-25T03:48:50.568 INFO:teuthology.kill:2022-07-25 03:48:50,568.568 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-07-25T03:48:50.593 INFO:teuthology.kill:2022-07-25 03:48:50,593.593 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-07-25T03:48:50.650 INFO:teuthology.kill:2022-07-25 03:48:50,649.649 INFO:teuthology.orchestra.console:Power off smithi071 2022-07-25T03:48:50.685 INFO:teuthology.kill:2022-07-25 03:48:50,685.685 INFO:teuthology.orchestra.console:Power off smithi117 2022-07-25T03:48:59.059 INFO:teuthology.kill:2022-07-25 03:48:59,058.058 INFO:teuthology.orchestra.console:Power off for smithi117 completed 2022-07-25T03:48:59.211 INFO:teuthology.kill:2022-07-25 03:48:59,211.211 INFO:teuthology.lock.ops:unlocked: smithi117.front.sepia.ceph.com 2022-07-25T03:49:03.133 INFO:teuthology.kill:2022-07-25 03:49:03,133.133 INFO:teuthology.orchestra.console:Power off for smithi071 completed 2022-07-25T03:49:03.282 INFO:teuthology.kill:2022-07-25 03:49:03,281.281 INFO:teuthology.lock.ops:unlocked: smithi071.front.sepia.ceph.com 2022-07-25T03:51:03.576 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15