2022-07-28T07:55:40.785 INFO:root:teuthology version: 1.1.1.dev399+g5f965ce1 2022-07-28T07:55:40.932 INFO:teuthology.lock.ops:Start node 'smithi018.front.sepia.ceph.com' reimaging 2022-07-28T07:55:40.933 INFO:teuthology.lock.ops:Updating [smithi018.front.sepia.ceph.com]: reset os type and version on server 2022-07-28T07:55:40.934 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server 2022-07-28T07:55:40.959 INFO:teuthology.lock.ops:Node 'smithi018.front.sepia.ceph.com' reimaging is complete 2022-07-28T07:55:40.960 INFO:teuthology.lock.ops:Start node 'smithi195.front.sepia.ceph.com' reimaging 2022-07-28T07:55:40.960 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: reset os type and version on server 2022-07-28T07:55:40.960 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2022-07-28T07:55:40.985 INFO:teuthology.lock.ops:Node 'smithi195.front.sepia.ceph.com' reimaging is complete 2022-07-28T07:55:41.172 INFO:teuthology.provision.fog.smithi018:Scheduling deploy of rhel 8.4 2022-07-28T07:55:41.194 INFO:teuthology.provision.fog.smithi195:Scheduling deploy of rhel 8.4 2022-07-28T07:55:41.500 INFO:teuthology.orchestra.console:Power off smithi195 2022-07-28T07:55:41.517 INFO:teuthology.orchestra.console:Power off smithi018 2022-07-28T07:55:41.652 INFO:teuthology.orchestra.console:Power off for smithi195 completed 2022-07-28T07:55:41.663 INFO:teuthology.orchestra.console:Power off for smithi018 completed 2022-07-28T07:55:41.753 INFO:teuthology.orchestra.console:Power on smithi195 2022-07-28T07:55:41.764 INFO:teuthology.orchestra.console:Power on smithi018 2022-07-28T07:55:46.034 INFO:teuthology.orchestra.console:Power on for smithi018 completed 2022-07-28T07:55:46.136 INFO:teuthology.provision.fog.smithi018:Waiting for deploy to finish 2022-07-28T07:55:50.137 INFO:teuthology.orchestra.console:Power on for smithi195 completed 2022-07-28T07:55:50.238 INFO:teuthology.provision.fog.smithi195:Waiting for deploy to finish 2022-07-28T07:58:02.037 ERROR:teuthology.orchestra.connection:Error authenticating with smithi018.front.sepia.ceph.com: Authentication failed. 2022-07-28T08:00:01.772 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-07-28T08:00:02.028 INFO:teuthology.provision.fog.smithi018:Node is ready 2022-07-28T08:00:02.044 INFO:teuthology.orchestra.run.smithi018.stdout:smithi018.front.sepia.ceph.com 2022-07-28T08:00:02.101 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18 smithi018.front.sepia.ceph.com smithi018 2022-07-28T08:00:02.442 INFO:teuthology.provision.fog.smithi018:Deploy complete! 2022-07-28T08:00:28.129 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-07-28T08:00:28.377 INFO:teuthology.provision.fog.smithi195:Node is ready 2022-07-28T08:00:28.393 INFO:teuthology.orchestra.run.smithi195.stdout:smithi195.front.sepia.ceph.com 2022-07-28T08:00:28.450 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.15.195 smithi195.front.sepia.ceph.com smithi195 2022-07-28T08:00:28.788 INFO:teuthology.provision.fog.smithi195:Deploy complete! 2022-07-28T08:00:29.038 INFO:teuthology.lock.ops:Checking smithi018.front.sepia.ceph.com 2022-07-28T08:00:29.039 INFO:teuthology.lock.ops:New key found. Updating... 2022-07-28T08:00:29.063 INFO:teuthology.lock.ops:Checking smithi195.front.sepia.ceph.com 2022-07-28T08:00:29.064 INFO:teuthology.lock.ops:New key found. Updating... 2022-07-28T08:00:29.086 INFO:teuthology.lock.ops:Updating [smithi018.front.sepia.ceph.com]: set os type and version on server 2022-07-28T08:00:29.087 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2022-07-28T08:00:29.249 INFO:teuthology.orchestra.run.smithi018.stdout:x86_64 2022-07-28T08:00:29.307 INFO:teuthology.orchestra.run.smithi018.stdout:NAME="Red Hat Enterprise Linux" 2022-07-28T08:00:29.307 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION="8.4 (Ootpa)" 2022-07-28T08:00:29.307 INFO:teuthology.orchestra.run.smithi018.stdout:ID="rhel" 2022-07-28T08:00:29.307 INFO:teuthology.orchestra.run.smithi018.stdout:ID_LIKE="fedora" 2022-07-28T08:00:29.308 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_ID="8.4" 2022-07-28T08:00:29.308 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM_ID="platform:el8" 2022-07-28T08:00:29.308 INFO:teuthology.orchestra.run.smithi018.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-07-28T08:00:29.308 INFO:teuthology.orchestra.run.smithi018.stdout:ANSI_COLOR="0;31" 2022-07-28T08:00:29.309 INFO:teuthology.orchestra.run.smithi018.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-07-28T08:00:29.309 INFO:teuthology.orchestra.run.smithi018.stdout:HOME_URL="https://www.redhat.com/" 2022-07-28T08:00:29.309 INFO:teuthology.orchestra.run.smithi018.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-07-28T08:00:29.309 INFO:teuthology.orchestra.run.smithi018.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-07-28T08:00:29.310 INFO:teuthology.orchestra.run.smithi018.stdout: 2022-07-28T08:00:29.310 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-07-28T08:00:29.310 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-07-28T08:00:29.310 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-07-28T08:00:29.310 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-07-28T08:00:29.312 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server 2022-07-28T08:00:29.342 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: set os type and version on server 2022-07-28T08:00:29.342 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2022-07-28T08:00:29.574 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2022-07-28T08:00:29.628 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="Red Hat Enterprise Linux" 2022-07-28T08:00:29.629 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="8.4 (Ootpa)" 2022-07-28T08:00:29.629 INFO:teuthology.orchestra.run.smithi195.stdout:ID="rhel" 2022-07-28T08:00:29.630 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="fedora" 2022-07-28T08:00:29.630 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="8.4" 2022-07-28T08:00:29.630 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el8" 2022-07-28T08:00:29.630 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-07-28T08:00:29.631 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2022-07-28T08:00:29.631 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-07-28T08:00:29.631 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://www.redhat.com/" 2022-07-28T08:00:29.631 INFO:teuthology.orchestra.run.smithi195.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-07-28T08:00:29.632 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-07-28T08:00:29.632 INFO:teuthology.orchestra.run.smithi195.stdout: 2022-07-28T08:00:29.632 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-07-28T08:00:29.632 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-07-28T08:00:29.632 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-07-28T08:00:29.633 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-07-28T08:00:29.633 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2022-07-28T08:00:29.745 INFO:teuthology.dispatcher.supervisor:Running job 6951648 2022-07-28T08:00:29.746 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_5f965ce157b8dcdaf2da92a5b5d1a63e787efdd9/virtualenv/bin/teuthology -v --owner scheduled_gabrioux@teuthology --archive /home/teuthworker/archive/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951648 --name gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi --description orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_rhel8 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} -- /home/teuthworker/archive/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951648/orig.config.yaml 2022-07-28T08:00:29.753 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951648 2022-07-28T08:00:29.754 INFO:teuthology.dispatcher.supervisor:Job PID: 12341 2022-07-28T08:00:29.755 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-07-28T20:00:54.143 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-07-28T20:00:54.343 INFO:teuthology.kill:Killing Pids: {12341} 2022-07-28T20:00:56.050 INFO:teuthology.task.internal:roles: ubuntu@smithi018.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.foo.a', 'node-exporter.a', 'alertmanager.a'] 2022-07-28T20:00:56.052 INFO:teuthology.task.internal:roles: ubuntu@smithi195.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a'] 2022-07-28T20:00:56.053 INFO:teuthology.misc:Compressing logs... 2022-07-28T20:00:56.054 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2022-07-28T20:00:56.273 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2022-07-28T20:00:56.601 INFO:teuthology.misc:Compressing logs... 2022-07-28T20:00:56.784 INFO:teuthology.misc:Compressing logs... 2022-07-28T20:00:59.107 INFO:teuthology.orchestra.run.smithi018.stderr:gzip: /var/log/ceph/e26f2742-0e4c-11ed-8430-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-07-28T20:01:01.233 INFO:teuthology.orchestra.run.smithi195.stderr:gzip: /var/log/ceph/e26f2742-0e4c-11ed-8430-001a4aab830c/ceph-mon.b.log: file size changed while zipping 2022-07-28T20:01:02.194 INFO:teuthology.orchestra.run.smithi018.stderr:gzip: /var/log/ceph/e26f2742-0e4c-11ed-8430-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-07-28T20:01:06.900 INFO:teuthology.orchestra.run.smithi018.stderr:gzip: /var/log/ceph/e26f2742-0e4c-11ed-8430-001a4aab830c/ceph-mon.c.log: file size changed while zipping 2022-07-28T20:01:09.207 INFO:teuthology.orchestra.run.smithi018.stderr:gzip: /var/log/ceph/e26f2742-0e4c-11ed-8430-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-07-28T20:01:16.262 INFO:teuthology.orchestra.run.smithi018.stderr:gzip: /var/log/ceph/e26f2742-0e4c-11ed-8430-001a4aab830c/ceph-mon.a.log: file size changed while zipping 2022-07-28T20:01:21.019 INFO:teuthology.kill:No teuthology processes running 2022-07-28T20:01:22.625 INFO:teuthology.kill:Nuking machines: ['smithi018', 'smithi195'] 2022-07-28T20:01:24.017 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_5f965ce157b8dcdaf2da92a5b5d1a63e787efdd9/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-07-28T20:01:24.018 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-07-28T20:01:24.018 INFO:teuthology.kill:2022-07-28 20:01:24,017.017 INFO:teuthology.nuke:targets: 2022-07-28T20:01:24.019 INFO:teuthology.kill: smithi018.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCv9c8bPZU9lBoVl8XbgKi+DlPxS76Ie8+V9adPkvvdLptpzm7RqTtEaL6UGDib5ppJkQWWoaxuJB6HV3vjXsEm1nOvNypDRjLeSkc0COv3MWQp1XBaAdb41NHB6DYctKlU6ZsoKbD4+jWhpVjpvZC4RthjtINu5JpUXBn5H+5Kprk8pcaxhHbcUiNUyWXzcWSmYwCv5S9hy+l1cqXTZqsRwIzKnP3j32iDdbMl1z0DXsHPVnslUNKzJ4Iqw6pZUtwo42c3AcXwF2w5uIWOuYtzD5LLPsm95gBhKXKOiLjcHOM4SBxO5xsVk6Rb0gM1htM+NqcH+CQCxLvGgg1lCelRcI3fknxs+nzZ+qzOtaigL/ThjT+uKHQCgeJg/y1uhQ1EzoOuklL1rDogrPSK+Ip6MyLJ44fhgyT70VPYvtg12X8sORCBKDZUMu4VvTC9d5WzVhHuq+DW/n8t3Cmn9oS1IG4+EpbU0rBBFw8DT2d0Wet1k1xtf2ad2ntr1YbrrOU= 2022-07-28T20:01:24.019 INFO:teuthology.kill: smithi195.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDUyKj+0VfFlujmmDojZxvru0sCLHXtxUa5mGUa9b9NqNxgw0BFYpVZeb3zYKSYq4phHsbkT59Us13kvHjBVZqEH6jYU4UDrNbo87DWU8O7EnTuQz6gOHRk99/WiBle46Lc9Cstv2+1izbPM66LCG5NsIlPOoewCMhcjcTi0XR5kFKkcjkxLoWeA2EDnyBjr/JoT/NIcwmHaybdHk59uL9rzBhdbWIvuLqRHiG8DgOI91iTAbR+BBN/uYwdZOREHwYPJvrfePoLvzNHS5DbqZysl1Ly//gHaSTjjLTlkhhyfnjNXJxjVLb/KTmO/+OJbTf1jakruNOlJriXyF4ixmT3aviJyPZLvGes4ZKhUQxzHgwUa80eNQcS2NfhQKAIvmFVL9aqFvTqq4BKGJ4nkY7GTsKOug4aBzWDivF++AJ13mNR5CCI34VxoisTlh+VY8nSNfyD0QfEBdCP9PMjuZ9h9EDyR8+vtd8uV7Wn7hLX386Uun41C+o9A4h1Ap2eEc= 2022-07-28T20:01:24.019 INFO:teuthology.kill:2022-07-28 20:01:24,017.017 INFO:teuthology.nuke:Checking targets against current locks 2022-07-28T20:01:24.073 INFO:teuthology.kill:2022-07-28 20:01:24,073.073 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-07-28T20:01:24.103 INFO:teuthology.kill:2022-07-28 20:01:24,102.102 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-07-28T20:01:24.172 INFO:teuthology.kill:2022-07-28 20:01:24,171.171 INFO:teuthology.orchestra.console:Power off smithi018 2022-07-28T20:01:24.224 INFO:teuthology.kill:2022-07-28 20:01:24,223.223 INFO:teuthology.orchestra.console:Power off smithi195 2022-07-28T20:01:32.573 INFO:teuthology.kill:2022-07-28 20:01:32,572.572 INFO:teuthology.orchestra.console:Power off for smithi018 completed 2022-07-28T20:01:32.609 INFO:teuthology.kill:2022-07-28 20:01:32,609.609 INFO:teuthology.orchestra.console:Power off for smithi195 completed 2022-07-28T20:01:32.751 INFO:teuthology.kill:2022-07-28 20:01:32,750.750 INFO:teuthology.lock.ops:unlocked: smithi018.front.sepia.ceph.com 2022-07-28T20:01:32.785 INFO:teuthology.kill:2022-07-28 20:01:32,784.784 INFO:teuthology.lock.ops:unlocked: smithi195.front.sepia.ceph.com 2022-07-28T20:03:33.064 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-07-28T20:03:33.172 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi018 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-07-28_15:17:14-fs-wip-yuri-testing-2022-07-25-0645-quincy-distro-default-smithi/6952521 2022-07-28T20:03:33.172 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi195 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-07-28_15:17:14-fs-wip-yuri-testing-2022-07-25-0645-quincy-distro-default-smithi/6952521