2022-07-27T10:26:08.776 INFO:root:teuthology version: 1.1.1.dev399+g5f965ce1 2022-07-27T10:26:09.028 INFO:teuthology.lock.ops:Start node 'smithi027.front.sepia.ceph.com' reimaging 2022-07-27T10:26:09.030 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: reset os type and version on server 2022-07-27T10:26:09.031 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2022-07-27T10:26:09.065 INFO:teuthology.lock.ops:Node 'smithi027.front.sepia.ceph.com' reimaging is complete 2022-07-27T10:26:09.066 INFO:teuthology.lock.ops:Start node 'smithi042.front.sepia.ceph.com' reimaging 2022-07-27T10:26:09.066 INFO:teuthology.lock.ops:Updating [smithi042.front.sepia.ceph.com]: reset os type and version on server 2022-07-27T10:26:09.067 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server 2022-07-27T10:26:09.089 INFO:teuthology.lock.ops:Node 'smithi042.front.sepia.ceph.com' reimaging is complete 2022-07-27T10:26:09.403 INFO:teuthology.provision.fog.smithi027:Scheduling deploy of centos 8.stream 2022-07-27T10:26:09.424 INFO:teuthology.provision.fog.smithi042:Scheduling deploy of centos 8.stream 2022-07-27T10:26:09.835 INFO:teuthology.orchestra.console:Power off smithi027 2022-07-27T10:26:09.939 INFO:teuthology.orchestra.console:Power off smithi042 2022-07-27T10:26:18.398 INFO:teuthology.orchestra.console:Power off for smithi042 completed 2022-07-27T10:26:18.503 INFO:teuthology.orchestra.console:Power on smithi042 2022-07-27T10:26:22.445 INFO:teuthology.orchestra.console:Power off for smithi027 completed 2022-07-27T10:26:22.550 INFO:teuthology.orchestra.console:Power on smithi027 2022-07-27T10:26:26.999 INFO:teuthology.orchestra.console:Power on for smithi042 completed 2022-07-27T10:26:27.102 INFO:teuthology.provision.fog.smithi042:Waiting for deploy to finish 2022-07-27T10:26:31.088 INFO:teuthology.orchestra.console:Power on for smithi027 completed 2022-07-27T10:26:31.190 INFO:teuthology.provision.fog.smithi027:Waiting for deploy to finish 2022-07-27T10:29:48.393 ERROR:teuthology.orchestra.connection:Error authenticating with smithi027.front.sepia.ceph.com: Authentication failed. 2022-07-27T10:30:35.474 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-07-27T10:30:35.770 INFO:teuthology.provision.fog.smithi042:Node is ready 2022-07-27T10:30:35.807 INFO:teuthology.orchestra.run.smithi042.stdout:smithi042.front.sepia.ceph.com 2022-07-27T10:30:35.881 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42 smithi042.front.sepia.ceph.com smithi042 2022-07-27T10:30:36.292 INFO:teuthology.provision.fog.smithi042:Deploy complete! 2022-07-27T10:32:47.411 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-07-27T10:32:47.709 INFO:teuthology.provision.fog.smithi027:Node is ready 2022-07-27T10:32:47.737 INFO:teuthology.orchestra.run.smithi027.stdout:smithi027.front.sepia.ceph.com 2022-07-27T10:32:47.799 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27 smithi027.front.sepia.ceph.com smithi027 2022-07-27T10:32:48.273 INFO:teuthology.provision.fog.smithi027:Deploy complete! 2022-07-27T10:32:48.615 INFO:teuthology.lock.ops:Checking smithi027.front.sepia.ceph.com 2022-07-27T10:32:48.616 INFO:teuthology.lock.ops:New key found. Updating... 2022-07-27T10:32:48.648 INFO:teuthology.lock.ops:Checking smithi042.front.sepia.ceph.com 2022-07-27T10:32:48.649 INFO:teuthology.lock.ops:New key found. Updating... 2022-07-27T10:32:48.691 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: set os type and version on server 2022-07-27T10:32:48.692 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2022-07-27T10:32:49.219 INFO:teuthology.orchestra.run.smithi027.stdout:x86_64 2022-07-27T10:32:49.312 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="CentOS Stream" 2022-07-27T10:32:49.312 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="8" 2022-07-27T10:32:49.313 INFO:teuthology.orchestra.run.smithi027.stdout:ID="centos" 2022-07-27T10:32:49.314 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="rhel fedora" 2022-07-27T10:32:49.314 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="8" 2022-07-27T10:32:49.314 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el8" 2022-07-27T10:32:49.315 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="CentOS Stream 8" 2022-07-27T10:32:49.315 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31" 2022-07-27T10:32:49.315 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-07-27T10:32:49.317 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://centos.org/" 2022-07-27T10:32:49.318 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-07-27T10:32:49.318 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-07-27T10:32:49.319 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-07-27T10:32:49.321 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2022-07-27T10:32:49.390 INFO:teuthology.lock.ops:Updating [smithi042.front.sepia.ceph.com]: set os type and version on server 2022-07-27T10:32:49.390 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2022-07-27T10:32:50.038 INFO:teuthology.orchestra.run.smithi042.stdout:x86_64 2022-07-27T10:32:50.108 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="CentOS Stream" 2022-07-27T10:32:50.108 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="8" 2022-07-27T10:32:50.109 INFO:teuthology.orchestra.run.smithi042.stdout:ID="centos" 2022-07-27T10:32:50.109 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE="rhel fedora" 2022-07-27T10:32:50.109 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="8" 2022-07-27T10:32:50.109 INFO:teuthology.orchestra.run.smithi042.stdout:PLATFORM_ID="platform:el8" 2022-07-27T10:32:50.110 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="CentOS Stream 8" 2022-07-27T10:32:50.110 INFO:teuthology.orchestra.run.smithi042.stdout:ANSI_COLOR="0;31" 2022-07-27T10:32:50.110 INFO:teuthology.orchestra.run.smithi042.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-07-27T10:32:50.110 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://centos.org/" 2022-07-27T10:32:50.111 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-07-27T10:32:50.111 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-07-27T10:32:50.111 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-07-27T10:32:50.112 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server 2022-07-27T10:32:50.282 INFO:teuthology.dispatcher.supervisor:Running job 6949801 2022-07-27T10:32:50.283 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_5f965ce157b8dcdaf2da92a5b5d1a63e787efdd9/virtualenv/bin/teuthology -v --owner scheduled_gabrioux@teuthology --archive /home/teuthworker/archive/gabrioux-2022-07-27_09:04:01-orch:cephadm-wip-guits-testing-2022-07-26-1524-quincy-distro-default-smithi/6949801 --name gabrioux-2022-07-27_09:04:01-orch:cephadm-wip-guits-testing-2022-07-26-1524-quincy-distro-default-smithi --description orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} -- /home/teuthworker/archive/gabrioux-2022-07-27_09:04:01-orch:cephadm-wip-guits-testing-2022-07-26-1524-quincy-distro-default-smithi/6949801/orig.config.yaml 2022-07-27T10:32:50.310 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/gabrioux-2022-07-27_09:04:01-orch:cephadm-wip-guits-testing-2022-07-26-1524-quincy-distro-default-smithi/6949801 2022-07-27T10:32:50.311 INFO:teuthology.dispatcher.supervisor:Job PID: 12784 2022-07-27T10:32:50.312 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-07-27T22:33:14.328 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-07-27T22:33:14.700 INFO:teuthology.kill:Killing Pids: {12784} 2022-07-27T22:33:18.379 INFO:teuthology.task.internal:roles: ubuntu@smithi027.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.foo.a', 'node-exporter.a', 'alertmanager.a'] 2022-07-27T22:33:18.381 INFO:teuthology.task.internal:roles: ubuntu@smithi042.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a'] 2022-07-27T22:33:18.382 INFO:teuthology.misc:Compressing logs... 2022-07-27T22:33:18.383 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2022-07-27T22:33:18.728 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2022-07-27T22:33:19.202 INFO:teuthology.misc:Compressing logs... 2022-07-27T22:33:19.442 INFO:teuthology.misc:Compressing logs... 2022-07-27T22:33:24.155 INFO:teuthology.orchestra.run.smithi042.stderr:gzip: /var/log/ceph/fe068734-0d98-11ed-8430-001a4aab830c/ceph-mon.b.log: file size changed while zipping 2022-07-27T22:33:24.376 INFO:teuthology.orchestra.run.smithi027.stderr:gzip: /var/log/ceph/fe068734-0d98-11ed-8430-001a4aab830c/ceph-mon.c.log: file size changed while zipping 2022-07-27T22:33:27.291 INFO:teuthology.orchestra.run.smithi027.stderr:gzip: /var/log/ceph/fe068734-0d98-11ed-8430-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-07-27T22:33:29.550 INFO:teuthology.orchestra.run.smithi027.stderr:gzip: /var/log/ceph/fe068734-0d98-11ed-8430-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-07-27T22:33:36.524 INFO:teuthology.orchestra.run.smithi027.stderr:gzip: /var/log/ceph/fe068734-0d98-11ed-8430-001a4aab830c/ceph-mon.a.log: file size changed while zipping 2022-07-27T22:33:38.771 INFO:teuthology.orchestra.run.smithi027.stderr:gzip: /var/log/ceph/fe068734-0d98-11ed-8430-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-07-27T22:33:47.116 INFO:teuthology.kill:No teuthology processes running 2022-07-27T22:33:51.396 INFO:teuthology.kill:Nuking machines: ['smithi027', 'smithi042'] 2022-07-27T22:33:54.573 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_5f965ce157b8dcdaf2da92a5b5d1a63e787efdd9/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-07-27T22:33:54.575 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-07-27T22:33:54.575 INFO:teuthology.kill:2022-07-27 22:33:54,573.573 INFO:teuthology.nuke:targets: 2022-07-27T22:33:54.576 INFO:teuthology.kill: smithi027.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCtpQmYuIn87W6MGfgFhH8iH6WZwKnBa7NbZEuMxmEDLDJMp5t2ryYQGyool3+RDimciitE52yZGV1liEcXi4O+xkqSJBNup9mavbUECl1jM3+vr9UCPMy4yQrcK+zg466PY3TGThuRnoQpAJYdhTN2xzr81YZKHJBlC/Cfer45efopnFAzV9TZ0iTb3m+3mqbSZp4TTeZpqML+YGySvLYOP1ZZfCoWOwNpwEq/HPoYEy6deeZh/ustigHFcrtXqVUbtYTE3YSwJDex/aU/oqHhXI4uZD88n69xPDA0TGfSxn/y9k39JPfQFeRnVyn8JsciCZvly++WmiTMsnNgKavWDkwz+2S9fGKlN5vNWHCuMo9Xp/X5gA6i8aBHH7mQofJRfxrylcmudSRjwS1QAlyOOwOIAYbccpbjGCdbe6h3ZufJXyHieoEbruDnt3CUHYog22J/lz7nJ3MMDX+UtAgp3/6cLlJSzVOz0DxVe/R/fGaEV7IUWij292KhnYQNR7E= 2022-07-27T22:33:54.576 INFO:teuthology.kill: smithi042.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD4YXIM2JZnKVf7Kr3X05L08j9e1fFJ0f5Wfl4+vpK7BdfM7QyPrDeps+Gjh8+f17oq/QLF5H26dNr9yUhIHnmZt1vOupK2DZEvBq+RisDOCOC+wJ1VLAZJbWurFTDobJPqKMAgFTK9XNlIafuOxyOsm4OLxlhc1oqTmMFGryB9nLKeiMLVPoGbY/DlpxFyQ2WA0juX82LAgNyRogMHx6d2gDfXDpzscKHU3Efrpec2SSYaVsS/bA0wFWD+eMsNgGtfTXEYTACLGSajMkqyER9sBjLIkOFasvWBnga14P2AG/rpcUTDnYOlwOaXZ36BfOHQr4LDx5W6gioGTz0MhM7ju1fRcgfOS9Why4PPquisgRazMLOyh2UUdIs7IxZQ+uq5kuYhwmJYMWLis+PveH+9kWNRoaI+qzXrh+WihpbWqo7stMYBumXQgr4VIh4oogrdMo9DU4npUp8whnw6rFz5HF1w7CghgEFVEKCE2E4DBd8EW5Y1ulciK0pBGpAhUvs= 2022-07-27T22:33:54.579 INFO:teuthology.kill:2022-07-27 22:33:54,577.577 INFO:teuthology.nuke:Checking targets against current locks 2022-07-27T22:33:54.735 INFO:teuthology.kill:2022-07-27 22:33:54,735.735 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-07-27T22:33:54.851 INFO:teuthology.kill:2022-07-27 22:33:54,850.850 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-07-27T22:33:55.114 INFO:teuthology.kill:2022-07-27 22:33:55,114.114 INFO:teuthology.orchestra.console:Power off smithi027 2022-07-27T22:33:55.268 INFO:teuthology.kill:2022-07-27 22:33:55,263.263 INFO:teuthology.orchestra.console:Power off smithi042 2022-07-27T22:34:03.665 INFO:teuthology.kill:2022-07-27 22:34:03,663.663 INFO:teuthology.orchestra.console:Power off for smithi027 completed 2022-07-27T22:34:03.721 INFO:teuthology.kill:2022-07-27 22:34:03,721.721 INFO:teuthology.orchestra.console:Power off for smithi042 completed 2022-07-27T22:34:03.878 INFO:teuthology.kill:2022-07-27 22:34:03,872.872 INFO:teuthology.lock.ops:unlocked: smithi027.front.sepia.ceph.com 2022-07-27T22:34:03.947 INFO:teuthology.kill:2022-07-27 22:34:03,929.929 INFO:teuthology.lock.ops:unlocked: smithi042.front.sepia.ceph.com 2022-07-27T22:36:04.528 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-07-27T22:36:04.839 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi027 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-07-27_18:30:47-rados-wip-yuri7-testing-2022-07-27-0808-quincy-distro-default-smithi/6950434 2022-07-27T22:36:04.840 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi042 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-07-27_18:30:47-rados-wip-yuri7-testing-2022-07-27-0808-quincy-distro-default-smithi/6950434