2022-07-28T08:23:57.365 INFO:root:teuthology version: 1.1.1.dev399+g5f965ce1 2022-07-28T08:23:57.509 INFO:teuthology.lock.ops:Start node 'smithi145.front.sepia.ceph.com' reimaging 2022-07-28T08:23:57.511 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: reset os type and version on server 2022-07-28T08:23:57.512 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2022-07-28T08:23:57.536 INFO:teuthology.lock.ops:Node 'smithi145.front.sepia.ceph.com' reimaging is complete 2022-07-28T08:23:57.537 INFO:teuthology.lock.ops:Start node 'smithi192.front.sepia.ceph.com' reimaging 2022-07-28T08:23:57.537 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: reset os type and version on server 2022-07-28T08:23:57.538 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2022-07-28T08:23:57.562 INFO:teuthology.lock.ops:Node 'smithi192.front.sepia.ceph.com' reimaging is complete 2022-07-28T08:23:57.767 INFO:teuthology.provision.fog.smithi145:Scheduling deploy of centos 8.stream 2022-07-28T08:23:57.792 INFO:teuthology.provision.fog.smithi192:Scheduling deploy of centos 8.stream 2022-07-28T08:23:58.074 INFO:teuthology.orchestra.console:Power off smithi145 2022-07-28T08:23:58.091 INFO:teuthology.orchestra.console:Power off smithi192 2022-07-28T08:23:58.232 INFO:teuthology.orchestra.console:Power off for smithi192 completed 2022-07-28T08:23:58.333 INFO:teuthology.orchestra.console:Power on smithi192 2022-07-28T08:24:06.812 INFO:teuthology.orchestra.console:Power on for smithi192 completed 2022-07-28T08:24:06.913 INFO:teuthology.provision.fog.smithi192:Waiting for deploy to finish 2022-07-28T08:24:10.560 INFO:teuthology.orchestra.console:Power off for smithi145 completed 2022-07-28T08:24:10.661 INFO:teuthology.orchestra.console:Power on smithi145 2022-07-28T08:24:19.022 INFO:teuthology.orchestra.console:Power on for smithi145 completed 2022-07-28T08:24:19.123 INFO:teuthology.provision.fog.smithi145:Waiting for deploy to finish 2022-07-28T08:28:25.574 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-07-28T08:28:44.589 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-07-28T08:28:44.896 INFO:teuthology.provision.fog.smithi192:Node is ready 2022-07-28T08:28:44.914 INFO:teuthology.orchestra.run.smithi192.stdout:smithi192.front.sepia.ceph.com 2022-07-28T08:28:44.972 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.15.192 smithi192.front.sepia.ceph.com smithi192 2022-07-28T08:28:45.316 INFO:teuthology.provision.fog.smithi192:Deploy complete! 2022-07-28T08:28:50.401 INFO:teuthology.provision.fog.smithi145:Node is ready 2022-07-28T08:28:50.423 INFO:teuthology.orchestra.run.smithi145.stdout:smithi145.front.sepia.ceph.com 2022-07-28T08:28:50.482 INFO:teuthology.orchestra.run.smithi145.stdout:172.21.15.145 smithi145.front.sepia.ceph.com smithi145 2022-07-28T08:28:50.836 INFO:teuthology.provision.fog.smithi145:Deploy complete! 2022-07-28T08:28:51.004 INFO:teuthology.lock.ops:Checking smithi145.front.sepia.ceph.com 2022-07-28T08:28:51.005 INFO:teuthology.lock.ops:New key found. Updating... 2022-07-28T08:28:51.026 INFO:teuthology.lock.ops:Checking smithi192.front.sepia.ceph.com 2022-07-28T08:28:51.027 INFO:teuthology.lock.ops:New key found. Updating... 2022-07-28T08:28:51.047 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: set os type and version on server 2022-07-28T08:28:51.048 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2022-07-28T08:28:51.215 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64 2022-07-28T08:28:51.272 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="CentOS Stream" 2022-07-28T08:28:51.272 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="8" 2022-07-28T08:28:51.273 INFO:teuthology.orchestra.run.smithi145.stdout:ID="centos" 2022-07-28T08:28:51.273 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="rhel fedora" 2022-07-28T08:28:51.273 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="8" 2022-07-28T08:28:51.274 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el8" 2022-07-28T08:28:51.274 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="CentOS Stream 8" 2022-07-28T08:28:51.274 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31" 2022-07-28T08:28:51.274 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-07-28T08:28:51.275 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://centos.org/" 2022-07-28T08:28:51.275 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-07-28T08:28:51.275 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-07-28T08:28:51.275 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-07-28T08:28:51.277 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2022-07-28T08:28:51.301 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: set os type and version on server 2022-07-28T08:28:51.301 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2022-07-28T08:28:51.528 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64 2022-07-28T08:28:51.589 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream" 2022-07-28T08:28:51.590 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="8" 2022-07-28T08:28:51.590 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos" 2022-07-28T08:28:51.591 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora" 2022-07-28T08:28:51.591 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="8" 2022-07-28T08:28:51.591 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el8" 2022-07-28T08:28:51.592 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 8" 2022-07-28T08:28:51.592 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2022-07-28T08:28:51.592 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-07-28T08:28:51.592 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/" 2022-07-28T08:28:51.592 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-07-28T08:28:51.593 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-07-28T08:28:51.593 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-07-28T08:28:51.594 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2022-07-28T08:28:51.703 INFO:teuthology.dispatcher.supervisor:Running job 6951680 2022-07-28T08:28:51.703 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_5f965ce157b8dcdaf2da92a5b5d1a63e787efdd9/virtualenv/bin/teuthology -v --owner scheduled_gabrioux@teuthology --archive /home/teuthworker/archive/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951680 --name gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi --description orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} -- /home/teuthworker/archive/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951680/orig.config.yaml 2022-07-28T08:28:51.708 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951680 2022-07-28T08:28:51.709 INFO:teuthology.dispatcher.supervisor:Job PID: 26152 2022-07-28T08:28:51.709 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-07-28T20:29:52.185 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-07-28T20:29:52.331 INFO:teuthology.kill:Killing Pids: {26152} 2022-07-28T20:29:54.210 INFO:teuthology.task.internal:roles: ubuntu@smithi145.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.foo.a', 'node-exporter.a', 'alertmanager.a'] 2022-07-28T20:29:54.211 INFO:teuthology.task.internal:roles: ubuntu@smithi192.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a'] 2022-07-28T20:29:54.211 INFO:teuthology.misc:Compressing logs... 2022-07-28T20:29:54.212 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2022-07-28T20:29:54.442 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2022-07-28T20:29:54.792 INFO:teuthology.misc:Compressing logs... 2022-07-28T20:29:54.990 INFO:teuthology.misc:Compressing logs... 2022-07-28T20:29:57.985 INFO:teuthology.orchestra.run.smithi145.stderr:gzip: /var/log/ceph/abeefaa4-0e50-11ed-8430-001a4aab830c/ceph-mon.c.log: file size changed while zipping 2022-07-28T20:29:58.028 INFO:teuthology.orchestra.run.smithi192.stderr:gzip: /var/log/ceph/abeefaa4-0e50-11ed-8430-001a4aab830c/ceph-mon.b.log: file size changed while zipping 2022-07-28T20:30:00.775 INFO:teuthology.orchestra.run.smithi145.stderr:gzip: /var/log/ceph/abeefaa4-0e50-11ed-8430-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-07-28T20:30:02.920 INFO:teuthology.orchestra.run.smithi145.stderr:gzip: /var/log/ceph/abeefaa4-0e50-11ed-8430-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-07-28T20:30:09.544 INFO:teuthology.orchestra.run.smithi145.stderr:gzip: /var/log/ceph/abeefaa4-0e50-11ed-8430-001a4aab830c/ceph-mon.a.log: file size changed while zipping 2022-07-28T20:30:11.704 INFO:teuthology.orchestra.run.smithi145.stderr:gzip: /var/log/ceph/abeefaa4-0e50-11ed-8430-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-07-28T20:30:16.100 INFO:teuthology.kill:No teuthology processes running 2022-07-28T20:30:18.171 INFO:teuthology.kill:Nuking machines: ['smithi145', 'smithi192'] 2022-07-28T20:30:19.954 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_5f965ce157b8dcdaf2da92a5b5d1a63e787efdd9/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-07-28T20:30:19.964 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-07-28T20:30:19.965 INFO:teuthology.kill:2022-07-28 20:30:19,954.954 INFO:teuthology.nuke:targets: 2022-07-28T20:30:19.972 INFO:teuthology.kill: smithi145.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXzeors0EDiJzVUOOuTT7kA0+FTIP8GtO6wRBd2mo0mEUOVUj1g9z/8ahzZXL/1ntVL7HpLAD6oH6zMJJ1JOstyrtmaRYy5mdfkPMV01OwUAmcbuW5fT4MAPatgYsPSE4rWMxe9fRjmHTwF0VQ7OHk6/gL9+0iFWOczbG1yVwSKyd50uW9cND2YOoFc/fEzLWFrQ47J9S7zpWca5tzDCMlQL5s8IMlYAKBNn0QQgNC9grGjmhIwmDlcjOkV/Sry2vWDZ4HSHvg7t/QYdXSMoN1Xe7kbbnqtNgusUneRJGgImuSvLGYOBgF6hA3OufBp4e0QFEIe9dn2EL1HPXyacaTWOM3IDB0fJ0W3lU8AEpsph7nTEc6H/E/6GhpWco6umh9Tnb6mmOebyE0IoLQ+Bev/632HKRMvsrFyhACX54igyHbShAL2ONAam0tprCIIY5OHvHO/hRvZ5BEwkQ4GFD6auVmIvixqnREpgBg7s6Z/MtUQQ/MMisN9e2jE4XvE50= 2022-07-28T20:30:19.972 INFO:teuthology.kill: smithi192.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDL+KdK8qqV9gpzwglwIboWvFJoUfDioHXvH9PNnX74Dr/ftO01/rRVheKzs8TWYzX7/pRrekAzBmVxTq/r4CR4tW5Mc0pTH3Gnlh/qPRfglBcK2hHrgh3AtcH0GvWrX/N7Q1AWZcuQPvN3pjziUCOwgI2jOjBhkuixiiQYqPRMvlhEZOJ3SGDtD2kAy0PPD1m4Fn0dDEnv/cxYN28Ey1uxfjoHnKN/zjlaYJhiyOlFjHdOaqA4KNXAeGx4mhTx3Dkskem67DVDz8u5UD3fDeDS2Y9WnWRVgdATh0vuaWrKlYDgN7NRDmcPw8/wqppTUlUpfFCkENVwJRPvm12GkJ9IHAGU93xsLiRGkY12JKBnEkaXQ/TL0m5Lew+3YA13D4ucfXXmaPfot9tCmkOzMDBYs8AyuBH+d7BdtNLy0ONIyATnk/1hrtmfZto8gpd11OyY7KF0aVvCcgzInG8N9yWPcHdShBSPoTDQ3WstL6gVuHByGq3MsAh/kFfN63fpO1U= 2022-07-28T20:30:19.973 INFO:teuthology.kill:2022-07-28 20:30:19,954.954 INFO:teuthology.nuke:Checking targets against current locks 2022-07-28T20:30:20.022 INFO:teuthology.kill:2022-07-28 20:30:20,022.022 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-07-28T20:30:20.072 INFO:teuthology.kill:2022-07-28 20:30:20,070.070 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-07-28T20:30:20.165 INFO:teuthology.kill:2022-07-28 20:30:20,163.163 INFO:teuthology.orchestra.console:Power off smithi145 2022-07-28T20:30:20.189 INFO:teuthology.kill:2022-07-28 20:30:20,188.188 INFO:teuthology.orchestra.console:Power off smithi192 2022-07-28T20:30:32.681 INFO:teuthology.kill:2022-07-28 20:30:32,681.681 INFO:teuthology.orchestra.console:Power off for smithi145 completed 2022-07-28T20:30:32.694 INFO:teuthology.kill:2022-07-28 20:30:32,690.690 INFO:teuthology.orchestra.console:Power off for smithi192 completed 2022-07-28T20:30:32.873 INFO:teuthology.kill:2022-07-28 20:30:32,871.871 INFO:teuthology.lock.ops:unlocked: smithi145.front.sepia.ceph.com 2022-07-28T20:30:32.880 INFO:teuthology.kill:2022-07-28 20:30:32,880.880 INFO:teuthology.lock.ops:unlocked: smithi192.front.sepia.ceph.com 2022-07-28T20:32:33.307 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-07-28T20:32:33.433 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi145 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-07-28_15:19:26-rados-wip-yuri-testing-2022-07-25-0645-quincy-distro-default-smithi/6952572 2022-07-28T20:32:33.434 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi192 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-07-28_15:19:26-rados-wip-yuri-testing-2022-07-25-0645-quincy-distro-default-smithi/6952572