2022-07-26T19:24:07.732 INFO:root:teuthology version: 1.1.1.dev399+g5f965ce1 2022-07-26T19:24:07.893 INFO:teuthology.lock.ops:Start node 'smithi038.front.sepia.ceph.com' reimaging 2022-07-26T19:24:07.894 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: reset os type and version on server 2022-07-26T19:24:07.895 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2022-07-26T19:24:07.919 INFO:teuthology.lock.ops:Node 'smithi038.front.sepia.ceph.com' reimaging is complete 2022-07-26T19:24:07.920 INFO:teuthology.lock.ops:Start node 'smithi115.front.sepia.ceph.com' reimaging 2022-07-26T19:24:07.920 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: reset os type and version on server 2022-07-26T19:24:07.921 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2022-07-26T19:24:07.942 INFO:teuthology.lock.ops:Node 'smithi115.front.sepia.ceph.com' reimaging is complete 2022-07-26T19:24:08.147 INFO:teuthology.provision.fog.smithi038:Scheduling deploy of rhel 8.4 2022-07-26T19:24:08.173 INFO:teuthology.provision.fog.smithi115:Scheduling deploy of rhel 8.4 2022-07-26T19:24:08.534 INFO:teuthology.orchestra.console:Power off smithi038 2022-07-26T19:24:08.564 INFO:teuthology.orchestra.console:Power off smithi115 2022-07-26T19:24:16.933 INFO:teuthology.orchestra.console:Power off for smithi038 completed 2022-07-26T19:24:16.937 INFO:teuthology.orchestra.console:Power off for smithi115 completed 2022-07-26T19:24:17.034 INFO:teuthology.orchestra.console:Power on smithi038 2022-07-26T19:24:17.045 INFO:teuthology.orchestra.console:Power on smithi115 2022-07-26T19:24:25.421 INFO:teuthology.orchestra.console:Power on for smithi038 completed 2022-07-26T19:24:25.429 INFO:teuthology.orchestra.console:Power on for smithi115 completed 2022-07-26T19:24:25.526 INFO:teuthology.provision.fog.smithi038:Waiting for deploy to finish 2022-07-26T19:24:25.532 INFO:teuthology.provision.fog.smithi115:Waiting for deploy to finish 2022-07-26T19:28:42.368 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-07-26T19:28:42.627 INFO:teuthology.provision.fog.smithi038:Node is ready 2022-07-26T19:28:42.646 INFO:teuthology.orchestra.run.smithi038.stdout:smithi038.front.sepia.ceph.com 2022-07-26T19:28:42.712 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38 smithi038.front.sepia.ceph.com smithi038 2022-07-26T19:28:43.047 INFO:teuthology.provision.fog.smithi038:Deploy complete! 2022-07-26T19:29:12.500 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-07-26T19:29:12.707 INFO:teuthology.provision.fog.smithi115:Node is ready 2022-07-26T19:29:12.724 INFO:teuthology.orchestra.run.smithi115.stdout:smithi115.front.sepia.ceph.com 2022-07-26T19:29:12.781 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115 smithi115.front.sepia.ceph.com smithi115 2022-07-26T19:29:13.117 INFO:teuthology.provision.fog.smithi115:Deploy complete! 2022-07-26T19:29:13.369 INFO:teuthology.lock.ops:Checking smithi038.front.sepia.ceph.com 2022-07-26T19:29:13.371 INFO:teuthology.lock.ops:New key found. Updating... 2022-07-26T19:29:13.395 INFO:teuthology.lock.ops:Checking smithi115.front.sepia.ceph.com 2022-07-26T19:29:13.395 INFO:teuthology.lock.ops:New key found. Updating... 2022-07-26T19:29:13.416 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: set os type and version on server 2022-07-26T19:29:13.416 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2022-07-26T19:29:13.671 INFO:teuthology.orchestra.run.smithi038.stdout:x86_64 2022-07-26T19:29:13.728 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="Red Hat Enterprise Linux" 2022-07-26T19:29:13.728 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="8.4 (Ootpa)" 2022-07-26T19:29:13.728 INFO:teuthology.orchestra.run.smithi038.stdout:ID="rhel" 2022-07-26T19:29:13.729 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="fedora" 2022-07-26T19:29:13.729 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="8.4" 2022-07-26T19:29:13.729 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el8" 2022-07-26T19:29:13.730 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-07-26T19:29:13.730 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31" 2022-07-26T19:29:13.730 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-07-26T19:29:13.730 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://www.redhat.com/" 2022-07-26T19:29:13.731 INFO:teuthology.orchestra.run.smithi038.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-07-26T19:29:13.731 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-07-26T19:29:13.731 INFO:teuthology.orchestra.run.smithi038.stdout: 2022-07-26T19:29:13.731 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-07-26T19:29:13.732 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-07-26T19:29:13.732 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-07-26T19:29:13.733 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-07-26T19:29:13.735 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2022-07-26T19:29:13.759 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: set os type and version on server 2022-07-26T19:29:13.759 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2022-07-26T19:29:13.994 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64 2022-07-26T19:29:14.049 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="Red Hat Enterprise Linux" 2022-07-26T19:29:14.049 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="8.4 (Ootpa)" 2022-07-26T19:29:14.050 INFO:teuthology.orchestra.run.smithi115.stdout:ID="rhel" 2022-07-26T19:29:14.050 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="fedora" 2022-07-26T19:29:14.051 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="8.4" 2022-07-26T19:29:14.051 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el8" 2022-07-26T19:29:14.052 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-07-26T19:29:14.052 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2022-07-26T19:29:14.053 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-07-26T19:29:14.053 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://www.redhat.com/" 2022-07-26T19:29:14.053 INFO:teuthology.orchestra.run.smithi115.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-07-26T19:29:14.053 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-07-26T19:29:14.054 INFO:teuthology.orchestra.run.smithi115.stdout: 2022-07-26T19:29:14.054 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-07-26T19:29:14.054 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-07-26T19:29:14.054 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-07-26T19:29:14.055 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-07-26T19:29:14.056 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2022-07-26T19:29:14.157 INFO:teuthology.dispatcher.supervisor:Running job 6948444 2022-07-26T19:29:14.157 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_5f965ce157b8dcdaf2da92a5b5d1a63e787efdd9/virtualenv/bin/teuthology -v --owner scheduled_gabrioux@teuthology --archive /home/teuthworker/archive/gabrioux-2022-07-26_18:31:55-orch:cephadm-wip-guits-testing-2022-07-26-1524-quincy-distro-default-smithi/6948444 --name gabrioux-2022-07-26_18:31:55-orch:cephadm-wip-guits-testing-2022-07-26-1524-quincy-distro-default-smithi --description orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} -- /home/teuthworker/archive/gabrioux-2022-07-26_18:31:55-orch:cephadm-wip-guits-testing-2022-07-26-1524-quincy-distro-default-smithi/6948444/orig.config.yaml 2022-07-26T19:29:14.162 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/gabrioux-2022-07-26_18:31:55-orch:cephadm-wip-guits-testing-2022-07-26-1524-quincy-distro-default-smithi/6948444 2022-07-26T19:29:14.163 INFO:teuthology.dispatcher.supervisor:Job PID: 23944 2022-07-26T19:29:14.164 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-07-27T07:30:10.691 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-07-27T07:30:10.877 INFO:teuthology.kill:Killing Pids: {23944} 2022-07-27T07:30:12.344 INFO:teuthology.task.internal:roles: ubuntu@smithi038.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.foo.a', 'node-exporter.a', 'alertmanager.a'] 2022-07-27T07:30:12.345 INFO:teuthology.task.internal:roles: ubuntu@smithi115.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a'] 2022-07-27T07:30:12.346 INFO:teuthology.misc:Compressing logs... 2022-07-27T07:30:12.346 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2022-07-27T07:30:12.585 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2022-07-27T07:30:12.890 INFO:teuthology.misc:Compressing logs... 2022-07-27T07:30:13.029 INFO:teuthology.misc:Compressing logs... 2022-07-27T07:30:13.651 INFO:teuthology.orchestra.run.smithi038.stderr:gzip: /var/log/ceph/c85f6a52-0d1a-11ed-8430-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-07-27T07:30:14.287 INFO:teuthology.orchestra.run.smithi115.stderr:gzip: /var/log/ceph/c85f6a52-0d1a-11ed-8430-001a4aab830c/ceph-mon.b.log: file size changed while zipping 2022-07-27T07:30:14.340 INFO:teuthology.orchestra.run.smithi038.stderr:gzip: /var/log/ceph/c85f6a52-0d1a-11ed-8430-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-07-27T07:30:15.597 INFO:teuthology.orchestra.run.smithi038.stderr:gzip: /var/log/ceph/c85f6a52-0d1a-11ed-8430-001a4aab830c/ceph-mon.c.log: file size changed while zipping 2022-07-27T07:30:16.185 INFO:teuthology.orchestra.run.smithi038.stderr:gzip: /var/log/ceph/c85f6a52-0d1a-11ed-8430-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-07-27T07:30:17.859 INFO:teuthology.orchestra.run.smithi038.stderr:gzip: /var/log/ceph/c85f6a52-0d1a-11ed-8430-001a4aab830c/ceph-mon.a.log: file size changed while zipping 2022-07-27T07:30:21.137 INFO:teuthology.kill:No teuthology processes running 2022-07-27T07:30:22.668 INFO:teuthology.kill:Nuking machines: ['smithi038', 'smithi115'] 2022-07-27T07:30:23.846 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_5f965ce157b8dcdaf2da92a5b5d1a63e787efdd9/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-07-27T07:30:23.847 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-07-27T07:30:23.847 INFO:teuthology.kill:2022-07-27 07:30:23,846.846 INFO:teuthology.nuke:targets: 2022-07-27T07:30:23.848 INFO:teuthology.kill: smithi038.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCcw4jjk/Ej2ezRENWugFT2LNmMz1PttY3OVUMH9497BZGchmY1Y+DhYYwR7rSvhpmauhgUe79m63Dcc7gEb/MAAszRM2pApI/4XgAQeDXO+3b8+QvOles/JZDrp1csKX8J0D/zTpwSSSSLyeLcenDj92wuFmGYsf/av91md6OBe05s3uoOwa9nN0E8qfz6bTqxrFzlgiscrt1mfmcsa4n9ilKp/L8/a1ywHzychC91t9sIB5OYC9ZuR4MDGInzkwIh9NmcuFM27W3XYL2GmCPLZfOUzzhN0+ncn212YpoYuFCTu2tSLPqCqECKH/MnTxJseP5v0epR2P4jCxIHDYSfcHOBRSnhE3WqzNntCSoRfcErfR08V3HUz8znKymnKqNky6CKev1YVm9tyhfuvD2EKPY0NqKK2oMXkjlFD+UgwtNKKL1ENGRZtSyq+k/uujVBNsJPMVGvCtJsvH0Th1IoTg3AhEa1KaILB/c2WVSgWD3sL9AhTFzgq3t3ilDP4CM= 2022-07-27T07:30:23.848 INFO:teuthology.kill: smithi115.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQcQrscQSibhNc4BL3asvWS+ySjgCAukTG1Ps5QGkm+JOZKOCnXYghHVgD+gqCFn23A6uGMIpyQ325lzmSoik/eRA9OpA8RmooUBAagcpc6vOzocDgK2JhR5cMJqUD/G+QZWaxi/6MkZKx4oiZgw4yeNxz+3zMyDI380RNwhyYHtdmHhurfxek72eEATGwhYXhbreGjfK42vFsypTIVfYHZ9ZpG3CWhWRSkkfSukIrzSTjsT5/ylAMkGNBI7nnwu8REYS9I0iMu95cI1PQpkZreIhropmqZyJKUZrzlNtjFZ5UM/4Ad4LZt14+DCwB+9xFe5BOxM4YHqcWi0d3zqUD4bkWJuOPc2XJ5n74L5wtbd91dnXbVfGW/TzAQgFllfNzJnDHKLthLkkpKs/UJpXREgmKLOe6RPQIuWkF4jGkmfVF7cPEGYFVFRKeA76mvx5ah5d0OmTAY3s8Mpr9/NubgVwt3p24gpdkNuUhdFL/ix2zYqEiNddlC8qQx0V6hMs= 2022-07-27T07:30:23.848 INFO:teuthology.kill:2022-07-27 07:30:23,847.847 INFO:teuthology.nuke:Checking targets against current locks 2022-07-27T07:30:23.912 INFO:teuthology.kill:2022-07-27 07:30:23,912.912 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-07-27T07:30:23.937 INFO:teuthology.kill:2022-07-27 07:30:23,937.937 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-07-27T07:30:24.002 INFO:teuthology.kill:2022-07-27 07:30:24,002.002 INFO:teuthology.orchestra.console:Power off smithi038 2022-07-27T07:30:24.042 INFO:teuthology.kill:2022-07-27 07:30:24,042.042 INFO:teuthology.orchestra.console:Power off smithi115 2022-07-27T07:30:32.385 INFO:teuthology.kill:2022-07-27 07:30:32,385.385 INFO:teuthology.orchestra.console:Power off for smithi038 completed 2022-07-27T07:30:32.541 INFO:teuthology.kill:2022-07-27 07:30:32,540.540 INFO:teuthology.lock.ops:unlocked: smithi038.front.sepia.ceph.com 2022-07-27T07:30:36.518 INFO:teuthology.kill:2022-07-27 07:30:36,518.518 INFO:teuthology.orchestra.console:Power off for smithi115 completed 2022-07-27T07:30:36.675 INFO:teuthology.kill:2022-07-27 07:30:36,675.675 INFO:teuthology.lock.ops:unlocked: smithi115.front.sepia.ceph.com 2022-07-27T07:32:37.049 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-07-27T07:32:37.178 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi038 but it was locked by another job: /home/teuthworker/archive/bhubbard-2022-07-27_07:20:47-ceph-ansible-wip-octopus-badone-testing-distro-basic-smithi/6949721 2022-07-27T07:32:37.179 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi115 but it was locked by another job: /home/teuthworker/archive/bhubbard-2022-07-27_07:20:47-ceph-ansible-wip-octopus-badone-testing-distro-basic-smithi/6949721