2022-07-27T10:23:55.022 INFO:root:teuthology version: 1.1.1.dev399+g5f965ce1 2022-07-27T10:23:55.378 INFO:teuthology.lock.ops:Start node 'smithi039.front.sepia.ceph.com' reimaging 2022-07-27T10:23:55.379 INFO:teuthology.lock.ops:Updating [smithi039.front.sepia.ceph.com]: reset os type and version on server 2022-07-27T10:23:55.380 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2022-07-27T10:23:55.415 INFO:teuthology.lock.ops:Node 'smithi039.front.sepia.ceph.com' reimaging is complete 2022-07-27T10:23:55.417 INFO:teuthology.lock.ops:Start node 'smithi130.front.sepia.ceph.com' reimaging 2022-07-27T10:23:55.418 INFO:teuthology.lock.ops:Updating [smithi130.front.sepia.ceph.com]: reset os type and version on server 2022-07-27T10:23:55.419 INFO:teuthology.lock.ops:Updating smithi130.front.sepia.ceph.com on lock server 2022-07-27T10:23:55.474 INFO:teuthology.lock.ops:Node 'smithi130.front.sepia.ceph.com' reimaging is complete 2022-07-27T10:23:55.736 INFO:teuthology.provision.fog.smithi039:Scheduling deploy of centos 8.stream 2022-07-27T10:23:55.820 INFO:teuthology.provision.fog.smithi130:Scheduling deploy of centos 8.stream 2022-07-27T10:23:56.344 INFO:teuthology.orchestra.console:Power off smithi039 2022-07-27T10:23:56.477 INFO:teuthology.orchestra.console:Power off smithi130 2022-07-27T10:23:56.697 INFO:teuthology.orchestra.console:Power off for smithi039 completed 2022-07-27T10:23:56.820 INFO:teuthology.orchestra.console:Power on smithi039 2022-07-27T10:24:01.175 INFO:teuthology.orchestra.console:Power on for smithi039 completed 2022-07-27T10:24:01.281 INFO:teuthology.provision.fog.smithi039:Waiting for deploy to finish 2022-07-27T10:24:04.995 INFO:teuthology.orchestra.console:Power off for smithi130 completed 2022-07-27T10:24:05.104 INFO:teuthology.orchestra.console:Power on smithi130 2022-07-27T10:24:13.570 INFO:teuthology.orchestra.console:Power on for smithi130 completed 2022-07-27T10:24:13.678 INFO:teuthology.provision.fog.smithi130:Waiting for deploy to finish 2022-07-27T10:28:48.089 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-07-27T10:28:48.382 INFO:teuthology.provision.fog.smithi130:Node is ready 2022-07-27T10:28:48.419 INFO:teuthology.orchestra.run.smithi130.stdout:smithi130.front.sepia.ceph.com 2022-07-27T10:28:48.560 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.15.130 smithi130.front.sepia.ceph.com smithi130 2022-07-27T10:28:49.033 INFO:teuthology.provision.fog.smithi130:Deploy complete! 2022-07-27T10:28:50.278 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-07-27T10:29:10.833 INFO:teuthology.provision.fog.smithi039:Node is ready 2022-07-27T10:29:10.887 INFO:teuthology.orchestra.run.smithi039.stdout:smithi039.front.sepia.ceph.com 2022-07-27T10:29:10.973 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39 smithi039.front.sepia.ceph.com smithi039 2022-07-27T10:29:11.454 INFO:teuthology.provision.fog.smithi039:Deploy complete! 2022-07-27T10:29:11.819 INFO:teuthology.lock.ops:Checking smithi039.front.sepia.ceph.com 2022-07-27T10:29:11.820 INFO:teuthology.lock.ops:New key found. Updating... 2022-07-27T10:29:11.856 INFO:teuthology.lock.ops:Checking smithi130.front.sepia.ceph.com 2022-07-27T10:29:11.857 INFO:teuthology.lock.ops:New key found. Updating... 2022-07-27T10:29:11.898 INFO:teuthology.lock.ops:Updating [smithi039.front.sepia.ceph.com]: set os type and version on server 2022-07-27T10:29:11.899 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2022-07-27T10:29:12.217 INFO:teuthology.orchestra.run.smithi039.stdout:x86_64 2022-07-27T10:29:12.286 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="CentOS Stream" 2022-07-27T10:29:12.288 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="8" 2022-07-27T10:29:12.288 INFO:teuthology.orchestra.run.smithi039.stdout:ID="centos" 2022-07-27T10:29:12.288 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE="rhel fedora" 2022-07-27T10:29:12.289 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="8" 2022-07-27T10:29:12.289 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM_ID="platform:el8" 2022-07-27T10:29:12.290 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="CentOS Stream 8" 2022-07-27T10:29:12.290 INFO:teuthology.orchestra.run.smithi039.stdout:ANSI_COLOR="0;31" 2022-07-27T10:29:12.291 INFO:teuthology.orchestra.run.smithi039.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-07-27T10:29:12.291 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://centos.org/" 2022-07-27T10:29:12.292 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-07-27T10:29:12.292 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-07-27T10:29:12.292 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-07-27T10:29:12.296 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2022-07-27T10:29:12.334 INFO:teuthology.lock.ops:Updating [smithi130.front.sepia.ceph.com]: set os type and version on server 2022-07-27T10:29:12.334 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2022-07-27T10:29:12.847 INFO:teuthology.orchestra.run.smithi130.stdout:x86_64 2022-07-27T10:29:12.911 INFO:teuthology.orchestra.run.smithi130.stdout:NAME="CentOS Stream" 2022-07-27T10:29:12.916 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION="8" 2022-07-27T10:29:12.917 INFO:teuthology.orchestra.run.smithi130.stdout:ID="centos" 2022-07-27T10:29:12.917 INFO:teuthology.orchestra.run.smithi130.stdout:ID_LIKE="rhel fedora" 2022-07-27T10:29:12.918 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION_ID="8" 2022-07-27T10:29:12.918 INFO:teuthology.orchestra.run.smithi130.stdout:PLATFORM_ID="platform:el8" 2022-07-27T10:29:12.919 INFO:teuthology.orchestra.run.smithi130.stdout:PRETTY_NAME="CentOS Stream 8" 2022-07-27T10:29:12.919 INFO:teuthology.orchestra.run.smithi130.stdout:ANSI_COLOR="0;31" 2022-07-27T10:29:12.921 INFO:teuthology.orchestra.run.smithi130.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-07-27T10:29:12.922 INFO:teuthology.orchestra.run.smithi130.stdout:HOME_URL="https://centos.org/" 2022-07-27T10:29:12.922 INFO:teuthology.orchestra.run.smithi130.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-07-27T10:29:12.923 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-07-27T10:29:12.929 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-07-27T10:29:12.930 INFO:teuthology.lock.ops:Updating smithi130.front.sepia.ceph.com on lock server 2022-07-27T10:29:13.165 INFO:teuthology.dispatcher.supervisor:Running job 6949794 2022-07-27T10:29:13.173 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_5f965ce157b8dcdaf2da92a5b5d1a63e787efdd9/virtualenv/bin/teuthology -v --owner scheduled_gabrioux@teuthology --archive /home/teuthworker/archive/gabrioux-2022-07-27_09:04:01-orch:cephadm-wip-guits-testing-2022-07-26-1524-quincy-distro-default-smithi/6949794 --name gabrioux-2022-07-27_09:04:01-orch:cephadm-wip-guits-testing-2022-07-26-1524-quincy-distro-default-smithi --description orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} -- /home/teuthworker/archive/gabrioux-2022-07-27_09:04:01-orch:cephadm-wip-guits-testing-2022-07-26-1524-quincy-distro-default-smithi/6949794/orig.config.yaml 2022-07-27T10:29:13.200 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/gabrioux-2022-07-27_09:04:01-orch:cephadm-wip-guits-testing-2022-07-26-1524-quincy-distro-default-smithi/6949794 2022-07-27T10:29:13.201 INFO:teuthology.dispatcher.supervisor:Job PID: 18947 2022-07-27T10:29:13.202 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-07-27T22:30:11.418 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-07-27T22:30:11.685 INFO:teuthology.kill:Killing Pids: {18947} 2022-07-27T22:30:13.659 INFO:teuthology.task.internal:roles: ubuntu@smithi039.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.foo.a', 'node-exporter.a', 'alertmanager.a'] 2022-07-27T22:30:13.661 INFO:teuthology.task.internal:roles: ubuntu@smithi130.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a'] 2022-07-27T22:30:13.662 INFO:teuthology.misc:Compressing logs... 2022-07-27T22:30:13.663 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2022-07-27T22:30:13.913 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2022-07-27T22:30:14.009 INFO:teuthology.orchestra.run.smithi039.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-07-27T22:30:14.185 INFO:teuthology.orchestra.run.smithi130.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-07-27T22:30:14.234 INFO:teuthology.orchestra.run.smithi039.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-07-27T22:30:14.234 INFO:teuthology.orchestra.run.smithi039.stderr:tar: Error is not recoverable: exiting now 2022-07-27T22:30:14.272 INFO:teuthology.orchestra.run.smithi130.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-07-27T22:30:14.272 INFO:teuthology.orchestra.run.smithi130.stderr:tar: Error is not recoverable: exiting now 2022-07-27T22:30:14.273 INFO:teuthology.misc:Compressing logs... 2022-07-27T22:30:14.627 INFO:teuthology.misc:Compressing logs... 2022-07-27T22:30:17.684 INFO:teuthology.orchestra.run.smithi130.stderr:gzip: /var/log/ceph/2e331130-0d98-11ed-8430-001a4aab830c/ceph-mon.b.log: file size changed while zipping 2022-07-27T22:30:18.574 INFO:teuthology.orchestra.run.smithi039.stderr:gzip: /var/log/ceph/2e331130-0d98-11ed-8430-001a4aab830c/ceph-mon.c.log: file size changed while zipping 2022-07-27T22:30:20.709 INFO:teuthology.orchestra.run.smithi039.stderr:gzip: /var/log/ceph/2e331130-0d98-11ed-8430-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-07-27T22:30:22.533 INFO:teuthology.orchestra.run.smithi039.stderr:gzip: /var/log/ceph/2e331130-0d98-11ed-8430-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-07-27T22:30:27.870 INFO:teuthology.orchestra.run.smithi039.stderr:gzip: /var/log/ceph/2e331130-0d98-11ed-8430-001a4aab830c/ceph-mon.a.log: file size changed while zipping 2022-07-27T22:30:29.699 INFO:teuthology.orchestra.run.smithi039.stderr:gzip: /var/log/ceph/2e331130-0d98-11ed-8430-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-07-27T22:30:33.900 INFO:teuthology.kill:No teuthology processes running 2022-07-27T22:30:36.733 INFO:teuthology.kill:Nuking machines: ['smithi039', 'smithi130'] 2022-07-27T22:30:39.435 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_5f965ce157b8dcdaf2da92a5b5d1a63e787efdd9/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-07-27T22:30:39.437 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-07-27T22:30:39.437 INFO:teuthology.kill:2022-07-27 22:30:39,435.435 INFO:teuthology.nuke:targets: 2022-07-27T22:30:39.438 INFO:teuthology.kill: smithi039.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAyzWipQDZd0XnUi3Q1WAFgAXs8xyA79jGsedAwHtuzTg3OhvHujTyLzju35cNdVYcGpbtpfFLz/ZJKUT7nblP0QsjuDpCo3UwKpmlsF7KguspJg3dksugAkTYEZ9j6K7O5EmLTKiNpgmMM1i22R3y1udL77WIMcNeh+UDltZuMevLXgkFId7RFeCn5KCYAJKHRx2k4/w1Gy6kc6j56n6S9gzuejoCxKIjxkOV+BB5zsQA81Je9yrPrb76juPmV/h3x+3ATP3EzbpMfGmHSzM4RX745wXdRIppAoVTIPBTsWsCaynI+T5DB/6PGDvpoH8RwB4Ptf6g1AU/c70+sNEbnfAfYgABV6Jl/wTkfX4LJQeRjsjKTWEuMSxWNQ/U86CVtjEvrOy7e9oWtFrGdPhYuRfOcX2iyutuX2LLk8sIfWuni0ad2pBXhDLfLQFl66EYK2p4RfOFN8/BwcEICMd2y1yNs18MGuCC7ThAW0Cu1trCNpo/pf3mzuw8eJt9/1s= 2022-07-27T22:30:39.438 INFO:teuthology.kill: smithi130.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCfBSw8+Uh9V3qQkqlX2oz2IFyO5eKkHgaB3GI4qnIFgkOSDeH/LVvqUC2B+fD4FH/8MCEXrdZH3QUB3LiOO8RGcL8UziuRv+PhT6OTdNHCeJLwlGc7L+z2KgyXyzS5v/GToYC+jT1tSktwUjvbCGl8nQGL8ii/bdE1Z4ta/YaluoIuZlqdfBqpBKDWqG3RRQSnTXacLNSUbVQzMQynkCYQgTOc5cLZeZi7qauPSdw33z+/hcnlRC7l/2lfxL1MXlehHPH/+LlJR/nQrTb4Jvcc07OHi7Lr8slfqW5QBzk3utf1Ge83wa+oWwJQna8KUCVrQd+XbSWzZadDgHwzNYTxYsX2ZphOXtZWfsoIxXlsUQ6OmbChU4MNqWaMRc6YeHTlftjL0VvechkXK7+yzoC/8AFT8X3yLk/CvW22/faa/qAi8F28Y/8tdmRGvdHB14tWYj+ab8TXfNWG4hRb/3XaAxMmBknzpuv46yjzrkeoU1T4k5WKDgR7Xfg4hKHCwlM= 2022-07-27T22:30:39.439 INFO:teuthology.kill:2022-07-27 22:30:39,439.439 INFO:teuthology.nuke:Checking targets against current locks 2022-07-27T22:30:39.517 INFO:teuthology.kill:2022-07-27 22:30:39,516.516 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-07-27T22:30:39.562 INFO:teuthology.kill:2022-07-27 22:30:39,561.561 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-07-27T22:30:39.667 INFO:teuthology.kill:2022-07-27 22:30:39,667.667 INFO:teuthology.orchestra.console:Power off smithi039 2022-07-27T22:30:39.769 INFO:teuthology.kill:2022-07-27 22:30:39,769.769 INFO:teuthology.orchestra.console:Power off smithi130 2022-07-27T22:30:48.158 INFO:teuthology.kill:2022-07-27 22:30:48,157.157 INFO:teuthology.orchestra.console:Power off for smithi039 completed 2022-07-27T22:30:48.336 INFO:teuthology.kill:2022-07-27 22:30:48,332.332 INFO:teuthology.lock.ops:unlocked: smithi039.front.sepia.ceph.com 2022-07-27T22:30:52.331 INFO:teuthology.kill:2022-07-27 22:30:52,330.330 INFO:teuthology.orchestra.console:Power off for smithi130 completed 2022-07-27T22:30:52.504 INFO:teuthology.kill:2022-07-27 22:30:52,500.500 INFO:teuthology.lock.ops:unlocked: smithi130.front.sepia.ceph.com 2022-07-27T22:32:53.016 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-07-27T22:32:53.455 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi039 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-07-27_18:30:47-rados-wip-yuri7-testing-2022-07-27-0808-quincy-distro-default-smithi/6950426 2022-07-27T22:32:53.456 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi130 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-07-27_18:30:47-rados-wip-yuri7-testing-2022-07-27-0808-quincy-distro-default-smithi/6950426