2022-05-10T00:35:22.408 INFO:root:teuthology version: 1.1.1.dev333+gb018fa01 2022-05-10T00:35:22.541 INFO:teuthology.lock.ops:Start node 'smithi029.front.sepia.ceph.com' reimaging 2022-05-10T00:35:22.543 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: reset os type and version on server 2022-05-10T00:35:22.543 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2022-05-10T00:35:22.564 INFO:teuthology.lock.ops:Node 'smithi029.front.sepia.ceph.com' reimaging is complete 2022-05-10T00:35:22.566 INFO:teuthology.lock.ops:Start node 'smithi036.front.sepia.ceph.com' reimaging 2022-05-10T00:35:22.566 INFO:teuthology.lock.ops:Updating [smithi036.front.sepia.ceph.com]: reset os type and version on server 2022-05-10T00:35:22.567 INFO:teuthology.lock.ops:Updating smithi036.front.sepia.ceph.com on lock server 2022-05-10T00:35:22.589 INFO:teuthology.lock.ops:Node 'smithi036.front.sepia.ceph.com' reimaging is complete 2022-05-10T00:35:22.781 INFO:teuthology.provision.fog.smithi029:Scheduling deploy of centos 8.stream 2022-05-10T00:35:22.803 INFO:teuthology.provision.fog.smithi036:Scheduling deploy of centos 8.stream 2022-05-10T00:35:23.133 INFO:teuthology.orchestra.console:Power off smithi029 2022-05-10T00:35:23.153 INFO:teuthology.orchestra.console:Power off smithi036 2022-05-10T00:35:31.513 INFO:teuthology.orchestra.console:Power off for smithi029 completed 2022-05-10T00:35:31.614 INFO:teuthology.orchestra.console:Power on smithi029 2022-05-10T00:35:35.630 INFO:teuthology.orchestra.console:Power off for smithi036 completed 2022-05-10T00:35:35.732 INFO:teuthology.orchestra.console:Power on smithi036 2022-05-10T00:35:39.975 INFO:teuthology.orchestra.console:Power on for smithi029 completed 2022-05-10T00:35:40.076 INFO:teuthology.provision.fog.smithi029:Waiting for deploy to finish 2022-05-10T00:35:44.097 INFO:teuthology.orchestra.console:Power on for smithi036 completed 2022-05-10T00:35:44.198 INFO:teuthology.provision.fog.smithi036:Waiting for deploy to finish 2022-05-10T00:39:49.051 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-10T00:39:49.333 INFO:teuthology.provision.fog.smithi036:Node is ready 2022-05-10T00:39:49.351 INFO:teuthology.orchestra.run.smithi036.stdout:smithi036.front.sepia.ceph.com 2022-05-10T00:39:49.413 INFO:teuthology.orchestra.run.smithi036.stdout:172.21.15.36 smithi036.front.sepia.ceph.com smithi036 2022-05-10T00:39:49.780 INFO:teuthology.provision.fog.smithi036:Deploy complete! 2022-05-10T00:40:24.374 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-10T00:40:24.667 INFO:teuthology.provision.fog.smithi029:Node is ready 2022-05-10T00:40:24.684 INFO:teuthology.orchestra.run.smithi029.stdout:smithi029.front.sepia.ceph.com 2022-05-10T00:40:24.743 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29 smithi029.front.sepia.ceph.com smithi029 2022-05-10T00:40:25.102 INFO:teuthology.provision.fog.smithi029:Deploy complete! 2022-05-10T00:40:25.257 INFO:teuthology.lock.ops:Checking smithi029.front.sepia.ceph.com 2022-05-10T00:40:25.257 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-10T00:40:25.281 INFO:teuthology.lock.ops:Checking smithi036.front.sepia.ceph.com 2022-05-10T00:40:25.281 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-10T00:40:25.301 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: set os type and version on server 2022-05-10T00:40:25.301 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2022-05-10T00:40:25.504 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64 2022-05-10T00:40:25.561 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="CentOS Stream" 2022-05-10T00:40:25.561 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="8" 2022-05-10T00:40:25.561 INFO:teuthology.orchestra.run.smithi029.stdout:ID="centos" 2022-05-10T00:40:25.562 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="rhel fedora" 2022-05-10T00:40:25.562 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="8" 2022-05-10T00:40:25.562 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el8" 2022-05-10T00:40:25.562 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-10T00:40:25.563 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31" 2022-05-10T00:40:25.563 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-10T00:40:25.563 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://centos.org/" 2022-05-10T00:40:25.563 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-10T00:40:25.563 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-10T00:40:25.564 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-10T00:40:25.565 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2022-05-10T00:40:25.585 INFO:teuthology.lock.ops:Updating [smithi036.front.sepia.ceph.com]: set os type and version on server 2022-05-10T00:40:25.585 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi036.front.sepia.ceph.com' 2022-05-10T00:40:25.876 INFO:teuthology.orchestra.run.smithi036.stdout:x86_64 2022-05-10T00:40:25.934 INFO:teuthology.orchestra.run.smithi036.stdout:NAME="CentOS Stream" 2022-05-10T00:40:25.935 INFO:teuthology.orchestra.run.smithi036.stdout:VERSION="8" 2022-05-10T00:40:25.935 INFO:teuthology.orchestra.run.smithi036.stdout:ID="centos" 2022-05-10T00:40:25.936 INFO:teuthology.orchestra.run.smithi036.stdout:ID_LIKE="rhel fedora" 2022-05-10T00:40:25.936 INFO:teuthology.orchestra.run.smithi036.stdout:VERSION_ID="8" 2022-05-10T00:40:25.936 INFO:teuthology.orchestra.run.smithi036.stdout:PLATFORM_ID="platform:el8" 2022-05-10T00:40:25.936 INFO:teuthology.orchestra.run.smithi036.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-10T00:40:25.937 INFO:teuthology.orchestra.run.smithi036.stdout:ANSI_COLOR="0;31" 2022-05-10T00:40:25.937 INFO:teuthology.orchestra.run.smithi036.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-10T00:40:25.937 INFO:teuthology.orchestra.run.smithi036.stdout:HOME_URL="https://centos.org/" 2022-05-10T00:40:25.937 INFO:teuthology.orchestra.run.smithi036.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-10T00:40:25.937 INFO:teuthology.orchestra.run.smithi036.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-10T00:40:25.938 INFO:teuthology.orchestra.run.smithi036.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-10T00:40:25.938 INFO:teuthology.lock.ops:Updating smithi036.front.sepia.ceph.com on lock server 2022-05-10T00:40:26.050 INFO:teuthology.dispatcher.supervisor:Running job 6828710 2022-05-10T00:40:26.051 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/bin/teuthology -v --owner scheduled_amathuri@teuthology --archive /home/teuthworker/archive/amathuri-2022-05-09_10:33:04-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6828710 --name amathuri-2022-05-09_10:33:04-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} -- /home/teuthworker/archive/amathuri-2022-05-09_10:33:04-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6828710/orig.config.yaml 2022-05-10T00:40:26.056 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/amathuri-2022-05-09_10:33:04-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6828710 2022-05-10T00:40:26.057 INFO:teuthology.dispatcher.supervisor:Job PID: 20436 2022-05-10T00:40:26.057 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-05-10T07:10:56.363 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-10T07:10:56.546 INFO:teuthology.kill:Killing Pids: {20436} 2022-05-10T07:10:57.977 INFO:teuthology.task.internal:roles: ubuntu@smithi029.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-05-10T07:10:57.977 INFO:teuthology.task.internal:roles: ubuntu@smithi036.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-05-10T07:10:57.978 INFO:teuthology.misc:Compressing logs... 2022-05-10T07:10:57.978 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2022-05-10T07:10:58.254 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi036.front.sepia.ceph.com' 2022-05-10T07:10:58.744 INFO:teuthology.misc:Compressing logs... 2022-05-10T07:10:59.229 INFO:teuthology.orchestra.run.smithi036.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-05-10T07:10:59.240 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-05-10T07:10:59.538 INFO:teuthology.misc:Compressing logs... 2022-05-10T07:11:04.110 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/ceph-client.admin.102847.log: file size changed while zipping 2022-05-10T07:11:06.733 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/ceph-client.admin.102782.log: file size changed while zipping 2022-05-10T07:11:06.857 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/ceph-client.admin.103097.log: file size changed while zipping 2022-05-10T07:11:06.975 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/ceph-client.admin.103305.log: file size changed while zipping 2022-05-10T07:11:54.249 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/ceph-client.admin.102974.log: file size changed while zipping 2022-05-10T07:11:54.640 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/ceph-client.admin.103302.log: file size changed while zipping 2022-05-10T07:13:00.134 INFO:teuthology.orchestra.run.smithi036.stderr:tar: .: file changed as we read it 2022-05-10T07:13:00.229 INFO:teuthology.kill:No teuthology processes running 2022-05-10T07:13:01.632 INFO:teuthology.kill:Nuking machines: ['smithi029', 'smithi036'] 2022-05-10T07:13:02.836 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-05-10T07:13:02.837 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-05-10T07:13:02.837 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:236: CryptographyDeprecationWarning: Blowfish has been deprecated 2022-05-10T07:13:02.838 INFO:teuthology.kill: "class": algorithms.Blowfish, 2022-05-10T07:13:02.839 INFO:teuthology.kill:2022-05-10 07:13:02,836.836 INFO:teuthology.nuke:targets: 2022-05-10T07:13:02.839 INFO:teuthology.kill: smithi029.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDM4XfZ6K2c/B1ifClmIyZmFLL2egeUTk8F7JclN8rcRlsyDpZworJvCOiWJgNGo1rzExsn+6U2zRs8+din6AWteKW+4En6q0zyUHn2KA693UaDTiykAoB33dxxWePIIdPZAUrpfcxL3ATwmp2Uo5T/d8ImTm2cxrKmCewFYNIppZir+8GmdXs8u6k5/kUU/rX+zreXqz9IsnmhR40ID1itdKwNIiwSDYKVrLbh9qXLlCPH+54XFJVTggfCQoM8sbbJJ5r0xxfFwVRi+nsUIwdVSN1ztwf64Q960qa5UKcLY3olJ/VJcF7dmxHrGSR6eRsm2R6kkuUYaoaKZW97clpvcjemOKYGVB4SY8cN+xyZ2zrtahbAciuFj2arkMiTlzwMKOXHomE2EwAhJm052aYbsgOHFJXhZMG0SIKTqdHrgaAjfsjpXcncdambMamX377jp7gLoVgn/sC6G6vNjY0cL1s92KfpINEMjov3g42o6Mjup99T69GSMZy8c2USkjs= 2022-05-10T07:13:02.839 INFO:teuthology.kill: smithi036.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQChUk3SEq7vrQppxqM5VmwjzCMCy+V79DGikS8NP6dgjBI2SfPwaxK2AdoSMmcLlqVwscJPxm/xodjoCZ5wzouF6fpTMZ06gs9/JLBatWiewRCjcdyr7jsiMlwaE5/QR+/DhEvcHzdAu6XbXlpM87c6LnSE6kUzCalPb9kqcfxhQGIA57HV0qH1/QZcl1XsFk562Xw29lyQ0YNawBkPAjuqUcwbMoHRATSctI5nwt3WmnM1L17v4G8YjR8DpVjTLGDw3qs3mVPervHgFf9bm0Slra7OXCIFJ0F5Wza9kvD2wwZNG1lxv6MCUWeoUXqAVp9LJy1HtbZ4GPk7qBavyzE0G3mJCEErvJWLjv2feYRfTUZU7mbPRi1zXYcNqjtK80baZJErc/7+Vu23Btzy2ziKLYwAiQpeVankg0FDe39VvN6Gikf0k0yN30D35f4hCs5La6VBqKT9XwA6y5KucyeSF9UrCO8WVUrn7Mbf9xrczP1kwWBDM2IsgQlDCfxdQS0= 2022-05-10T07:13:02.864 INFO:teuthology.kill:2022-05-10 07:13:02,863.863 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-10T07:13:02.867 INFO:teuthology.kill:2022-05-10 07:13:02,867.867 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-10T07:13:02.943 INFO:teuthology.kill:2022-05-10 07:13:02,942.942 INFO:teuthology.orchestra.console:Power off smithi036 2022-05-10T07:13:02.956 INFO:teuthology.kill:2022-05-10 07:13:02,955.955 INFO:teuthology.orchestra.console:Power off smithi029 2022-05-10T07:13:11.317 INFO:teuthology.kill:2022-05-10 07:13:11,316.316 INFO:teuthology.orchestra.console:Power off for smithi029 completed 2022-05-10T07:13:11.470 INFO:teuthology.kill:2022-05-10 07:13:11,470.470 INFO:teuthology.lock.ops:unlocked: smithi029.front.sepia.ceph.com 2022-05-10T07:13:15.420 INFO:teuthology.kill:2022-05-10 07:13:15,419.419 INFO:teuthology.orchestra.console:Power off for smithi036 completed 2022-05-10T07:13:15.576 INFO:teuthology.kill:2022-05-10 07:13:15,576.576 INFO:teuthology.lock.ops:unlocked: smithi036.front.sepia.ceph.com 2022-05-10T07:15:15.964 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-05-10T07:15:16.064 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi036 but it was locked by another job: /home/teuthworker/archive/vshankar-2022-05-09_10:08:21-fs-wip-vshankar-testing-20220509-125847-testing-default-smithi/6828382