2022-05-06T02:00:03.075 INFO:root:teuthology version: 1.1.1.dev331+gfd5c3166 2022-05-06T02:00:03.202 INFO:teuthology.lock.ops:Start node 'smithi124.front.sepia.ceph.com' reimaging 2022-05-06T02:00:03.203 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: reset os type and version on server 2022-05-06T02:00:03.204 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server 2022-05-06T02:00:03.221 INFO:teuthology.lock.ops:Node 'smithi124.front.sepia.ceph.com' reimaging is complete 2022-05-06T02:00:03.222 INFO:teuthology.lock.ops:Start node 'smithi185.front.sepia.ceph.com' reimaging 2022-05-06T02:00:03.222 INFO:teuthology.lock.ops:Updating [smithi185.front.sepia.ceph.com]: reset os type and version on server 2022-05-06T02:00:03.223 INFO:teuthology.lock.ops:Updating smithi185.front.sepia.ceph.com on lock server 2022-05-06T02:00:03.241 INFO:teuthology.lock.ops:Node 'smithi185.front.sepia.ceph.com' reimaging is complete 2022-05-06T02:00:03.449 INFO:teuthology.provision.fog.smithi124:Scheduling deploy of centos 8.stream 2022-05-06T02:00:03.455 INFO:teuthology.provision.fog.smithi185:Scheduling deploy of centos 8.stream 2022-05-06T02:00:03.786 INFO:teuthology.orchestra.console:Power off smithi185 2022-05-06T02:00:03.848 INFO:teuthology.orchestra.console:Power off smithi124 2022-05-06T02:00:03.927 INFO:teuthology.orchestra.console:Power off for smithi185 completed 2022-05-06T02:00:03.990 INFO:teuthology.orchestra.console:Power off for smithi124 completed 2022-05-06T02:00:04.029 INFO:teuthology.orchestra.console:Power on smithi185 2022-05-06T02:00:04.091 INFO:teuthology.orchestra.console:Power on smithi124 2022-05-06T02:00:08.285 INFO:teuthology.orchestra.console:Power on for smithi185 completed 2022-05-06T02:00:08.386 INFO:teuthology.provision.fog.smithi185:Waiting for deploy to finish 2022-05-06T02:00:12.454 INFO:teuthology.orchestra.console:Power on for smithi124 completed 2022-05-06T02:00:12.556 INFO:teuthology.provision.fog.smithi124:Waiting for deploy to finish 2022-05-06T02:04:53.301 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-06T02:04:53.552 INFO:teuthology.provision.fog.smithi124:Node is ready 2022-05-06T02:04:53.611 INFO:teuthology.orchestra.run.smithi124.stdout:smithi124.front.sepia.ceph.com 2022-05-06T02:04:53.672 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.15.124 smithi124.front.sepia.ceph.com smithi124 2022-05-06T02:04:54.034 INFO:teuthology.provision.fog.smithi124:Deploy complete! 2022-05-06T02:04:55.088 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-06T02:04:55.342 INFO:teuthology.provision.fog.smithi185:Node is ready 2022-05-06T02:04:55.400 INFO:teuthology.orchestra.run.smithi185.stdout:smithi185.front.sepia.ceph.com 2022-05-06T02:04:55.458 INFO:teuthology.orchestra.run.smithi185.stdout:172.21.15.185 smithi185.front.sepia.ceph.com smithi185 2022-05-06T02:04:55.798 INFO:teuthology.provision.fog.smithi185:Deploy complete! 2022-05-06T02:04:55.947 INFO:teuthology.lock.ops:Checking smithi124.front.sepia.ceph.com 2022-05-06T02:04:55.948 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-06T02:04:55.967 INFO:teuthology.lock.ops:Checking smithi185.front.sepia.ceph.com 2022-05-06T02:04:55.968 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-06T02:04:55.991 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: set os type and version on server 2022-05-06T02:04:55.991 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2022-05-06T02:04:56.201 INFO:teuthology.orchestra.run.smithi124.stdout:x86_64 2022-05-06T02:04:56.259 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="CentOS Stream" 2022-05-06T02:04:56.260 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="8" 2022-05-06T02:04:56.260 INFO:teuthology.orchestra.run.smithi124.stdout:ID="centos" 2022-05-06T02:04:56.261 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="rhel fedora" 2022-05-06T02:04:56.261 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="8" 2022-05-06T02:04:56.262 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el8" 2022-05-06T02:04:56.262 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-06T02:04:56.263 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31" 2022-05-06T02:04:56.263 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-06T02:04:56.263 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://centos.org/" 2022-05-06T02:04:56.263 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-06T02:04:56.264 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-06T02:04:56.264 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-06T02:04:56.267 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server 2022-05-06T02:04:56.285 INFO:teuthology.lock.ops:Updating [smithi185.front.sepia.ceph.com]: set os type and version on server 2022-05-06T02:04:56.285 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi185.front.sepia.ceph.com' 2022-05-06T02:04:56.487 INFO:teuthology.orchestra.run.smithi185.stdout:x86_64 2022-05-06T02:04:56.545 INFO:teuthology.orchestra.run.smithi185.stdout:NAME="CentOS Stream" 2022-05-06T02:04:56.545 INFO:teuthology.orchestra.run.smithi185.stdout:VERSION="8" 2022-05-06T02:04:56.545 INFO:teuthology.orchestra.run.smithi185.stdout:ID="centos" 2022-05-06T02:04:56.545 INFO:teuthology.orchestra.run.smithi185.stdout:ID_LIKE="rhel fedora" 2022-05-06T02:04:56.546 INFO:teuthology.orchestra.run.smithi185.stdout:VERSION_ID="8" 2022-05-06T02:04:56.546 INFO:teuthology.orchestra.run.smithi185.stdout:PLATFORM_ID="platform:el8" 2022-05-06T02:04:56.546 INFO:teuthology.orchestra.run.smithi185.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-06T02:04:56.546 INFO:teuthology.orchestra.run.smithi185.stdout:ANSI_COLOR="0;31" 2022-05-06T02:04:56.547 INFO:teuthology.orchestra.run.smithi185.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-06T02:04:56.547 INFO:teuthology.orchestra.run.smithi185.stdout:HOME_URL="https://centos.org/" 2022-05-06T02:04:56.547 INFO:teuthology.orchestra.run.smithi185.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-06T02:04:56.548 INFO:teuthology.orchestra.run.smithi185.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-06T02:04:56.548 INFO:teuthology.orchestra.run.smithi185.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-06T02:04:56.548 INFO:teuthology.lock.ops:Updating smithi185.front.sepia.ceph.com on lock server 2022-05-06T02:04:56.647 INFO:teuthology.dispatcher.supervisor:Running job 6822853 2022-05-06T02:04:56.648 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/bin/teuthology -v --owner scheduled_amathuri@teuthology --archive /home/teuthworker/archive/amathuri-2022-05-05_05:14:18-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6822853 --name amathuri-2022-05-05_05:14:18-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} -- /home/teuthworker/archive/amathuri-2022-05-05_05:14:18-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6822853/orig.config.yaml 2022-05-06T02:04:56.652 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/amathuri-2022-05-05_05:14:18-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6822853 2022-05-06T02:04:56.653 INFO:teuthology.dispatcher.supervisor:Job PID: 18592 2022-05-06T02:04:56.654 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-05-06T08:35:25.987 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-06T08:35:26.148 INFO:teuthology.kill:Killing Pids: {18592} 2022-05-06T08:35:27.626 INFO:teuthology.task.internal:roles: ubuntu@smithi124.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-05-06T08:35:27.627 INFO:teuthology.task.internal:roles: ubuntu@smithi185.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-05-06T08:35:27.627 INFO:teuthology.misc:Compressing logs... 2022-05-06T08:35:27.628 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2022-05-06T08:35:27.829 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi185.front.sepia.ceph.com' 2022-05-06T08:35:28.175 INFO:teuthology.misc:Compressing logs... 2022-05-06T08:35:28.648 INFO:teuthology.orchestra.run.smithi124.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-05-06T08:35:28.764 INFO:teuthology.orchestra.run.smithi185.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-05-06T08:35:29.113 INFO:teuthology.misc:Compressing logs... 2022-05-06T08:35:53.646 INFO:teuthology.orchestra.run.smithi124.stderr:gzip: /var/log/ceph/ceph-osd.0.log: file size changed while zipping 2022-05-06T08:36:05.261 INFO:teuthology.kill:No teuthology processes running 2022-05-06T08:36:06.728 INFO:teuthology.kill:Nuking machines: ['smithi124', 'smithi185'] 2022-05-06T08:36:07.962 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-05-06T08:36:07.963 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-05-06T08:36:07.963 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:236: CryptographyDeprecationWarning: Blowfish has been deprecated 2022-05-06T08:36:07.963 INFO:teuthology.kill: "class": algorithms.Blowfish, 2022-05-06T08:36:07.964 INFO:teuthology.kill:2022-05-06 08:36:07,961.961 INFO:teuthology.nuke:targets: 2022-05-06T08:36:07.964 INFO:teuthology.kill: smithi124.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5pPOvgYfidiR6dC0K7/igPTXZ1rdpWBAtHRyZiIQAc9YlmDRnKa2vdRmA0B8OtuYly6LtYL0nrOjQH9kN4/RCQ280PiT7F8cWp6TPRSlJae6pZgU/F2VMJrsGP6jIu/wn0vRj+c5JzA97TneToE95MSYXIWRumZChzrXWQcCNAVHYwRWN1AP/mckw6BhbO/+giE9tRmzftFj/7E1WojPEQ02t+hqfOXJOZ+Vy7Er4P3h02nHyYBDkqadr9wDXSZwMFJbjrKea+ka6GSjXVLqaTnY64nyg2C+6kiiy8An/izLQ2DtoYfn6TYUkSu34+uwHaFbQGSEGwyfLUV8Hy2h9XaxEe7zb20jSVLd8IYu+Tet+wYsn9e5zdln5wS/qj/8Kaxx2q1VtYPnmmgz/rZRe2XOPtQ9uNPj3rkwBp3DptzWIE1asbLmsjIQ1nD+Q5C1ZtCp7v907HKSFSoiPOAx2fzSwsnGZH7S5equw1XXWmoC476FGiOPbRvBGN8vrqkk= 2022-05-06T08:36:07.964 INFO:teuthology.kill: smithi185.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBmiBpsswZO0CBEfqLMFoqxftCJr8tmulY4SoaqDnb+iub2KjWSJAZMme2VviW+m4CxZxsQnQnC4Xck+mO7W0EHAgqxdP/5UL/+wkec2zSwYyE/WqcJWr9AWLsx7gCvBGkjjsFTspCKvR689Bvh9nsqDx1e+Zq54yim1CN3LvknuMxmrM0I+EtewnhyO8vCD73dX2gTfJyEB5vL2kfFnNEVgeQrlNCURhJGxJg3kzGv8yksAk4wk4KpE5GK2t00/6sY2S3XBvmBJmvr4cV72dJKj+sGsTsWQ3vDY6KiO3cSWpByFKF55tRW3l23ZL1MnOq774upUblTTONSrhnFhHw0xgZEAVK4VHxaaQLUM/lRQfNjWF8nK8KTLR52asw+hE0odkRBCusnerSRph4VzyGbTBsMKESh7QM2lBWGQHjBf4NXzc55OsDePjb2n1FYHNOkVc1FiiEJa06P0Cbe/IOKQDO9oXFPIXNR1jFMPymy3rJtnEs/5C4Nb+ymlhxikk= 2022-05-06T08:36:07.992 INFO:teuthology.kill:2022-05-06 08:36:07,991.991 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-06T08:36:07.995 INFO:teuthology.kill:2022-05-06 08:36:07,995.995 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-06T08:36:08.074 INFO:teuthology.kill:2022-05-06 08:36:08,073.073 INFO:teuthology.orchestra.console:Power off smithi185 2022-05-06T08:36:08.087 INFO:teuthology.kill:2022-05-06 08:36:08,087.087 INFO:teuthology.orchestra.console:Power off smithi124 2022-05-06T08:36:20.553 INFO:teuthology.kill:2022-05-06 08:36:20,553.553 INFO:teuthology.orchestra.console:Power off for smithi185 completed 2022-05-06T08:36:20.560 INFO:teuthology.kill:2022-05-06 08:36:20,559.559 INFO:teuthology.orchestra.console:Power off for smithi124 completed 2022-05-06T08:36:20.706 INFO:teuthology.kill:2022-05-06 08:36:20,705.705 INFO:teuthology.lock.ops:unlocked: smithi185.front.sepia.ceph.com 2022-05-06T08:36:20.709 INFO:teuthology.kill:2022-05-06 08:36:20,709.709 INFO:teuthology.lock.ops:unlocked: smithi124.front.sepia.ceph.com 2022-05-06T08:38:21.046 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-05-06T08:38:21.148 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi124 but it was locked by another job: /home/teuthworker/archive/khiremat-2022-05-06_08:22:09-fs:volumes-wip-khiremat-44347-subvolumegroup-quota-final-2-distro-default-smithi/6824744 2022-05-06T08:38:21.148 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi185 but it was locked by another job: /home/teuthworker/archive/khiremat-2022-05-06_08:22:09-fs:volumes-wip-khiremat-44347-subvolumegroup-quota-final-2-distro-default-smithi/6824744