2022-05-18T11:42:43.634 INFO:root:teuthology version: 1.1.1.dev333+gb018fa01 2022-05-18T11:42:43.849 INFO:teuthology.lock.ops:Start node 'smithi163.front.sepia.ceph.com' reimaging 2022-05-18T11:42:43.850 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: reset os type and version on server 2022-05-18T11:42:43.850 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2022-05-18T11:42:43.879 INFO:teuthology.lock.ops:Node 'smithi163.front.sepia.ceph.com' reimaging is complete 2022-05-18T11:42:43.879 INFO:teuthology.lock.ops:Start node 'smithi173.front.sepia.ceph.com' reimaging 2022-05-18T11:42:43.879 INFO:teuthology.lock.ops:Updating [smithi173.front.sepia.ceph.com]: reset os type and version on server 2022-05-18T11:42:43.880 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2022-05-18T11:42:43.907 INFO:teuthology.lock.ops:Node 'smithi173.front.sepia.ceph.com' reimaging is complete 2022-05-18T11:42:44.100 INFO:teuthology.provision.fog.smithi163:Scheduling deploy of centos 8.stream 2022-05-18T11:42:44.171 INFO:teuthology.provision.fog.smithi173:Scheduling deploy of centos 8.stream 2022-05-18T11:42:44.471 INFO:teuthology.orchestra.console:Power off smithi163 2022-05-18T11:42:44.535 INFO:teuthology.orchestra.console:Power off smithi173 2022-05-18T11:42:52.907 INFO:teuthology.orchestra.console:Power off for smithi173 completed 2022-05-18T11:42:53.009 INFO:teuthology.orchestra.console:Power on smithi173 2022-05-18T11:42:56.980 INFO:teuthology.orchestra.console:Power off for smithi163 completed 2022-05-18T11:42:57.082 INFO:teuthology.orchestra.console:Power on smithi163 2022-05-18T11:42:57.283 INFO:teuthology.orchestra.console:Power on for smithi173 completed 2022-05-18T11:42:57.384 INFO:teuthology.provision.fog.smithi173:Waiting for deploy to finish 2022-05-18T11:43:01.342 INFO:teuthology.orchestra.console:Power on for smithi163 completed 2022-05-18T11:43:01.444 INFO:teuthology.provision.fog.smithi163:Waiting for deploy to finish 2022-05-18T11:47:01.122 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-18T11:47:26.205 INFO:teuthology.provision.fog.smithi173:Node is ready 2022-05-18T11:47:26.225 INFO:teuthology.orchestra.run.smithi173.stdout:smithi173.front.sepia.ceph.com 2022-05-18T11:47:26.283 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.15.173 smithi173.front.sepia.ceph.com smithi173 2022-05-18T11:47:26.641 INFO:teuthology.provision.fog.smithi173:Deploy complete! 2022-05-18T11:48:37.051 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-18T11:48:37.315 INFO:teuthology.provision.fog.smithi163:Node is ready 2022-05-18T11:48:37.332 INFO:teuthology.orchestra.run.smithi163.stdout:smithi163.front.sepia.ceph.com 2022-05-18T11:48:37.390 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163 smithi163.front.sepia.ceph.com smithi163 2022-05-18T11:48:37.780 INFO:teuthology.provision.fog.smithi163:Deploy complete! 2022-05-18T11:48:37.986 INFO:teuthology.lock.ops:Checking smithi163.front.sepia.ceph.com 2022-05-18T11:48:37.987 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-18T11:48:38.121 INFO:teuthology.lock.ops:Checking smithi173.front.sepia.ceph.com 2022-05-18T11:48:38.123 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-18T11:48:38.331 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: set os type and version on server 2022-05-18T11:48:38.332 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2022-05-18T11:48:38.539 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64 2022-05-18T11:48:38.598 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="CentOS Stream" 2022-05-18T11:48:38.598 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="8" 2022-05-18T11:48:38.598 INFO:teuthology.orchestra.run.smithi163.stdout:ID="centos" 2022-05-18T11:48:38.598 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="rhel fedora" 2022-05-18T11:48:38.599 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="8" 2022-05-18T11:48:38.599 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el8" 2022-05-18T11:48:38.599 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-18T11:48:38.599 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31" 2022-05-18T11:48:38.600 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-18T11:48:38.600 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://centos.org/" 2022-05-18T11:48:38.600 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-18T11:48:38.600 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-18T11:48:38.601 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-18T11:48:38.602 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2022-05-18T11:48:38.622 INFO:teuthology.lock.ops:Updating [smithi173.front.sepia.ceph.com]: set os type and version on server 2022-05-18T11:48:38.622 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2022-05-18T11:48:38.907 INFO:teuthology.orchestra.run.smithi173.stdout:x86_64 2022-05-18T11:48:38.968 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="CentOS Stream" 2022-05-18T11:48:38.968 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="8" 2022-05-18T11:48:38.968 INFO:teuthology.orchestra.run.smithi173.stdout:ID="centos" 2022-05-18T11:48:38.969 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="rhel fedora" 2022-05-18T11:48:38.969 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="8" 2022-05-18T11:48:38.969 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el8" 2022-05-18T11:48:38.969 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-18T11:48:38.970 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31" 2022-05-18T11:48:38.970 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-18T11:48:38.970 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://centos.org/" 2022-05-18T11:48:38.970 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-18T11:48:38.971 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-18T11:48:38.971 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-18T11:48:38.972 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2022-05-18T11:48:39.089 INFO:teuthology.dispatcher.supervisor:Running job 6837877 2022-05-18T11:48:39.089 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/bin/teuthology -v --owner scheduled_amathuri@teuthology --archive /home/teuthworker/archive/amathuri-2022-05-17_05:46:36-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6837877 --name amathuri-2022-05-17_05:46:36-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} -- /home/teuthworker/archive/amathuri-2022-05-17_05:46:36-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6837877/orig.config.yaml 2022-05-18T11:48:39.096 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/amathuri-2022-05-17_05:46:36-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6837877 2022-05-18T11:48:39.097 INFO:teuthology.dispatcher.supervisor:Job PID: 4387 2022-05-18T11:48:39.098 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-05-18T18:19:09.701 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-18T18:19:09.951 INFO:teuthology.kill:Killing Pids: {4387} 2022-05-18T18:19:11.448 INFO:teuthology.task.internal:roles: ubuntu@smithi163.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-05-18T18:19:11.449 INFO:teuthology.task.internal:roles: ubuntu@smithi173.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-05-18T18:19:11.449 INFO:teuthology.misc:Compressing logs... 2022-05-18T18:19:11.450 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2022-05-18T18:19:11.657 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2022-05-18T18:19:12.126 INFO:teuthology.misc:Compressing logs... 2022-05-18T18:19:12.511 INFO:teuthology.orchestra.run.smithi173.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-05-18T18:19:12.525 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-05-18T18:19:12.790 INFO:teuthology.misc:Compressing logs... 2022-05-18T18:19:54.318 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /var/log/ceph/ceph-client.admin.109409.log: file size changed while zipping 2022-05-18T18:20:58.989 INFO:teuthology.kill:No teuthology processes running 2022-05-18T18:21:00.753 INFO:teuthology.kill:Nuking machines: ['smithi163', 'smithi173'] 2022-05-18T18:21:02.109 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-05-18T18:21:02.110 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-05-18T18:21:02.111 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:236: CryptographyDeprecationWarning: Blowfish has been deprecated 2022-05-18T18:21:02.111 INFO:teuthology.kill: "class": algorithms.Blowfish, 2022-05-18T18:21:02.111 INFO:teuthology.kill:2022-05-18 18:21:02,107.107 INFO:teuthology.nuke:targets: 2022-05-18T18:21:02.112 INFO:teuthology.kill: smithi163.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDG1di8g62m1jGDqnxexL/f7ZYeIp0R8u2eOLIfglPoSse1CFe9OPPF6+Z5JyXJ2HNnVVcOHXFjV2E8Ms09Z9xIOEGIoxW2Lc31Qz5bGLWxMIkhu3aUtnmY+76X2A/Lb3uV/gnfzTkjpNmIgOwEXTYNSCWLon24wzTYwWWHydwiw8kbIVEoZ3tAZrJ2cSoQh1oXcUv1o4oFy2sJzaDd7Cr444ll3ylHyR5Z1kSQPZ2gWbuBwXknt0Z21DNhcMLlo55BjGEyzGwGlL4b+fKyZScPo2D3efTs90fELefGzg9jOUMZTv/5cBxl/KlBwaqBMwlcOAyd/i/YHbQt4JcXkBmAKG1+nYmbpkj9O6af3lwskghOBFWiWL5Ab3lcaKMffgeg14s1HG7JRnSXxiQoo751NkAp2DKnjSZINLG6rkXG/56pTOzKfuG50/FsmGyMyUFZ8Z3z1xr6FfwVT16ZffTSax1RIubWQxyg3BnITnuKz3CCXqPB+0GQ2eWdXaGEGmM= 2022-05-18T18:21:02.112 INFO:teuthology.kill: smithi173.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkLCuRg8QeQxMRn7KwkZq9PoNK1Ejw4sw6B/JyZVV3ZC2LfueoCVzpYZ+/ir4CkcWwK5eO31v7RM7mGJ9BA2Wj6yrV1kM4VlkGRAeIwxeFCau6YCX23QjmHQWRGVETtXV+mIkyh+QJja9SgUhqbYIo9jP3+oZKN3KiuUR9PGS4cAPIPCR2Bl/DGlXY0r9ahxtF4bkuOgAUsS8fCYr2cHzR7tXqYe/tNq0ulg1mQ45kaQBikKdUUNvxU6WGu3ehXfvJM7Ae7mjCoEFIVUWiN+WXnRsukOp5uQ9FEB9L5/9tlSR5zqmKZh7HobMIuYjiAJypncy5Fig+JXNb60XhNWKcWOQm3wsMpxGvOUJWO/o9MwmU3RUhcYMbLRwA/32azWfYRqq/VWpsP60gD+a6cYL/CUQ+Xgb/aMZY2/vojw/8WWxXt/aXYs+5fwRCKjgBnq/B6qj7PKZ1Loy0Ke6WgYzbLhfBWW4uQezFkxVNS3cmoCxY287ONpgZWro57TiZ1yM= 2022-05-18T18:21:02.144 INFO:teuthology.kill:2022-05-18 18:21:02,144.144 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-18T18:21:02.149 INFO:teuthology.kill:2022-05-18 18:21:02,149.149 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-18T18:21:02.252 INFO:teuthology.kill:2022-05-18 18:21:02,251.251 INFO:teuthology.orchestra.console:Power off smithi163 2022-05-18T18:21:02.275 INFO:teuthology.kill:2022-05-18 18:21:02,274.274 INFO:teuthology.orchestra.console:Power off smithi173 2022-05-18T18:21:14.765 INFO:teuthology.kill:2022-05-18 18:21:14,764.764 INFO:teuthology.orchestra.console:Power off for smithi163 completed 2022-05-18T18:21:14.773 INFO:teuthology.kill:2022-05-18 18:21:14,773.773 INFO:teuthology.orchestra.console:Power off for smithi173 completed 2022-05-18T18:21:14.941 INFO:teuthology.kill:2022-05-18 18:21:14,940.940 INFO:teuthology.lock.ops:unlocked: smithi163.front.sepia.ceph.com 2022-05-18T18:21:14.943 INFO:teuthology.kill:2022-05-18 18:21:14,943.943 INFO:teuthology.lock.ops:unlocked: smithi173.front.sepia.ceph.com 2022-05-18T18:23:15.362 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-05-18T18:23:15.474 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi163 but it was locked by another job: /home/teuthworker/archive/cbodley-2022-05-18_17:53:50-rgw-wip-cbodley-testing-distro-default-smithi/6840352 2022-05-18T18:23:15.475 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi173 but it was locked by another job: /home/teuthworker/archive/cbodley-2022-05-18_17:53:50-rgw-wip-cbodley-testing-distro-default-smithi/6840346