2022-05-18T11:42:44.164 INFO:root:teuthology version: 1.1.1.dev333+gb018fa01 2022-05-18T11:42:44.376 INFO:teuthology.lock.ops:Start node 'smithi146.front.sepia.ceph.com' reimaging 2022-05-18T11:42:44.377 INFO:teuthology.lock.ops:Updating [smithi146.front.sepia.ceph.com]: reset os type and version on server 2022-05-18T11:42:44.377 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2022-05-18T11:42:44.408 INFO:teuthology.lock.ops:Node 'smithi146.front.sepia.ceph.com' reimaging is complete 2022-05-18T11:42:44.409 INFO:teuthology.lock.ops:Start node 'smithi157.front.sepia.ceph.com' reimaging 2022-05-18T11:42:44.411 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: reset os type and version on server 2022-05-18T11:42:44.411 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2022-05-18T11:42:44.456 INFO:teuthology.lock.ops:Node 'smithi157.front.sepia.ceph.com' reimaging is complete 2022-05-18T11:42:44.657 INFO:teuthology.provision.fog.smithi146:Scheduling deploy of centos 8.stream 2022-05-18T11:42:44.670 INFO:teuthology.provision.fog.smithi157:Scheduling deploy of centos 8.stream 2022-05-18T11:42:44.982 INFO:teuthology.orchestra.console:Power off smithi146 2022-05-18T11:42:45.024 INFO:teuthology.orchestra.console:Power off smithi157 2022-05-18T11:42:53.399 INFO:teuthology.orchestra.console:Power off for smithi157 completed 2022-05-18T11:42:53.501 INFO:teuthology.orchestra.console:Power on smithi157 2022-05-18T11:42:57.473 INFO:teuthology.orchestra.console:Power off for smithi146 completed 2022-05-18T11:42:57.575 INFO:teuthology.orchestra.console:Power on smithi146 2022-05-18T11:43:01.836 INFO:teuthology.orchestra.console:Power on for smithi146 completed 2022-05-18T11:43:01.868 INFO:teuthology.orchestra.console:Power on for smithi157 completed 2022-05-18T11:43:01.938 INFO:teuthology.provision.fog.smithi146:Waiting for deploy to finish 2022-05-18T11:43:01.969 INFO:teuthology.provision.fog.smithi157:Waiting for deploy to finish 2022-05-18T11:47:20.870 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-18T11:47:46.490 INFO:teuthology.provision.fog.smithi146:Node is ready 2022-05-18T11:47:46.514 INFO:teuthology.orchestra.run.smithi146.stdout:smithi146.front.sepia.ceph.com 2022-05-18T11:47:46.575 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146 smithi146.front.sepia.ceph.com smithi146 2022-05-18T11:47:46.949 INFO:teuthology.provision.fog.smithi146:Deploy complete! 2022-05-18T11:49:14.099 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-18T11:49:14.363 INFO:teuthology.provision.fog.smithi157:Node is ready 2022-05-18T11:49:14.423 INFO:teuthology.orchestra.run.smithi157.stdout:smithi157.front.sepia.ceph.com 2022-05-18T11:49:14.490 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.15.157 smithi157.front.sepia.ceph.com smithi157 2022-05-18T11:49:14.865 INFO:teuthology.provision.fog.smithi157:Deploy complete! 2022-05-18T11:49:15.091 INFO:teuthology.lock.ops:Checking smithi146.front.sepia.ceph.com 2022-05-18T11:49:15.092 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-18T11:49:15.148 INFO:teuthology.lock.ops:Checking smithi157.front.sepia.ceph.com 2022-05-18T11:49:15.148 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-18T11:49:15.191 INFO:teuthology.lock.ops:Updating [smithi146.front.sepia.ceph.com]: set os type and version on server 2022-05-18T11:49:15.192 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2022-05-18T11:49:15.534 INFO:teuthology.orchestra.run.smithi146.stdout:x86_64 2022-05-18T11:49:15.596 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="CentOS Stream" 2022-05-18T11:49:15.596 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="8" 2022-05-18T11:49:15.597 INFO:teuthology.orchestra.run.smithi146.stdout:ID="centos" 2022-05-18T11:49:15.597 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="rhel fedora" 2022-05-18T11:49:15.598 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="8" 2022-05-18T11:49:15.598 INFO:teuthology.orchestra.run.smithi146.stdout:PLATFORM_ID="platform:el8" 2022-05-18T11:49:15.598 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-18T11:49:15.598 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31" 2022-05-18T11:49:15.599 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-18T11:49:15.599 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://centos.org/" 2022-05-18T11:49:15.599 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-18T11:49:15.600 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-18T11:49:15.600 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-18T11:49:15.602 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2022-05-18T11:49:15.626 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: set os type and version on server 2022-05-18T11:49:15.627 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2022-05-18T11:49:15.888 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2022-05-18T11:49:15.953 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="CentOS Stream" 2022-05-18T11:49:15.954 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8" 2022-05-18T11:49:15.954 INFO:teuthology.orchestra.run.smithi157.stdout:ID="centos" 2022-05-18T11:49:15.954 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="rhel fedora" 2022-05-18T11:49:15.954 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8" 2022-05-18T11:49:15.955 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8" 2022-05-18T11:49:15.955 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-18T11:49:15.955 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2022-05-18T11:49:15.955 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-18T11:49:15.956 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://centos.org/" 2022-05-18T11:49:15.956 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-18T11:49:15.956 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-18T11:49:15.956 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-18T11:49:15.957 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2022-05-18T11:49:16.070 INFO:teuthology.dispatcher.supervisor:Running job 6837878 2022-05-18T11:49:16.070 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/bin/teuthology -v --owner scheduled_amathuri@teuthology --archive /home/teuthworker/archive/amathuri-2022-05-17_05:46:36-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6837878 --name amathuri-2022-05-17_05:46:36-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} -- /home/teuthworker/archive/amathuri-2022-05-17_05:46:36-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6837878/orig.config.yaml 2022-05-18T11:49:16.078 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/amathuri-2022-05-17_05:46:36-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6837878 2022-05-18T11:49:16.080 INFO:teuthology.dispatcher.supervisor:Job PID: 16602 2022-05-18T11:49:16.080 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-05-18T18:19:46.666 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-18T18:19:46.870 INFO:teuthology.kill:Killing Pids: {16602} 2022-05-18T18:19:48.469 INFO:teuthology.task.internal:roles: ubuntu@smithi146.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-05-18T18:19:48.470 INFO:teuthology.task.internal:roles: ubuntu@smithi157.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-05-18T18:19:48.471 INFO:teuthology.misc:Compressing logs... 2022-05-18T18:19:48.472 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2022-05-18T18:19:48.679 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2022-05-18T18:19:49.157 INFO:teuthology.misc:Compressing logs... 2022-05-18T18:19:49.532 INFO:teuthology.orchestra.run.smithi157.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-05-18T18:19:49.549 INFO:teuthology.orchestra.run.smithi146.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-05-18T18:19:49.823 INFO:teuthology.misc:Compressing logs... 2022-05-18T18:20:09.025 INFO:teuthology.orchestra.run.smithi146.stderr:gzip: /var/log/ceph/ceph-client.admin.105442.log: file size changed while zipping 2022-05-18T18:20:14.137 INFO:teuthology.orchestra.run.smithi146.stderr:gzip: /var/log/ceph/ceph-client.admin.105778.log: file size changed while zipping 2022-05-18T18:20:38.934 INFO:teuthology.kill:No teuthology processes running 2022-05-18T18:20:40.469 INFO:teuthology.kill:Nuking machines: ['smithi146', 'smithi157'] 2022-05-18T18:20:42.069 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-05-18T18:20:42.070 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-05-18T18:20:42.071 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:236: CryptographyDeprecationWarning: Blowfish has been deprecated 2022-05-18T18:20:42.072 INFO:teuthology.kill: "class": algorithms.Blowfish, 2022-05-18T18:20:42.072 INFO:teuthology.kill:2022-05-18 18:20:42,068.068 INFO:teuthology.nuke:targets: 2022-05-18T18:20:42.073 INFO:teuthology.kill: smithi146.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr7LwxeLE9ddiSuldnPOslqNDKOj9C5u+yV+4PBHdLjR/z2PZe9PteKZ5CX7mlbHty7sLyvu1a6VkSW+BT2ZW9qtWE3losWaJ/nfTI93JxrtsTLxywx3IQhrQYTsZUUbm387utNySek8t6YP1EqYlYnqSSvZwd0d18ouqrzmpekmrU/d+FuEDqYlsvzAZozO7nsll5K38XiBD75qZ3AoyMHwzErBfsY2l96L6h77ApujCess7h47lCJsm5eb+Py7kQBZVcHUiCDoyXBnLmbMlnbBzq3PAH8GXJRsNC2inDAa3hCW8gLHXmveJXntvDONsa6L86MICroRWQR6YRwb/f7l1M5R/kY4CbvENFeDgwBrK+fuQp7RvSTq/w8mUt/bFexql6nsYVJZPg95pe7hHTD6sJ72RvJLmEsA1OvkWpjC/u91rBXkOIyrQBGemSPAl0x/RmjwHi/ucJBt0UDCMeynuPFGJ13jes8kfIhG0erIyO3Yxp2dMSeTqtGIqWKZE= 2022-05-18T18:20:42.074 INFO:teuthology.kill: smithi157.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDia7AGCCJ8Q4rHk9tis+uvvcFHwfEWd+jY94QH8WYMjZh2ohKpg2G5R5L/f2PtT5juoCfXOrUFUKPlv3MfNpy1M2GbvexbmmVCQcqJvbkBPy9TjvLpDwCp74Fx1uet5qhpPdpio+UqhkT1e/vBP9x8f/ai4lm45MSvfj5IyXpFy3EeebyOHZayQqDgHyAuKlRNwIjIAqkM2Vu7YJRLEbfx69MdgiHUn2jT1IWSGzoDK0ToRyNUJrONkrtTuWa/MMaJK1XU5soL2TiOPqiQtFn7VTNxrmWVDlfELWk+z2w9pCyg6Dj3KcLznsFATD7jVg5ELzB3Dvzgqnlzdz6xv691k9w9M+k+I7uBAPfnXlW5aJ/Yq5JgAWWsC/XpNYZRCiiW2GlP0dm1hgM2dB/2X/YT58y53WVFXHqbWBptydZKLLrOM+hvqq+6ZdEjeq0tQdLjGHrCuGvVb/fIzzPuto1ITqUgnriu9JAG1Vc+Kj1a+4mAROzOTcBySKGg8C+vTIk= 2022-05-18T18:20:42.111 INFO:teuthology.kill:2022-05-18 18:20:42,111.111 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-18T18:20:42.116 INFO:teuthology.kill:2022-05-18 18:20:42,116.116 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-18T18:20:42.217 INFO:teuthology.kill:2022-05-18 18:20:42,216.216 INFO:teuthology.orchestra.console:Power off smithi157 2022-05-18T18:20:42.244 INFO:teuthology.kill:2022-05-18 18:20:42,243.243 INFO:teuthology.orchestra.console:Power off smithi146 2022-05-18T18:20:50.640 INFO:teuthology.kill:2022-05-18 18:20:50,640.640 INFO:teuthology.orchestra.console:Power off for smithi157 completed 2022-05-18T18:20:50.803 INFO:teuthology.kill:2022-05-18 18:20:50,802.802 INFO:teuthology.lock.ops:unlocked: smithi157.front.sepia.ceph.com 2022-05-18T18:20:54.769 INFO:teuthology.kill:2022-05-18 18:20:54,768.768 INFO:teuthology.orchestra.console:Power off for smithi146 completed 2022-05-18T18:20:54.954 INFO:teuthology.kill:2022-05-18 18:20:54,951.951 INFO:teuthology.lock.ops:unlocked: smithi146.front.sepia.ceph.com 2022-05-18T18:22:55.512 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-05-18T18:22:55.627 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi146 but it was locked by another job: /home/teuthworker/archive/cbodley-2022-05-18_17:53:50-rgw-wip-cbodley-testing-distro-default-smithi/6840345 2022-05-18T18:22:55.628 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi157 but it was locked by another job: /home/teuthworker/archive/cbodley-2022-05-18_17:53:50-rgw-wip-cbodley-testing-distro-default-smithi/6840345