2022-05-19T01:37:47.872 INFO:root:teuthology version: 1.1.1.dev333+gb018fa01 2022-05-19T01:37:48.007 INFO:teuthology.lock.ops:Start node 'smithi063.front.sepia.ceph.com' reimaging 2022-05-19T01:37:48.008 INFO:teuthology.lock.ops:Updating [smithi063.front.sepia.ceph.com]: reset os type and version on server 2022-05-19T01:37:48.009 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server 2022-05-19T01:37:48.029 INFO:teuthology.lock.ops:Node 'smithi063.front.sepia.ceph.com' reimaging is complete 2022-05-19T01:37:48.030 INFO:teuthology.lock.ops:Start node 'smithi064.front.sepia.ceph.com' reimaging 2022-05-19T01:37:48.030 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: reset os type and version on server 2022-05-19T01:37:48.030 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2022-05-19T01:37:48.053 INFO:teuthology.lock.ops:Node 'smithi064.front.sepia.ceph.com' reimaging is complete 2022-05-19T01:37:48.248 INFO:teuthology.provision.fog.smithi063:Scheduling deploy of centos 8.stream 2022-05-19T01:37:48.278 INFO:teuthology.provision.fog.smithi064:Scheduling deploy of centos 8.stream 2022-05-19T01:37:48.560 INFO:teuthology.orchestra.console:Power off smithi063 2022-05-19T01:37:48.612 INFO:teuthology.orchestra.console:Power off smithi064 2022-05-19T01:38:01.044 INFO:teuthology.orchestra.console:Power off for smithi063 completed 2022-05-19T01:38:01.092 INFO:teuthology.orchestra.console:Power off for smithi064 completed 2022-05-19T01:38:01.145 INFO:teuthology.orchestra.console:Power on smithi063 2022-05-19T01:38:01.193 INFO:teuthology.orchestra.console:Power on smithi064 2022-05-19T01:38:09.512 INFO:teuthology.orchestra.console:Power on for smithi063 completed 2022-05-19T01:38:09.559 INFO:teuthology.orchestra.console:Power on for smithi064 completed 2022-05-19T01:38:09.614 INFO:teuthology.provision.fog.smithi063:Waiting for deploy to finish 2022-05-19T01:38:09.660 INFO:teuthology.provision.fog.smithi064:Waiting for deploy to finish 2022-05-19T01:42:50.633 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-19T01:42:50.890 INFO:teuthology.provision.fog.smithi064:Node is ready 2022-05-19T01:42:50.909 INFO:teuthology.orchestra.run.smithi064.stdout:smithi064.front.sepia.ceph.com 2022-05-19T01:42:50.968 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64 smithi064.front.sepia.ceph.com smithi064 2022-05-19T01:42:51.324 INFO:teuthology.provision.fog.smithi064:Deploy complete! 2022-05-19T01:42:56.543 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-19T01:42:56.843 INFO:teuthology.provision.fog.smithi063:Node is ready 2022-05-19T01:42:56.863 INFO:teuthology.orchestra.run.smithi063.stdout:smithi063.front.sepia.ceph.com 2022-05-19T01:42:56.923 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63 smithi063.front.sepia.ceph.com smithi063 2022-05-19T01:42:57.290 INFO:teuthology.provision.fog.smithi063:Deploy complete! 2022-05-19T01:42:57.460 INFO:teuthology.lock.ops:Checking smithi063.front.sepia.ceph.com 2022-05-19T01:42:57.461 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-19T01:42:57.486 INFO:teuthology.lock.ops:Checking smithi064.front.sepia.ceph.com 2022-05-19T01:42:57.487 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-19T01:42:57.514 INFO:teuthology.lock.ops:Updating [smithi063.front.sepia.ceph.com]: set os type and version on server 2022-05-19T01:42:57.514 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2022-05-19T01:42:57.756 INFO:teuthology.orchestra.run.smithi063.stdout:x86_64 2022-05-19T01:42:57.813 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="CentOS Stream" 2022-05-19T01:42:57.813 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="8" 2022-05-19T01:42:57.813 INFO:teuthology.orchestra.run.smithi063.stdout:ID="centos" 2022-05-19T01:42:57.814 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE="rhel fedora" 2022-05-19T01:42:57.814 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="8" 2022-05-19T01:42:57.814 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM_ID="platform:el8" 2022-05-19T01:42:57.814 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-19T01:42:57.814 INFO:teuthology.orchestra.run.smithi063.stdout:ANSI_COLOR="0;31" 2022-05-19T01:42:57.815 INFO:teuthology.orchestra.run.smithi063.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-19T01:42:57.815 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://centos.org/" 2022-05-19T01:42:57.815 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-19T01:42:57.815 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-19T01:42:57.816 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-19T01:42:57.817 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server 2022-05-19T01:42:57.839 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: set os type and version on server 2022-05-19T01:42:57.839 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2022-05-19T01:42:58.062 INFO:teuthology.orchestra.run.smithi064.stdout:x86_64 2022-05-19T01:42:58.122 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="CentOS Stream" 2022-05-19T01:42:58.122 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="8" 2022-05-19T01:42:58.122 INFO:teuthology.orchestra.run.smithi064.stdout:ID="centos" 2022-05-19T01:42:58.123 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="rhel fedora" 2022-05-19T01:42:58.123 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="8" 2022-05-19T01:42:58.123 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el8" 2022-05-19T01:42:58.123 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-19T01:42:58.124 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31" 2022-05-19T01:42:58.124 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-19T01:42:58.124 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://centos.org/" 2022-05-19T01:42:58.124 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-19T01:42:58.125 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-19T01:42:58.125 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-19T01:42:58.125 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2022-05-19T01:42:58.238 INFO:teuthology.dispatcher.supervisor:Running job 6837934 2022-05-19T01:42:58.239 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/bin/teuthology -v --owner scheduled_amathuri@teuthology --archive /home/teuthworker/archive/amathuri-2022-05-17_05:46:36-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6837934 --name amathuri-2022-05-17_05:46:36-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} -- /home/teuthworker/archive/amathuri-2022-05-17_05:46:36-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6837934/orig.config.yaml 2022-05-19T01:42:58.248 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/amathuri-2022-05-17_05:46:36-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6837934 2022-05-19T01:42:58.250 INFO:teuthology.dispatcher.supervisor:Job PID: 8043 2022-05-19T01:42:58.250 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-05-19T08:13:30.591 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-19T08:13:30.786 INFO:teuthology.kill:Killing Pids: {8043} 2022-05-19T08:13:32.343 INFO:teuthology.task.internal:roles: ubuntu@smithi063.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-05-19T08:13:32.344 INFO:teuthology.task.internal:roles: ubuntu@smithi064.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-05-19T08:13:32.345 INFO:teuthology.misc:Compressing logs... 2022-05-19T08:13:32.345 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2022-05-19T08:13:32.507 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2022-05-19T08:13:32.847 INFO:teuthology.misc:Compressing logs... 2022-05-19T08:13:33.375 INFO:teuthology.orchestra.run.smithi064.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-05-19T08:13:33.376 INFO:teuthology.orchestra.run.smithi063.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-05-19T08:13:33.718 INFO:teuthology.misc:Compressing logs... 2022-05-19T08:13:37.429 INFO:teuthology.orchestra.run.smithi063.stderr:gzip: /var/log/ceph/ceph-client.admin.103362.log: file size changed while zipping 2022-05-19T08:14:34.537 INFO:teuthology.kill:No teuthology processes running 2022-05-19T08:14:36.188 INFO:teuthology.kill:Nuking machines: ['smithi063', 'smithi064'] 2022-05-19T08:14:37.370 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-05-19T08:14:37.371 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-05-19T08:14:37.372 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:236: CryptographyDeprecationWarning: Blowfish has been deprecated 2022-05-19T08:14:37.372 INFO:teuthology.kill: "class": algorithms.Blowfish, 2022-05-19T08:14:37.372 INFO:teuthology.kill:2022-05-19 08:14:37,370.370 INFO:teuthology.nuke:targets: 2022-05-19T08:14:37.372 INFO:teuthology.kill: smithi063.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDi303fj33xWrW/XFOxbrNoLUYndGdgfkrs0zAspdH+sMk9RkmK+UjepS4qWFrpHJdZIpzNbtPSdOVMsFuSL0fMv9/8P7m1BHlZ77lZwJ0KhOgCC1MUsjv/rzlDDQapBeKCeOUyrTsTEgFnV3pu/7j/xPagrn0zCktQIUKapEJGgrneRHMpaXv5LaHp8a+yzn6+vPeFvUviDQykpOvjH+KVCU25U2b8nzSklPcXfRKMBwjytVwwiYeB+UqfGSz1OciiE52VZHBER31pkINARjA3l0S4G9N87lZ8zN+hGY0DCDdEHKVaml93d/+jBLlFkuQOWVqZqTqRIQm6YvWbeFm6VaYbBEQ3oHfkbCu5stV60edjRm/hM+IMoueu3ANsphgvt/3UI9kwz9Bw9ZR8FPZSZf10/eGfcijiexXmXJBcY+CQb6RFfKLs2qHtOCr2mOWTmkv5cjHeNZsyneqycvEFAxTDuzkb97E/Ll78pZ1R8DSR2riFUZcF3V0ngMbiLVM= 2022-05-19T08:14:37.373 INFO:teuthology.kill: smithi064.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8/vSqNjxZC91Esd2rEUpiyUHdmhsNn0Ok8XPPy4lGdnWjM8bulB6ri8Hj0yep3bvBxJLQoDzl1Drk6AVtHs3/+s6nBRELGAlFYCthhs2NaWtnY+Fq85P5q1i9HNc25nyDdFd1zHlgbhK0pyxfUth3ALEIB4x5orNIT15J8MahPGQlnD4CD0fCZ08e0vW30Z1s30SI2l1xHTIIUldZO5AQdijD+13NQW5CzfPf1LR//QRkRfnBr63EwtWtm9z5JOh2byXyqQC1pOz95GPhDyMYUpmB87eg1ODERYwUpxCouaJT6MUjK0sTsKG0yp3egHqalY+hwoQP0pWGA4PzkqkjJ4yOCTiAfwcz7Rl1jJZOB9wX4sZCtPD9aosAAyGbYVwdL7Gg2xI4OQhM9kufLG7xwUx08qxWZ03H9oIfKYzwyi8kPOGZY4IWa09Al8YHg1OOxxP7aMhOcHqkLrytO94MYN0C8Ml1e/Xo8jt1v7UiigKwBwIGuK4hDFZIDfjsGgM= 2022-05-19T08:14:37.402 INFO:teuthology.kill:2022-05-19 08:14:37,402.402 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-19T08:14:37.408 INFO:teuthology.kill:2022-05-19 08:14:37,408.408 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-19T08:14:37.490 INFO:teuthology.kill:2022-05-19 08:14:37,490.490 INFO:teuthology.orchestra.console:Power off smithi063 2022-05-19T08:14:37.503 INFO:teuthology.kill:2022-05-19 08:14:37,502.502 INFO:teuthology.orchestra.console:Power off smithi064 2022-05-19T08:14:45.862 INFO:teuthology.kill:2022-05-19 08:14:45,862.862 INFO:teuthology.orchestra.console:Power off for smithi064 completed 2022-05-19T08:14:46.013 INFO:teuthology.kill:2022-05-19 08:14:46,012.012 INFO:teuthology.lock.ops:unlocked: smithi064.front.sepia.ceph.com 2022-05-19T08:14:49.968 INFO:teuthology.kill:2022-05-19 08:14:49,967.967 INFO:teuthology.orchestra.console:Power off for smithi063 completed 2022-05-19T08:14:50.116 INFO:teuthology.kill:2022-05-19 08:14:50,116.116 INFO:teuthology.lock.ops:unlocked: smithi063.front.sepia.ceph.com 2022-05-19T08:16:50.516 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-05-19T08:16:50.663 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi063 but it was locked by another job: /home/teuthworker/archive/adking-2022-05-19_01:41:26-orch:cephadm-wip-adk2-testing-2022-05-18-1605-pacific-distro-basic-smithi/6840547 2022-05-19T08:16:50.663 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi064 but it was locked by another job: /home/teuthworker/archive/adking-2022-05-19_01:41:26-orch:cephadm-wip-adk2-testing-2022-05-18-1605-pacific-distro-basic-smithi/6840547