2022-05-17T20:30:33.474 INFO:root:teuthology version: 1.1.1.dev333+gb018fa01 2022-05-17T20:30:33.599 INFO:teuthology.lock.ops:Start node 'smithi027.front.sepia.ceph.com' reimaging 2022-05-17T20:30:33.601 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: reset os type and version on server 2022-05-17T20:30:33.601 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2022-05-17T20:30:33.620 INFO:teuthology.lock.ops:Node 'smithi027.front.sepia.ceph.com' reimaging is complete 2022-05-17T20:30:33.621 INFO:teuthology.lock.ops:Start node 'smithi131.front.sepia.ceph.com' reimaging 2022-05-17T20:30:33.621 INFO:teuthology.lock.ops:Updating [smithi131.front.sepia.ceph.com]: reset os type and version on server 2022-05-17T20:30:33.621 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2022-05-17T20:30:33.645 INFO:teuthology.lock.ops:Node 'smithi131.front.sepia.ceph.com' reimaging is complete 2022-05-17T20:30:33.833 INFO:teuthology.provision.fog.smithi027:Scheduling deploy of centos 8.stream 2022-05-17T20:30:33.862 INFO:teuthology.provision.fog.smithi131:Scheduling deploy of centos 8.stream 2022-05-17T20:30:34.218 INFO:teuthology.orchestra.console:Power off smithi027 2022-05-17T20:30:34.255 INFO:teuthology.orchestra.console:Power off smithi131 2022-05-17T20:30:46.699 INFO:teuthology.orchestra.console:Power off for smithi027 completed 2022-05-17T20:30:46.727 INFO:teuthology.orchestra.console:Power off for smithi131 completed 2022-05-17T20:30:46.801 INFO:teuthology.orchestra.console:Power on smithi027 2022-05-17T20:30:46.827 INFO:teuthology.orchestra.console:Power on smithi131 2022-05-17T20:30:51.076 INFO:teuthology.orchestra.console:Power on for smithi131 completed 2022-05-17T20:30:51.177 INFO:teuthology.provision.fog.smithi131:Waiting for deploy to finish 2022-05-17T20:30:55.166 INFO:teuthology.orchestra.console:Power on for smithi027 completed 2022-05-17T20:30:55.267 INFO:teuthology.provision.fog.smithi027:Waiting for deploy to finish 2022-05-17T20:34:48.055 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-17T20:35:13.535 INFO:teuthology.provision.fog.smithi131:Node is ready 2022-05-17T20:35:13.559 INFO:teuthology.orchestra.run.smithi131.stdout:smithi131.front.sepia.ceph.com 2022-05-17T20:35:13.618 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.131 smithi131.front.sepia.ceph.com smithi131 2022-05-17T20:35:13.988 INFO:teuthology.provision.fog.smithi131:Deploy complete! 2022-05-17T20:36:11.492 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-17T20:36:31.538 INFO:teuthology.provision.fog.smithi027:Node is ready 2022-05-17T20:36:31.561 INFO:teuthology.orchestra.run.smithi027.stdout:smithi027.front.sepia.ceph.com 2022-05-17T20:36:31.619 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27 smithi027.front.sepia.ceph.com smithi027 2022-05-17T20:36:32.000 INFO:teuthology.provision.fog.smithi027:Deploy complete! 2022-05-17T20:36:32.178 INFO:teuthology.lock.ops:Checking smithi027.front.sepia.ceph.com 2022-05-17T20:36:32.179 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-17T20:36:32.206 INFO:teuthology.lock.ops:Checking smithi131.front.sepia.ceph.com 2022-05-17T20:36:32.207 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-17T20:36:32.227 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: set os type and version on server 2022-05-17T20:36:32.227 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2022-05-17T20:36:32.478 INFO:teuthology.orchestra.run.smithi027.stdout:x86_64 2022-05-17T20:36:32.536 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="CentOS Stream" 2022-05-17T20:36:32.537 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="8" 2022-05-17T20:36:32.537 INFO:teuthology.orchestra.run.smithi027.stdout:ID="centos" 2022-05-17T20:36:32.537 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="rhel fedora" 2022-05-17T20:36:32.538 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="8" 2022-05-17T20:36:32.538 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el8" 2022-05-17T20:36:32.538 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-17T20:36:32.538 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31" 2022-05-17T20:36:32.539 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-17T20:36:32.539 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://centos.org/" 2022-05-17T20:36:32.539 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-17T20:36:32.539 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-17T20:36:32.540 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-17T20:36:32.541 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2022-05-17T20:36:32.562 INFO:teuthology.lock.ops:Updating [smithi131.front.sepia.ceph.com]: set os type and version on server 2022-05-17T20:36:32.562 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2022-05-17T20:36:32.889 INFO:teuthology.orchestra.run.smithi131.stdout:x86_64 2022-05-17T20:36:32.947 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="CentOS Stream" 2022-05-17T20:36:32.947 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="8" 2022-05-17T20:36:32.947 INFO:teuthology.orchestra.run.smithi131.stdout:ID="centos" 2022-05-17T20:36:32.947 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="rhel fedora" 2022-05-17T20:36:32.948 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="8" 2022-05-17T20:36:32.948 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el8" 2022-05-17T20:36:32.948 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-17T20:36:32.949 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31" 2022-05-17T20:36:32.949 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-17T20:36:32.949 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://centos.org/" 2022-05-17T20:36:32.949 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-17T20:36:32.950 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-17T20:36:32.950 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-17T20:36:32.950 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2022-05-17T20:36:33.067 INFO:teuthology.dispatcher.supervisor:Running job 6837841 2022-05-17T20:36:33.068 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/bin/teuthology -v --owner scheduled_amathuri@teuthology --archive /home/teuthworker/archive/amathuri-2022-05-17_05:46:36-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6837841 --name amathuri-2022-05-17_05:46:36-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} -- /home/teuthworker/archive/amathuri-2022-05-17_05:46:36-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6837841/orig.config.yaml 2022-05-17T20:36:33.073 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/amathuri-2022-05-17_05:46:36-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6837841 2022-05-17T20:36:33.074 INFO:teuthology.dispatcher.supervisor:Job PID: 1417 2022-05-17T20:36:33.074 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-05-18T03:06:44.771 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-18T03:06:44.950 INFO:teuthology.kill:Killing Pids: {1417} 2022-05-18T03:06:46.387 INFO:teuthology.task.internal:roles: ubuntu@smithi027.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-05-18T03:06:46.388 INFO:teuthology.task.internal:roles: ubuntu@smithi131.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-05-18T03:06:46.388 INFO:teuthology.misc:Compressing logs... 2022-05-18T03:06:46.389 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2022-05-18T03:06:46.638 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2022-05-18T03:06:47.170 INFO:teuthology.misc:Compressing logs... 2022-05-18T03:06:47.467 INFO:teuthology.orchestra.run.smithi131.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-05-18T03:06:47.537 INFO:teuthology.orchestra.run.smithi027.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-05-18T03:06:47.774 INFO:teuthology.misc:Compressing logs... 2022-05-18T03:06:56.502 INFO:teuthology.orchestra.run.smithi027.stderr:gzip: /var/log/ceph/ceph-client.admin.105585.log: file size changed while zipping 2022-05-18T03:06:56.688 INFO:teuthology.orchestra.run.smithi027.stderr:gzip: /var/log/ceph/ceph-client.admin.105311.log: file size changed while zipping 2022-05-18T03:11:17.360 INFO:teuthology.kill:No teuthology processes running 2022-05-18T03:11:18.953 INFO:teuthology.kill:Nuking machines: ['smithi027', 'smithi131'] 2022-05-18T03:11:20.191 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-05-18T03:11:20.192 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-05-18T03:11:20.192 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:236: CryptographyDeprecationWarning: Blowfish has been deprecated 2022-05-18T03:11:20.193 INFO:teuthology.kill: "class": algorithms.Blowfish, 2022-05-18T03:11:20.193 INFO:teuthology.kill:2022-05-18 03:11:20,191.191 INFO:teuthology.nuke:targets: 2022-05-18T03:11:20.193 INFO:teuthology.kill: smithi027.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQHz6hpREc+0CBl46UIZFy45GCduc3yD14UrC7CcYxY+X0SkFTZ0uW+ZfsqSZ87p5DGTy2unMXADOB0Ui43tpdtdl02WxUDGSla7D/vc1CCA9AqoTv8EcnJtbZHFeE2U8afpBLpJnY62Zz+fPxzwwbxFu7MJYNAIAE9mw7R3WJYLu9KepYkwmD6oVDnKYRP3VXKnSKwrXUeAtHdvhbAPxP85F3rTlWmcJDd5wmEZv+5b1HMDyzH7dpwPn9TV6x3hwlG0y6hjoAOAV7dPk2ESojRoYop2gTmkWoyIrFTaXiwyBfSrehEEvt4UsTGNCSp+SIIHyTkIEpSrh5aXUfAru1nC7qA1pTMz/mvRhURubM0iApMQkUeBgUfggHMyE7RiAob0IS5YFqdXd9VjjWd6mBfkxiXs8pF4SntlBMkYJk63Xoc5ZIlEblDM4PULwVuheGPBq7vRmTRj8q9QdNEptH2D4KWjzNcjr7WDXkZB9uhVB6Cf5IbrpONVYA8B1b63s= 2022-05-18T03:11:20.194 INFO:teuthology.kill: smithi131.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNYvSm8DHe466Lpil4u6IjyIEu4brDCk48PM3YTBCRs/6uWtuHSXH66gP5Uau5gN2c9ZMJR++1i5QdWEIbuce9EzIYTInRK/ySCayCEKA4y81vp4YqwdnK9ny2VXoW65x3shmAf+0C07ZB0Dtgdy2pDGo4DviXkgJRC49tTdi46SZ6988XvgqkEQ+hJA7EF69u7MqnixtYoeJsf7586j3KxA1p8tbLUDaUa9uizTmkG4g/D2FiqscoNxYFv96uFZC2lW5l+occEXryYZZxZZCgvI38dQ7/PzqG9/hocxhL6QazZypR0jY3hw+F6MsGmBHQa1crKpnmjVRESi3ki7OWkvB+M04fLIwKkS+tKuNX7DFOnDNPqXiex1FUKUAonsZorXYn2zk0Jme+rxC3lvCfbQ6Hdm8KBXQaEiiO2kj93p4CFPl8cFYHrcFYGQtQHMFMQI7J1oQSc9WiNcG4903adbGAuCMFbi9JboiutOwJVPsyQToQoiA7ZKzsPtbw5Ec= 2022-05-18T03:11:20.230 INFO:teuthology.kill:2022-05-18 03:11:20,230.230 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-18T03:11:20.234 INFO:teuthology.kill:2022-05-18 03:11:20,234.234 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-18T03:11:20.333 INFO:teuthology.kill:2022-05-18 03:11:20,332.332 INFO:teuthology.orchestra.console:Power off smithi131 2022-05-18T03:11:20.383 INFO:teuthology.kill:2022-05-18 03:11:20,383.383 INFO:teuthology.orchestra.console:Power off smithi027 2022-05-18T03:11:32.828 INFO:teuthology.kill:2022-05-18 03:11:32,827.827 INFO:teuthology.orchestra.console:Power off for smithi131 completed 2022-05-18T03:11:32.861 INFO:teuthology.kill:2022-05-18 03:11:32,861.861 INFO:teuthology.orchestra.console:Power off for smithi027 completed 2022-05-18T03:11:32.987 INFO:teuthology.kill:2022-05-18 03:11:32,986.986 INFO:teuthology.lock.ops:unlocked: smithi131.front.sepia.ceph.com 2022-05-18T03:11:33.010 INFO:teuthology.kill:2022-05-18 03:11:33,009.009 INFO:teuthology.lock.ops:unlocked: smithi027.front.sepia.ceph.com 2022-05-18T03:13:33.348 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-05-18T03:13:33.461 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi027 but it was locked by another job: /home/teuthworker/archive/nojha-2022-05-17_22:38:06-rados-wip-lrc-fix-pacific-distro-basic-smithi/6839080 2022-05-18T03:13:33.462 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi131 but it was locked by another job: /home/teuthworker/archive/nojha-2022-05-17_22:38:06-rados-wip-lrc-fix-pacific-distro-basic-smithi/6839080