2022-04-29T13:57:20.581 INFO:root:teuthology version: 1.1.1.dev328+g004701de 2022-04-29T13:57:20.705 INFO:teuthology.lock.ops:Start node 'smithi145.front.sepia.ceph.com' reimaging 2022-04-29T13:57:20.706 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: reset os type and version on server 2022-04-29T13:57:20.706 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2022-04-29T13:57:20.726 INFO:teuthology.lock.ops:Node 'smithi145.front.sepia.ceph.com' reimaging is complete 2022-04-29T13:57:20.727 INFO:teuthology.lock.ops:Start node 'smithi157.front.sepia.ceph.com' reimaging 2022-04-29T13:57:20.727 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: reset os type and version on server 2022-04-29T13:57:20.727 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2022-04-29T13:57:20.748 INFO:teuthology.lock.ops:Node 'smithi157.front.sepia.ceph.com' reimaging is complete 2022-04-29T13:57:20.957 INFO:teuthology.provision.fog.smithi145:Scheduling deploy of centos 8.stream 2022-04-29T13:57:21.076 INFO:teuthology.provision.fog.smithi157:Scheduling deploy of centos 8.stream 2022-04-29T13:57:21.477 INFO:teuthology.orchestra.console:Power off smithi157 2022-04-29T13:57:21.492 INFO:teuthology.orchestra.console:Power off smithi145 2022-04-29T13:57:29.848 INFO:teuthology.orchestra.console:Power off for smithi157 completed 2022-04-29T13:57:29.857 INFO:teuthology.orchestra.console:Power off for smithi145 completed 2022-04-29T13:57:29.949 INFO:teuthology.orchestra.console:Power on smithi157 2022-04-29T13:57:29.957 INFO:teuthology.orchestra.console:Power on smithi145 2022-04-29T13:57:38.313 INFO:teuthology.orchestra.console:Power on for smithi157 completed 2022-04-29T13:57:38.318 INFO:teuthology.orchestra.console:Power on for smithi145 completed 2022-04-29T13:57:38.414 INFO:teuthology.provision.fog.smithi157:Waiting for deploy to finish 2022-04-29T13:57:38.418 INFO:teuthology.provision.fog.smithi145:Waiting for deploy to finish 2022-04-29T14:02:16.750 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-04-29T14:02:17.053 INFO:teuthology.provision.fog.smithi145:Node is ready 2022-04-29T14:02:17.074 INFO:teuthology.orchestra.run.smithi145.stdout:smithi145.front.sepia.ceph.com 2022-04-29T14:02:17.132 INFO:teuthology.orchestra.run.smithi145.stdout:172.21.15.145 smithi145.front.sepia.ceph.com smithi145 2022-04-29T14:02:17.477 INFO:teuthology.provision.fog.smithi145:Deploy complete! 2022-04-29T14:02:56.001 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-04-29T14:02:56.308 INFO:teuthology.provision.fog.smithi157:Node is ready 2022-04-29T14:02:56.328 INFO:teuthology.orchestra.run.smithi157.stdout:smithi157.front.sepia.ceph.com 2022-04-29T14:02:56.387 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.15.157 smithi157.front.sepia.ceph.com smithi157 2022-04-29T14:02:56.746 INFO:teuthology.provision.fog.smithi157:Deploy complete! 2022-04-29T14:02:56.907 INFO:teuthology.lock.ops:Checking smithi145.front.sepia.ceph.com 2022-04-29T14:02:56.908 INFO:teuthology.lock.ops:New key found. Updating... 2022-04-29T14:02:56.926 INFO:teuthology.lock.ops:Checking smithi157.front.sepia.ceph.com 2022-04-29T14:02:56.926 INFO:teuthology.lock.ops:New key found. Updating... 2022-04-29T14:02:56.945 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: set os type and version on server 2022-04-29T14:02:56.945 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2022-04-29T14:02:57.239 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64 2022-04-29T14:02:57.296 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="CentOS Stream" 2022-04-29T14:02:57.296 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="8" 2022-04-29T14:02:57.296 INFO:teuthology.orchestra.run.smithi145.stdout:ID="centos" 2022-04-29T14:02:57.296 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="rhel fedora" 2022-04-29T14:02:57.296 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="8" 2022-04-29T14:02:57.296 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el8" 2022-04-29T14:02:57.297 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="CentOS Stream 8" 2022-04-29T14:02:57.297 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31" 2022-04-29T14:02:57.297 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-04-29T14:02:57.297 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://centos.org/" 2022-04-29T14:02:57.297 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-04-29T14:02:57.297 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-04-29T14:02:57.297 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-04-29T14:02:57.299 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2022-04-29T14:02:57.317 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: set os type and version on server 2022-04-29T14:02:57.317 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2022-04-29T14:02:57.532 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2022-04-29T14:02:57.589 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="CentOS Stream" 2022-04-29T14:02:57.589 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8" 2022-04-29T14:02:57.589 INFO:teuthology.orchestra.run.smithi157.stdout:ID="centos" 2022-04-29T14:02:57.589 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="rhel fedora" 2022-04-29T14:02:57.589 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8" 2022-04-29T14:02:57.589 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8" 2022-04-29T14:02:57.589 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="CentOS Stream 8" 2022-04-29T14:02:57.590 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2022-04-29T14:02:57.590 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-04-29T14:02:57.590 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://centos.org/" 2022-04-29T14:02:57.590 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-04-29T14:02:57.590 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-04-29T14:02:57.591 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-04-29T14:02:57.591 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2022-04-29T14:02:57.693 INFO:teuthology.dispatcher.supervisor:Running job 6812748 2022-04-29T14:02:57.693 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_004701def07b67dd914d7b1775457fec6788a495/virtualenv/bin/teuthology -v --owner scheduled_amathuri@teuthology --archive /home/teuthworker/archive/amathuri-2022-04-29_07:12:13-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6812748 --name amathuri-2022-04-29_07:12:13-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} -- /home/teuthworker/archive/amathuri-2022-04-29_07:12:13-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6812748/orig.config.yaml 2022-04-29T14:02:57.698 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/amathuri-2022-04-29_07:12:13-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6812748 2022-04-29T14:02:57.699 INFO:teuthology.dispatcher.supervisor:Job PID: 2806 2022-04-29T14:02:57.700 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-04-29T20:33:27.163 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-04-29T20:33:27.378 INFO:teuthology.kill:Killing Pids: {2806} 2022-04-29T20:33:28.770 INFO:teuthology.task.internal:roles: ubuntu@smithi145.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-04-29T20:33:28.770 INFO:teuthology.task.internal:roles: ubuntu@smithi157.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-04-29T20:33:28.770 INFO:teuthology.misc:Compressing logs... 2022-04-29T20:33:28.771 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2022-04-29T20:33:28.978 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2022-04-29T20:33:29.306 INFO:teuthology.misc:Compressing logs... 2022-04-29T20:33:29.712 INFO:teuthology.orchestra.run.smithi145.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-04-29T20:33:30.040 INFO:teuthology.misc:Compressing logs... 2022-04-29T20:33:57.202 INFO:teuthology.kill:No teuthology processes running 2022-04-29T20:33:58.691 INFO:teuthology.kill:Nuking machines: ['smithi145', 'smithi157'] 2022-04-29T20:33:59.978 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_004701def07b67dd914d7b1775457fec6788a495/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-04-29T20:33:59.978 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-04-29T20:33:59.979 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_004701def07b67dd914d7b1775457fec6788a495/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:236: CryptographyDeprecationWarning: Blowfish has been deprecated 2022-04-29T20:33:59.979 INFO:teuthology.kill: "class": algorithms.Blowfish, 2022-04-29T20:33:59.979 INFO:teuthology.kill:2022-04-29 20:33:59,978.978 INFO:teuthology.nuke:targets: 2022-04-29T20:33:59.979 INFO:teuthology.kill: smithi145.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1cjpcReN23W4lbXKihx9EX731Q9O2jsi8dye/ORyo6EBwo1cNBbg4z7+fOMmiVU19oOWcIHQdLzoGjPMhILbwGNvz1kF4eZ8AnOZ6bCfIXXKmVzqn+lcS95HcmimNEWZrd7F7ceadJh63DtGWVxNRt2l7vmsIgTtQx/MH//ZMZE8dTTAze19AnMIjFv7hkBve52Vx9aaPHLgCNT0HVtplNXA5WYCT4U50FMUEd7apzBwx51Y2CqlIhZSDhsPqliaH4NmBjrA7nzmM2KpPxt8L2WIQWMClzY1UZSKOGn9UGI8aJmcSxgcghlGCMto+uE4xKMsRFzhjeCcGpM5p+MuH68/CYRf4Vj2DA6zrQlcupJxyJDUKL+S05G8pWQbUzR/5PwQKXtB/gH3uJU0ny7isgPo00v38pG/bZWx8W8964u9yDlME1vdRD1a9xezr34xUltXh1iPPDYYLCUx6618MKG50Do5XielaLvOSxsiMq6AUq5i3yqrGZpta0yUYKH0= 2022-04-29T20:33:59.979 INFO:teuthology.kill: smithi157.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNvNaGE3HO0yDA7Iolt2xV2QDKBxwXdqWWdPrYdMMhV/+dWLO1PHmUuHQZSfLPVl3jA/CiehIprbM4YRkDJ+yHw3rj4ZNCjrnzyT+cpJ9LlRf2nTZJ/qZIWdNVJH+hnsbyYyTBhiRar2a3+iatDCkbd3O929M0eDrpTm6uaQu/EhPt1743rubXFHBM1rUGShl4TYVVavUgQd6+7Lp1KHWI7xoZjFt73bNcBigY/qW9ds9+mjHRLSxhRhTfpGXzs30kal9lDiateRL8mjK/n/BwXChTkjZgdRzEPne6/4udY7KJhsLtklAedw10J1DqHEwhT2AARaemMQJ3Tu7HAYZOTyed4k6PnA7owPgPt77fVWfo/hPupu5h03GLYhK0JIbpjFNMaBLfPCbUGgx8SZXJKZRogT1Ye3eDVnCVAmmTmTk1e0TBvYk5Pxj6fmqRICe8qlWS53n2fOdXAaiwRzHNiTG8MppL8wyFn7rZUvVM+JQ261Zhj/CHIDp4fkG6st8= 2022-04-29T20:34:00.009 INFO:teuthology.kill:2022-04-29 20:34:00,009.009 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-04-29T20:34:00.014 INFO:teuthology.kill:2022-04-29 20:34:00,014.014 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-04-29T20:34:00.093 INFO:teuthology.kill:2022-04-29 20:34:00,093.093 INFO:teuthology.orchestra.console:Power off smithi145 2022-04-29T20:34:00.112 INFO:teuthology.kill:2022-04-29 20:34:00,111.111 INFO:teuthology.orchestra.console:Power off smithi157 2022-04-29T20:34:08.472 INFO:teuthology.kill:2022-04-29 20:34:08,472.472 INFO:teuthology.orchestra.console:Power off for smithi145 completed 2022-04-29T20:34:08.485 INFO:teuthology.kill:2022-04-29 20:34:08,485.485 INFO:teuthology.orchestra.console:Power off for smithi157 completed 2022-04-29T20:34:08.619 INFO:teuthology.kill:2022-04-29 20:34:08,618.618 INFO:teuthology.lock.ops:unlocked: smithi145.front.sepia.ceph.com 2022-04-29T20:34:08.627 INFO:teuthology.kill:2022-04-29 20:34:08,627.627 INFO:teuthology.lock.ops:unlocked: smithi157.front.sepia.ceph.com 2022-04-29T20:36:09.009 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-04-29T20:36:09.161 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi145 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-04-29_15:44:49-rados-wip-yuri5-testing-2022-04-28-1007-distro-default-smithi/6814088 2022-04-29T20:36:09.161 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi157 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-04-29_15:44:49-rados-wip-yuri5-testing-2022-04-28-1007-distro-default-smithi/6814088