2022-05-05T17:53:26.349 INFO:root:teuthology version: 1.1.1.dev331+gfd5c3166 2022-05-05T17:53:26.469 INFO:teuthology.lock.ops:Start node 'smithi074.front.sepia.ceph.com' reimaging 2022-05-05T17:53:26.470 INFO:teuthology.lock.ops:Updating [smithi074.front.sepia.ceph.com]: reset os type and version on server 2022-05-05T17:53:26.471 INFO:teuthology.lock.ops:Updating smithi074.front.sepia.ceph.com on lock server 2022-05-05T17:53:26.489 INFO:teuthology.lock.ops:Node 'smithi074.front.sepia.ceph.com' reimaging is complete 2022-05-05T17:53:26.489 INFO:teuthology.lock.ops:Start node 'smithi187.front.sepia.ceph.com' reimaging 2022-05-05T17:53:26.490 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: reset os type and version on server 2022-05-05T17:53:26.490 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2022-05-05T17:53:26.508 INFO:teuthology.lock.ops:Node 'smithi187.front.sepia.ceph.com' reimaging is complete 2022-05-05T17:53:26.712 INFO:teuthology.provision.fog.smithi074:Scheduling deploy of centos 8.stream 2022-05-05T17:53:26.716 INFO:teuthology.provision.fog.smithi187:Scheduling deploy of centos 8.stream 2022-05-05T17:53:27.024 INFO:teuthology.orchestra.console:Power off smithi187 2022-05-05T17:53:27.035 INFO:teuthology.orchestra.console:Power off smithi074 2022-05-05T17:53:35.391 INFO:teuthology.orchestra.console:Power off for smithi074 completed 2022-05-05T17:53:35.492 INFO:teuthology.orchestra.console:Power on smithi074 2022-05-05T17:53:39.498 INFO:teuthology.orchestra.console:Power off for smithi187 completed 2022-05-05T17:53:39.600 INFO:teuthology.orchestra.console:Power on smithi187 2022-05-05T17:53:43.855 INFO:teuthology.orchestra.console:Power on for smithi074 completed 2022-05-05T17:53:43.956 INFO:teuthology.provision.fog.smithi074:Waiting for deploy to finish 2022-05-05T17:53:47.961 INFO:teuthology.orchestra.console:Power on for smithi187 completed 2022-05-05T17:53:48.062 INFO:teuthology.provision.fog.smithi187:Waiting for deploy to finish 2022-05-05T17:56:19.061 ERROR:teuthology.orchestra.connection:Error authenticating with smithi187.front.sepia.ceph.com: Authentication failed. 2022-05-05T17:58:21.843 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-05T17:58:22.116 INFO:teuthology.provision.fog.smithi074:Node is ready 2022-05-05T17:58:22.134 INFO:teuthology.orchestra.run.smithi074.stdout:smithi074.front.sepia.ceph.com 2022-05-05T17:58:22.193 INFO:teuthology.orchestra.run.smithi074.stdout:172.21.15.74 smithi074.front.sepia.ceph.com smithi074 2022-05-05T17:58:22.554 INFO:teuthology.provision.fog.smithi074:Deploy complete! 2022-05-05T17:58:27.967 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-05T17:58:28.229 INFO:teuthology.provision.fog.smithi187:Node is ready 2022-05-05T17:58:28.288 INFO:teuthology.orchestra.run.smithi187.stdout:smithi187.front.sepia.ceph.com 2022-05-05T17:58:28.347 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.15.187 smithi187.front.sepia.ceph.com smithi187 2022-05-05T17:58:28.698 INFO:teuthology.provision.fog.smithi187:Deploy complete! 2022-05-05T17:58:28.861 INFO:teuthology.lock.ops:Checking smithi074.front.sepia.ceph.com 2022-05-05T17:58:28.862 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-05T17:58:28.889 INFO:teuthology.lock.ops:Checking smithi187.front.sepia.ceph.com 2022-05-05T17:58:28.889 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-05T17:58:28.907 INFO:teuthology.lock.ops:Updating [smithi074.front.sepia.ceph.com]: set os type and version on server 2022-05-05T17:58:28.907 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi074.front.sepia.ceph.com' 2022-05-05T17:58:29.110 INFO:teuthology.orchestra.run.smithi074.stdout:x86_64 2022-05-05T17:58:29.168 INFO:teuthology.orchestra.run.smithi074.stdout:NAME="CentOS Stream" 2022-05-05T17:58:29.168 INFO:teuthology.orchestra.run.smithi074.stdout:VERSION="8" 2022-05-05T17:58:29.168 INFO:teuthology.orchestra.run.smithi074.stdout:ID="centos" 2022-05-05T17:58:29.168 INFO:teuthology.orchestra.run.smithi074.stdout:ID_LIKE="rhel fedora" 2022-05-05T17:58:29.169 INFO:teuthology.orchestra.run.smithi074.stdout:VERSION_ID="8" 2022-05-05T17:58:29.169 INFO:teuthology.orchestra.run.smithi074.stdout:PLATFORM_ID="platform:el8" 2022-05-05T17:58:29.169 INFO:teuthology.orchestra.run.smithi074.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-05T17:58:29.169 INFO:teuthology.orchestra.run.smithi074.stdout:ANSI_COLOR="0;31" 2022-05-05T17:58:29.170 INFO:teuthology.orchestra.run.smithi074.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-05T17:58:29.170 INFO:teuthology.orchestra.run.smithi074.stdout:HOME_URL="https://centos.org/" 2022-05-05T17:58:29.170 INFO:teuthology.orchestra.run.smithi074.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-05T17:58:29.170 INFO:teuthology.orchestra.run.smithi074.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-05T17:58:29.170 INFO:teuthology.orchestra.run.smithi074.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-05T17:58:29.171 INFO:teuthology.lock.ops:Updating smithi074.front.sepia.ceph.com on lock server 2022-05-05T17:58:29.189 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: set os type and version on server 2022-05-05T17:58:29.189 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2022-05-05T17:58:29.390 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64 2022-05-05T17:58:29.447 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Stream" 2022-05-05T17:58:29.448 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="8" 2022-05-05T17:58:29.448 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos" 2022-05-05T17:58:29.448 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora" 2022-05-05T17:58:29.448 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="8" 2022-05-05T17:58:29.448 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el8" 2022-05-05T17:58:29.449 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-05T17:58:29.449 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2022-05-05T17:58:29.449 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-05T17:58:29.449 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://centos.org/" 2022-05-05T17:58:29.449 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-05T17:58:29.450 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-05T17:58:29.450 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-05T17:58:29.451 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2022-05-05T17:58:29.539 INFO:teuthology.dispatcher.supervisor:Running job 6822733 2022-05-05T17:58:29.540 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/bin/teuthology -v --owner scheduled_amathuri@teuthology --archive /home/teuthworker/archive/amathuri-2022-05-05_05:14:18-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6822733 --name amathuri-2022-05-05_05:14:18-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} -- /home/teuthworker/archive/amathuri-2022-05-05_05:14:18-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6822733/orig.config.yaml 2022-05-05T17:58:29.544 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/amathuri-2022-05-05_05:14:18-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6822733 2022-05-05T17:58:29.545 INFO:teuthology.dispatcher.supervisor:Job PID: 5270 2022-05-05T17:58:29.545 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-05-06T00:28:40.011 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-06T00:28:40.176 INFO:teuthology.kill:Killing Pids: {5270} 2022-05-06T00:28:41.640 INFO:teuthology.task.internal:roles: ubuntu@smithi074.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-05-06T00:28:41.641 INFO:teuthology.task.internal:roles: ubuntu@smithi187.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-05-06T00:28:41.641 INFO:teuthology.misc:Compressing logs... 2022-05-06T00:28:41.642 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi074.front.sepia.ceph.com' 2022-05-06T00:28:41.846 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2022-05-06T00:28:42.169 INFO:teuthology.misc:Compressing logs... 2022-05-06T00:28:42.682 INFO:teuthology.orchestra.run.smithi187.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-05-06T00:28:42.689 INFO:teuthology.orchestra.run.smithi074.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-05-06T00:28:43.024 INFO:teuthology.misc:Compressing logs... 2022-05-06T00:28:56.777 INFO:teuthology.orchestra.run.smithi074.stderr:gzip: /var/log/ceph/ceph-client.admin.51680.log: file size changed while zipping 2022-05-06T00:29:40.488 INFO:teuthology.kill:No teuthology processes running 2022-05-06T00:29:41.844 INFO:teuthology.kill:Nuking machines: ['smithi074', 'smithi187'] 2022-05-06T00:29:43.011 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-05-06T00:29:43.012 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-05-06T00:29:43.012 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:236: CryptographyDeprecationWarning: Blowfish has been deprecated 2022-05-06T00:29:43.012 INFO:teuthology.kill: "class": algorithms.Blowfish, 2022-05-06T00:29:43.013 INFO:teuthology.kill:2022-05-06 00:29:43,010.010 INFO:teuthology.nuke:targets: 2022-05-06T00:29:43.013 INFO:teuthology.kill: smithi074.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxyXM6mwxXfZLHeNPfnk8lqddKjijYlNF7XpaGlltbP7/rrBzak+f5NISFX+dgxT+AkAQN+HWJy3bKxU+Ci7fsmqH7s3p4c/23piSdS3gg4rOFdZu8LUPgeXRTlkNcOk1NjRM0FhM9Z7fN+U4CezyPC6qGOQs6yyX0bp06MI4gL2vlzReH/SvkS+HxTQoqqP7ef11LhneX573s6Vh7g+ijFxD0oh1h+xlD+VTWqENpMZ1bBOJGd2JDFoI/IGywpSLigu/iSbNdJ5O+vVMeyYQXpfy5v4sNP1Rm0mkaN8H+ePsif6dEjoTzWafek7mwFqP+kZiDoU3AOpPMmMz7Ct69Yv0vzNQdgPFALUeFOs9RHoJ/txFAmvno5Owqw9MATNAvJ2evNU8eOvApdWT2eI1iTAjYX3jWXdR9kNjh18GWZEUH0K3jg78SzKTDHiFy1+gxQL9GRlB/IA+MKiGdKnyYIObh3bpCLhnq4QKcHLTjwf1iics5Z+rpNScW/jKBneM= 2022-05-06T00:29:43.013 INFO:teuthology.kill: smithi187.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDckwfW+QoEJ0xH7H1S45ngHTiTqtXgYI5kwcxwNCgZHjdgWexPKceHvWdBAKRQY4YUKprtGs/3x4E6RjFEaDsVMyEi7gE2W1W25kTYxohA037be4dFHG4QGEdxjqcCciTZ/TnbUGqNxP+rosO4JEQ7kpM7DfDD/a9+DB4TWcVPflmL97RFLzbHQUo+N6KgzdYSYg5aIf5WpDDF2u9zMSgWlWg/42Xv1wvZ6uSxwYRuNK92n2nsaSqf7YTbxk7W7x5axI2/vKm1wzZdAuA3imrxjkQAx0D0YyHfdKR1Ij1DaJ06K37NxS1VSzPBVPGl7NEz/Oz6uajZhs82vWO+Q+rUYQGSyLSQKDB5X9eNsjiojzfcez/9NodTgdDwC1wBe+BL3i+L/px487O4z10XNk41qFlCb4JPj/Ogs8e+9jPM0l0c1S9vYKhIxMMA1AXtXjQtEtABJ+MegchwnQKhF/AuDRb66a+EnFTpCgJ3rsGdnicwPsJSSUMDP3S6wekgOgc= 2022-05-06T00:29:43.039 INFO:teuthology.kill:2022-05-06 00:29:43,039.039 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-06T00:29:43.043 INFO:teuthology.kill:2022-05-06 00:29:43,042.042 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-06T00:29:43.114 INFO:teuthology.kill:2022-05-06 00:29:43,114.114 INFO:teuthology.orchestra.console:Power off smithi074 2022-05-06T00:29:43.126 INFO:teuthology.kill:2022-05-06 00:29:43,126.126 INFO:teuthology.orchestra.console:Power off smithi187 2022-05-06T00:29:51.481 INFO:teuthology.kill:2022-05-06 00:29:51,481.481 INFO:teuthology.orchestra.console:Power off for smithi074 completed 2022-05-06T00:29:51.626 INFO:teuthology.kill:2022-05-06 00:29:51,626.626 INFO:teuthology.lock.ops:unlocked: smithi074.front.sepia.ceph.com 2022-05-06T00:29:55.594 INFO:teuthology.kill:2022-05-06 00:29:55,593.593 INFO:teuthology.orchestra.console:Power off for smithi187 completed 2022-05-06T00:29:55.735 INFO:teuthology.kill:2022-05-06 00:29:55,735.735 INFO:teuthology.lock.ops:unlocked: smithi187.front.sepia.ceph.com 2022-05-06T00:31:55.936 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-05-06T00:31:56.040 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi074 but it was locked by another job: /home/teuthworker/archive/amathuri-2022-05-05_05:14:18-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6822838 2022-05-06T00:31:56.041 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi187 but it was locked by another job: /home/teuthworker/archive/amathuri-2022-05-05_05:14:18-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6822838