2022-05-17T20:33:16.325 INFO:root:teuthology version: 1.1.1.dev333+gb018fa01 2022-05-17T20:33:16.488 INFO:teuthology.lock.ops:Start node 'smithi136.front.sepia.ceph.com' reimaging 2022-05-17T20:33:16.490 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: reset os type and version on server 2022-05-17T20:33:16.490 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2022-05-17T20:33:16.523 INFO:teuthology.lock.ops:Node 'smithi136.front.sepia.ceph.com' reimaging is complete 2022-05-17T20:33:16.524 INFO:teuthology.lock.ops:Start node 'smithi157.front.sepia.ceph.com' reimaging 2022-05-17T20:33:16.524 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: reset os type and version on server 2022-05-17T20:33:16.525 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2022-05-17T20:33:16.547 INFO:teuthology.lock.ops:Node 'smithi157.front.sepia.ceph.com' reimaging is complete 2022-05-17T20:33:16.751 INFO:teuthology.provision.fog.smithi136:Scheduling deploy of centos 8.stream 2022-05-17T20:33:16.762 INFO:teuthology.provision.fog.smithi157:Scheduling deploy of centos 8.stream 2022-05-17T20:33:17.128 INFO:teuthology.orchestra.console:Power off smithi136 2022-05-17T20:33:17.201 INFO:teuthology.orchestra.console:Power off smithi157 2022-05-17T20:33:25.567 INFO:teuthology.orchestra.console:Power off for smithi157 completed 2022-05-17T20:33:25.669 INFO:teuthology.orchestra.console:Power on smithi157 2022-05-17T20:33:29.622 INFO:teuthology.orchestra.console:Power off for smithi136 completed 2022-05-17T20:33:29.724 INFO:teuthology.orchestra.console:Power on smithi136 2022-05-17T20:33:34.043 INFO:teuthology.orchestra.console:Power on for smithi157 completed 2022-05-17T20:33:34.145 INFO:teuthology.provision.fog.smithi157:Waiting for deploy to finish 2022-05-17T20:33:38.091 INFO:teuthology.orchestra.console:Power on for smithi136 completed 2022-05-17T20:33:38.192 INFO:teuthology.provision.fog.smithi136:Waiting for deploy to finish 2022-05-17T20:38:07.275 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-17T20:38:07.549 INFO:teuthology.provision.fog.smithi136:Node is ready 2022-05-17T20:38:07.567 INFO:teuthology.orchestra.run.smithi136.stdout:smithi136.front.sepia.ceph.com 2022-05-17T20:38:07.626 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.15.136 smithi136.front.sepia.ceph.com smithi136 2022-05-17T20:38:07.986 INFO:teuthology.provision.fog.smithi136:Deploy complete! 2022-05-17T20:39:00.805 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-17T20:39:01.068 INFO:teuthology.provision.fog.smithi157:Node is ready 2022-05-17T20:39:01.086 INFO:teuthology.orchestra.run.smithi157.stdout:smithi157.front.sepia.ceph.com 2022-05-17T20:39:01.144 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.15.157 smithi157.front.sepia.ceph.com smithi157 2022-05-17T20:39:01.490 INFO:teuthology.provision.fog.smithi157:Deploy complete! 2022-05-17T20:39:01.669 INFO:teuthology.lock.ops:Checking smithi136.front.sepia.ceph.com 2022-05-17T20:39:01.670 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-17T20:39:01.698 INFO:teuthology.lock.ops:Checking smithi157.front.sepia.ceph.com 2022-05-17T20:39:01.699 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-17T20:39:01.721 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: set os type and version on server 2022-05-17T20:39:01.722 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2022-05-17T20:39:02.000 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64 2022-05-17T20:39:02.058 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="CentOS Stream" 2022-05-17T20:39:02.059 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="8" 2022-05-17T20:39:02.059 INFO:teuthology.orchestra.run.smithi136.stdout:ID="centos" 2022-05-17T20:39:02.059 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="rhel fedora" 2022-05-17T20:39:02.060 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="8" 2022-05-17T20:39:02.060 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el8" 2022-05-17T20:39:02.060 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-17T20:39:02.060 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31" 2022-05-17T20:39:02.060 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-17T20:39:02.061 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://centos.org/" 2022-05-17T20:39:02.061 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-17T20:39:02.061 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-17T20:39:02.061 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-17T20:39:02.063 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2022-05-17T20:39:02.091 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: set os type and version on server 2022-05-17T20:39:02.092 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2022-05-17T20:39:02.306 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2022-05-17T20:39:02.364 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="CentOS Stream" 2022-05-17T20:39:02.365 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8" 2022-05-17T20:39:02.365 INFO:teuthology.orchestra.run.smithi157.stdout:ID="centos" 2022-05-17T20:39:02.365 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="rhel fedora" 2022-05-17T20:39:02.366 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8" 2022-05-17T20:39:02.366 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8" 2022-05-17T20:39:02.366 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-17T20:39:02.366 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2022-05-17T20:39:02.366 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-17T20:39:02.367 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://centos.org/" 2022-05-17T20:39:02.367 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-17T20:39:02.367 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-17T20:39:02.367 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-17T20:39:02.368 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2022-05-17T20:39:02.478 INFO:teuthology.dispatcher.supervisor:Running job 6837847 2022-05-17T20:39:02.478 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/bin/teuthology -v --owner scheduled_amathuri@teuthology --archive /home/teuthworker/archive/amathuri-2022-05-17_05:46:36-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6837847 --name amathuri-2022-05-17_05:46:36-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} -- /home/teuthworker/archive/amathuri-2022-05-17_05:46:36-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6837847/orig.config.yaml 2022-05-17T20:39:02.483 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/amathuri-2022-05-17_05:46:36-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6837847 2022-05-17T20:39:02.484 INFO:teuthology.dispatcher.supervisor:Job PID: 30727 2022-05-17T20:39:02.485 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-05-18T03:09:31.963 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-18T03:09:32.173 INFO:teuthology.kill:Killing Pids: {30727} 2022-05-18T03:09:33.810 INFO:teuthology.task.internal:roles: ubuntu@smithi136.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-05-18T03:09:33.811 INFO:teuthology.task.internal:roles: ubuntu@smithi157.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-05-18T03:09:33.811 INFO:teuthology.misc:Compressing logs... 2022-05-18T03:09:33.812 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2022-05-18T03:09:34.121 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2022-05-18T03:09:34.590 INFO:teuthology.misc:Compressing logs... 2022-05-18T03:09:34.885 INFO:teuthology.orchestra.run.smithi157.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-05-18T03:09:34.920 INFO:teuthology.orchestra.run.smithi136.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-05-18T03:09:35.137 INFO:teuthology.misc:Compressing logs... 2022-05-18T03:09:46.851 INFO:teuthology.orchestra.run.smithi136.stderr:gzip: /var/log/ceph/ceph-client.admin.105392.log: file size changed while zipping 2022-05-18T03:11:15.756 INFO:teuthology.orchestra.run.smithi136.stderr:gzip: /var/log/ceph/ceph-client.admin.105478.log: file size changed while zipping 2022-05-18T03:12:39.287 INFO:teuthology.orchestra.run.smithi136.stderr:gzip: /var/log/ceph/ceph-client.admin.105226.log: file size changed while zipping 2022-05-18T03:12:39.572 INFO:teuthology.orchestra.run.smithi136.stderr:gzip: /var/log/ceph/ceph-client.admin.105572.log: file size changed while zipping 2022-05-18T03:12:40.005 INFO:teuthology.orchestra.run.smithi136.stderr:gzip: /var/log/ceph/ceph-client.admin.105134.log: file size changed while zipping 2022-05-18T03:14:43.540 INFO:teuthology.kill:No teuthology processes running 2022-05-18T03:14:44.943 INFO:teuthology.kill:Nuking machines: ['smithi136', 'smithi157'] 2022-05-18T03:14:46.159 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-05-18T03:14:46.160 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-05-18T03:14:46.160 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:236: CryptographyDeprecationWarning: Blowfish has been deprecated 2022-05-18T03:14:46.160 INFO:teuthology.kill: "class": algorithms.Blowfish, 2022-05-18T03:14:46.160 INFO:teuthology.kill:2022-05-18 03:14:46,158.158 INFO:teuthology.nuke:targets: 2022-05-18T03:14:46.161 INFO:teuthology.kill: smithi136.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD3jtCCaeC4DmdTVI9b6JtWJu/x8H0zquSh0gzH/N9+4Cz0cWYRK2D1OIo2ogS2uCRrUKFcSSOUzKeZUAXcnBOBdYF0cc/7yRvxyrMfAz4KTIqeADKUekD31sy+ZIrGiTwZ0vmWxkwk3Nb7jZT9HX193/O8Ar/GeDK/7aM256TVL1gIwL+szVfNvJMfEuQ4oMzzlzaXj0TOez00PIl53Ot532NLuY0Qtg+oKyp+/+GVAculu7LwGLwkjsIrpJmbDKQqxvAm9yQ5VUZ7BoRzuG5s1KK1l/hVnYujx4v7jAI9LF0BU2ReMF3bpWk1RSEwgQFHPpUtJyJSAi5RKHOT+gGE8GsnxMy/mSgW8YmmqL68mdMujTOgX8xZMKgIEDtG/BMoccn/e8Ci7JumfPhovMSfmTAFPuAGGe93irkf7rWc5i1blcqlvE6eM4PzSFDy0CZBSeMIaln2dosdndh28KkSXPKGAPS4yK7K7hs31sfCE3/HNxIVwOpRogMLqix7ad0= 2022-05-18T03:14:46.161 INFO:teuthology.kill: smithi157.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPbXBnr640recUdX0kDv5sB3gVOAZQC2flOI3vJHFIHRJY7DMkvd75x3bFiuii+/R2FZQ31tuiFOYiCzfW8f8CNDjjbCvfBa8WlF8Aq2f++18WvmCCUYxMbD1vahqjscMm6XB6wn1mMzgmUPsMuXD4T5X7i85Wrj66UkY/nVQ/rPWnRckCEoWcMIi/vOcftpec31FaMPIKS/W/LYT/l2sqwBX/EFK3uNqS1/aOSyDQy7dNTJvCkMBI2oOdexVwR+4RBAv3s0JQa+Qm/ccjifpSsfONJST4hCAdF4ZyPmq7x2S5/wbZMf0XlcN1//zPwk05DhNxfgyx/pekPYG63oLtjS4RPtNauC/XcNSzYtznaVNui6u5zDn7H3aKAVsSn0joAW++D0yTyXUptbsLu/BGn9J+bFQylEZhoFBix84rmqW6K5Y5vFYeCWP+56Tt5LokjJRCj+IgNGdVxNi2S2HKmETHq4qsNuFIN8fFhZKWzq87g5RSfGnM1IOn7krl7x0= 2022-05-18T03:14:46.188 INFO:teuthology.kill:2022-05-18 03:14:46,188.188 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-18T03:14:46.191 INFO:teuthology.kill:2022-05-18 03:14:46,191.191 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-18T03:14:46.270 INFO:teuthology.kill:2022-05-18 03:14:46,269.269 INFO:teuthology.orchestra.console:Power off smithi136 2022-05-18T03:14:46.284 INFO:teuthology.kill:2022-05-18 03:14:46,284.284 INFO:teuthology.orchestra.console:Power off smithi157 2022-05-18T03:14:54.641 INFO:teuthology.kill:2022-05-18 03:14:54,641.641 INFO:teuthology.orchestra.console:Power off for smithi136 completed 2022-05-18T03:14:54.647 INFO:teuthology.kill:2022-05-18 03:14:54,647.647 INFO:teuthology.orchestra.console:Power off for smithi157 completed 2022-05-18T03:14:54.794 INFO:teuthology.kill:2022-05-18 03:14:54,793.793 INFO:teuthology.lock.ops:unlocked: smithi136.front.sepia.ceph.com 2022-05-18T03:14:54.798 INFO:teuthology.kill:2022-05-18 03:14:54,798.798 INFO:teuthology.lock.ops:unlocked: smithi157.front.sepia.ceph.com 2022-05-18T03:16:55.136 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-05-18T03:16:55.244 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi136 but it was locked by another job: /home/teuthworker/archive/nojha-2022-05-17_22:38:06-rados-wip-lrc-fix-pacific-distro-basic-smithi/6839091 2022-05-18T03:16:55.245 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi157 but it was locked by another job: /home/teuthworker/archive/nojha-2022-05-17_22:38:06-rados-wip-lrc-fix-pacific-distro-basic-smithi/6839091