2022-05-07T05:01:11.770 INFO:root:teuthology version: 1.1.1.dev331+gfd5c3166 2022-05-07T05:01:11.897 INFO:teuthology.lock.ops:Start node 'smithi062.front.sepia.ceph.com' reimaging 2022-05-07T05:01:11.898 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: reset os type and version on server 2022-05-07T05:01:11.899 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2022-05-07T05:01:11.918 INFO:teuthology.lock.ops:Node 'smithi062.front.sepia.ceph.com' reimaging is complete 2022-05-07T05:01:11.919 INFO:teuthology.lock.ops:Start node 'smithi116.front.sepia.ceph.com' reimaging 2022-05-07T05:01:11.919 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: reset os type and version on server 2022-05-07T05:01:11.919 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2022-05-07T05:01:11.940 INFO:teuthology.lock.ops:Node 'smithi116.front.sepia.ceph.com' reimaging is complete 2022-05-07T05:01:12.120 INFO:teuthology.provision.fog.smithi062:Scheduling deploy of centos 8.stream 2022-05-07T05:01:12.140 INFO:teuthology.provision.fog.smithi116:Scheduling deploy of centos 8.stream 2022-05-07T05:01:12.487 INFO:teuthology.orchestra.console:Power off smithi062 2022-05-07T05:01:12.521 INFO:teuthology.orchestra.console:Power off smithi116 2022-05-07T05:01:20.886 INFO:teuthology.orchestra.console:Power off for smithi116 completed 2022-05-07T05:01:20.988 INFO:teuthology.orchestra.console:Power on smithi116 2022-05-07T05:01:24.966 INFO:teuthology.orchestra.console:Power off for smithi062 completed 2022-05-07T05:01:25.069 INFO:teuthology.orchestra.console:Power on smithi062 2022-05-07T05:01:25.240 INFO:teuthology.orchestra.console:Power on for smithi116 completed 2022-05-07T05:01:25.341 INFO:teuthology.provision.fog.smithi116:Waiting for deploy to finish 2022-05-07T05:01:33.433 INFO:teuthology.orchestra.console:Power on for smithi062 completed 2022-05-07T05:01:33.534 INFO:teuthology.provision.fog.smithi062:Waiting for deploy to finish 2022-05-07T05:05:29.382 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-07T05:05:46.734 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-07T05:05:55.022 INFO:teuthology.provision.fog.smithi116:Node is ready 2022-05-07T05:05:55.041 INFO:teuthology.orchestra.run.smithi116.stdout:smithi116.front.sepia.ceph.com 2022-05-07T05:05:55.098 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.15.116 smithi116.front.sepia.ceph.com smithi116 2022-05-07T05:05:55.466 INFO:teuthology.provision.fog.smithi116:Deploy complete! 2022-05-07T05:06:11.727 INFO:teuthology.provision.fog.smithi062:Node is ready 2022-05-07T05:06:11.746 INFO:teuthology.orchestra.run.smithi062.stdout:smithi062.front.sepia.ceph.com 2022-05-07T05:06:11.803 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62 smithi062.front.sepia.ceph.com smithi062 2022-05-07T05:06:12.196 INFO:teuthology.provision.fog.smithi062:Deploy complete! 2022-05-07T05:06:12.359 INFO:teuthology.lock.ops:Checking smithi062.front.sepia.ceph.com 2022-05-07T05:06:12.361 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-07T05:06:12.380 INFO:teuthology.lock.ops:Checking smithi116.front.sepia.ceph.com 2022-05-07T05:06:12.380 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-07T05:06:12.399 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: set os type and version on server 2022-05-07T05:06:12.401 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2022-05-07T05:06:12.604 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2022-05-07T05:06:12.660 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream" 2022-05-07T05:06:12.661 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="8" 2022-05-07T05:06:12.661 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos" 2022-05-07T05:06:12.661 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora" 2022-05-07T05:06:12.661 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="8" 2022-05-07T05:06:12.662 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el8" 2022-05-07T05:06:12.662 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-07T05:06:12.662 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2022-05-07T05:06:12.662 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-07T05:06:12.663 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/" 2022-05-07T05:06:12.663 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-07T05:06:12.663 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-07T05:06:12.663 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-07T05:06:12.665 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2022-05-07T05:06:12.684 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: set os type and version on server 2022-05-07T05:06:12.684 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2022-05-07T05:06:12.953 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64 2022-05-07T05:06:13.011 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="CentOS Stream" 2022-05-07T05:06:13.011 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="8" 2022-05-07T05:06:13.011 INFO:teuthology.orchestra.run.smithi116.stdout:ID="centos" 2022-05-07T05:06:13.011 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="rhel fedora" 2022-05-07T05:06:13.012 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="8" 2022-05-07T05:06:13.012 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el8" 2022-05-07T05:06:13.012 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-07T05:06:13.012 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2022-05-07T05:06:13.012 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-07T05:06:13.013 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://centos.org/" 2022-05-07T05:06:13.013 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-07T05:06:13.013 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-07T05:06:13.013 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-07T05:06:13.014 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2022-05-07T05:06:13.101 INFO:teuthology.dispatcher.supervisor:Running job 6824883 2022-05-07T05:06:13.101 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/bin/teuthology -v --owner scheduled_amathuri@teuthology --archive /home/teuthworker/archive/amathuri-2022-05-06_08:37:20-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6824883 --name amathuri-2022-05-06_08:37:20-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} -- /home/teuthworker/archive/amathuri-2022-05-06_08:37:20-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6824883/orig.config.yaml 2022-05-07T05:06:13.105 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/amathuri-2022-05-06_08:37:20-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6824883 2022-05-07T05:06:13.106 INFO:teuthology.dispatcher.supervisor:Job PID: 7648 2022-05-07T05:06:13.106 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-05-07T11:36:42.804 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-07T11:36:42.987 INFO:teuthology.kill:Killing Pids: {7648} 2022-05-07T11:36:44.407 INFO:teuthology.task.internal:roles: ubuntu@smithi062.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-05-07T11:36:44.408 INFO:teuthology.task.internal:roles: ubuntu@smithi116.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-05-07T11:36:44.408 INFO:teuthology.misc:Compressing logs... 2022-05-07T11:36:44.409 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2022-05-07T11:36:44.614 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2022-05-07T11:36:44.937 INFO:teuthology.misc:Compressing logs... 2022-05-07T11:36:45.350 INFO:teuthology.orchestra.run.smithi116.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-05-07T11:36:45.351 INFO:teuthology.orchestra.run.smithi062.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-05-07T11:36:45.622 INFO:teuthology.misc:Compressing logs... 2022-05-07T11:37:16.014 INFO:teuthology.orchestra.run.smithi062.stderr:gzip: /var/log/ceph/ceph-client.admin.52502.log: file size changed while zipping 2022-05-07T11:37:27.693 INFO:teuthology.kill:No teuthology processes running 2022-05-07T11:37:29.055 INFO:teuthology.kill:Nuking machines: ['smithi062', 'smithi116'] 2022-05-07T11:37:30.238 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-05-07T11:37:30.239 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-05-07T11:37:30.240 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:236: CryptographyDeprecationWarning: Blowfish has been deprecated 2022-05-07T11:37:30.240 INFO:teuthology.kill: "class": algorithms.Blowfish, 2022-05-07T11:37:30.240 INFO:teuthology.kill:2022-05-07 11:37:30,238.238 INFO:teuthology.nuke:targets: 2022-05-07T11:37:30.240 INFO:teuthology.kill: smithi062.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC31QqMijZg4KuAqj1g2mZ+htp33Ihq3TpPMOS9ew+Tn7o8lwtin/WN7hI57/tzbEfj2tC9+Xht0j/QTAQasgYKrxEqOcxfAxUJQgq6CEPs28cFZgd6pmZuLX3dVKnPMpZ3OIIhZ5ujxxab8JbDWQF299rxyFk6QnLKIKMz7XyWmqb7TgSGsCyKADGda9KH7ehekolFPEu1rBFYYiVvKV3t/s3ekds7X8EU5ODxJzicLNdQmSrK5wTEcEkbHj804QQ/73GhcJwT5JFxUR7xi43nEzoBXxom7G2Jylus823stXdYH1/h9Y6/eAlM3ef4EFXIBm7XqsbU5nODmw3mw0lX81hOGj+5EwoSr6ioq/UB4PbmhQYBnHADheboX0VQoU/H9gd46fS7NwYybChRD9a7LklyhhCeO73xFOE/FVVb2jxePXHhi7TTF/QWXENY9x9EhnQ5+SibspMNOyVosiW2gfPYKd9ZHc5cS7qQFw8QVqw6uvQvFK1m49yQqlBohCM= 2022-05-07T11:37:30.241 INFO:teuthology.kill: smithi116.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3zfo+uYu1q9qMSW9ASj0nvYfd508tyhBmMJ2nZGCb44YPdHp5GbUbqrF5oizesA/5N2VycMAReIbepMIgOIgohfVlp/g/NJPtmGHK+eHJpLyFu8QOC/YRd65ylnvPMDLNjXuotIi7VzoMYRSBZI1gpaeU08xsSoBjD+xzYGt9seYpoDZ7HA8b2KjL1opMm2TZqbcAI/dB7rIdmubtyAThip9Xc0NyI2I1w13IHDKT2c0JLjGdkyVoMKsYYEApdf17AcJvJKBdH2YZuzd+AQqn3IfD+8+rJ7P8p9yHiqtDuh94PEAXAstHpJVxcQc6Ns3imectuDR3oxNfMLmNP5IupP3lLZpLqpGAbnxmYuOURVVKTE1aPZ8j5kYbk9KgyTF5UO0+C49HRNGP6GJhF5gL/jyBSmiWzeF9pe9sLe6FVx2aYsk/jM/83zMxqhda7p/VQ23zZO4mQ6uwYrGb6y+QcXTXDgyXEWcBrxJgdHpI2nzh1gGjB9WM4b1EWdBaVhs= 2022-05-07T11:37:30.266 INFO:teuthology.kill:2022-05-07 11:37:30,266.266 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-07T11:37:30.269 INFO:teuthology.kill:2022-05-07 11:37:30,269.269 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-07T11:37:30.344 INFO:teuthology.kill:2022-05-07 11:37:30,344.344 INFO:teuthology.orchestra.console:Power off smithi116 2022-05-07T11:37:30.357 INFO:teuthology.kill:2022-05-07 11:37:30,357.357 INFO:teuthology.orchestra.console:Power off smithi062 2022-05-07T11:37:42.823 INFO:teuthology.kill:2022-05-07 11:37:42,823.823 INFO:teuthology.orchestra.console:Power off for smithi116 completed 2022-05-07T11:37:42.828 INFO:teuthology.kill:2022-05-07 11:37:42,828.828 INFO:teuthology.orchestra.console:Power off for smithi062 completed 2022-05-07T11:37:42.972 INFO:teuthology.kill:2022-05-07 11:37:42,971.971 INFO:teuthology.lock.ops:unlocked: smithi116.front.sepia.ceph.com 2022-05-07T11:37:42.977 INFO:teuthology.kill:2022-05-07 11:37:42,977.977 INFO:teuthology.lock.ops:unlocked: smithi062.front.sepia.ceph.com 2022-05-07T11:39:43.229 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-05-07T11:39:43.331 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi062 but it was locked by another job: /home/teuthworker/archive/lflores-2022-05-04_18:59:38-rados-wip-55077-octopus-distro-default-smithi/6821066 2022-05-07T11:39:43.331 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi116 but it was locked by another job: /home/teuthworker/archive/lflores-2022-05-04_18:59:38-rados-wip-55077-octopus-distro-default-smithi/6821067