2022-05-18T11:51:20.386 INFO:root:teuthology version: 1.1.1.dev333+gb018fa01 2022-05-18T11:51:20.639 INFO:teuthology.lock.ops:Start node 'smithi073.front.sepia.ceph.com' reimaging 2022-05-18T11:51:20.640 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: reset os type and version on server 2022-05-18T11:51:20.640 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2022-05-18T11:51:20.670 INFO:teuthology.lock.ops:Node 'smithi073.front.sepia.ceph.com' reimaging is complete 2022-05-18T11:51:20.671 INFO:teuthology.lock.ops:Start node 'smithi116.front.sepia.ceph.com' reimaging 2022-05-18T11:51:20.671 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: reset os type and version on server 2022-05-18T11:51:20.672 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2022-05-18T11:51:20.706 INFO:teuthology.lock.ops:Node 'smithi116.front.sepia.ceph.com' reimaging is complete 2022-05-18T11:51:20.914 INFO:teuthology.provision.fog.smithi073:Scheduling deploy of centos 8.stream 2022-05-18T11:51:20.928 INFO:teuthology.provision.fog.smithi116:Scheduling deploy of centos 8.stream 2022-05-18T11:51:21.309 INFO:teuthology.orchestra.console:Power off smithi073 2022-05-18T11:51:21.361 INFO:teuthology.orchestra.console:Power off smithi116 2022-05-18T11:51:29.749 INFO:teuthology.orchestra.console:Power off for smithi116 completed 2022-05-18T11:51:29.851 INFO:teuthology.orchestra.console:Power on smithi116 2022-05-18T11:51:33.813 INFO:teuthology.orchestra.console:Power off for smithi073 completed 2022-05-18T11:51:33.928 INFO:teuthology.orchestra.console:Power on smithi073 2022-05-18T11:51:38.211 INFO:teuthology.orchestra.console:Power on for smithi073 completed 2022-05-18T11:51:38.249 INFO:teuthology.orchestra.console:Power on for smithi116 completed 2022-05-18T11:51:38.313 INFO:teuthology.provision.fog.smithi073:Waiting for deploy to finish 2022-05-18T11:51:38.351 INFO:teuthology.provision.fog.smithi116:Waiting for deploy to finish 2022-05-18T11:55:42.418 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-18T11:56:07.722 INFO:teuthology.provision.fog.smithi073:Node is ready 2022-05-18T11:56:07.745 INFO:teuthology.orchestra.run.smithi073.stdout:smithi073 2022-05-18T11:56:07.805 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73 smithi073.front.sepia.ceph.com smithi073 2022-05-18T11:56:08.205 INFO:teuthology.provision.fog.smithi073:Deploy complete! 2022-05-18T11:56:16.964 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-18T11:56:17.233 INFO:teuthology.provision.fog.smithi116:Node is ready 2022-05-18T11:56:17.274 INFO:teuthology.orchestra.run.smithi116.stdout:smithi116.front.sepia.ceph.com 2022-05-18T11:56:17.339 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.15.116 smithi116.front.sepia.ceph.com smithi116 2022-05-18T11:56:17.684 INFO:teuthology.provision.fog.smithi116:Deploy complete! 2022-05-18T11:56:17.935 INFO:teuthology.lock.ops:Checking smithi073.front.sepia.ceph.com 2022-05-18T11:56:17.936 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-18T11:56:17.958 INFO:teuthology.lock.ops:Checking smithi116.front.sepia.ceph.com 2022-05-18T11:56:17.958 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-18T11:56:17.977 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: set os type and version on server 2022-05-18T11:56:17.978 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2022-05-18T11:56:18.209 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2022-05-18T11:56:18.268 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream" 2022-05-18T11:56:18.268 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="8" 2022-05-18T11:56:18.268 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos" 2022-05-18T11:56:18.269 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora" 2022-05-18T11:56:18.269 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="8" 2022-05-18T11:56:18.271 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el8" 2022-05-18T11:56:18.271 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-18T11:56:18.272 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2022-05-18T11:56:18.272 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-18T11:56:18.272 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/" 2022-05-18T11:56:18.273 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-18T11:56:18.273 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-18T11:56:18.273 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-18T11:56:18.275 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2022-05-18T11:56:18.295 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: set os type and version on server 2022-05-18T11:56:18.295 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2022-05-18T11:56:18.455 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64 2022-05-18T11:56:18.511 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="CentOS Stream" 2022-05-18T11:56:18.512 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="8" 2022-05-18T11:56:18.512 INFO:teuthology.orchestra.run.smithi116.stdout:ID="centos" 2022-05-18T11:56:18.512 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="rhel fedora" 2022-05-18T11:56:18.512 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="8" 2022-05-18T11:56:18.512 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el8" 2022-05-18T11:56:18.513 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-18T11:56:18.513 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2022-05-18T11:56:18.514 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-18T11:56:18.514 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://centos.org/" 2022-05-18T11:56:18.515 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-18T11:56:18.515 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-18T11:56:18.515 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-18T11:56:18.516 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2022-05-18T11:56:18.617 INFO:teuthology.dispatcher.supervisor:Running job 6837890 2022-05-18T11:56:18.618 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/bin/teuthology -v --owner scheduled_amathuri@teuthology --archive /home/teuthworker/archive/amathuri-2022-05-17_05:46:36-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6837890 --name amathuri-2022-05-17_05:46:36-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} -- /home/teuthworker/archive/amathuri-2022-05-17_05:46:36-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6837890/orig.config.yaml 2022-05-18T11:56:18.623 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/amathuri-2022-05-17_05:46:36-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6837890 2022-05-18T11:56:18.623 INFO:teuthology.dispatcher.supervisor:Job PID: 32234 2022-05-18T11:56:18.624 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-05-18T18:26:49.238 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-18T18:26:49.477 INFO:teuthology.kill:Killing Pids: {32234} 2022-05-18T18:26:51.039 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-05-18T18:26:51.040 INFO:teuthology.task.internal:roles: ubuntu@smithi116.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-05-18T18:26:51.040 INFO:teuthology.misc:Compressing logs... 2022-05-18T18:26:51.041 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2022-05-18T18:26:51.285 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2022-05-18T18:26:51.796 INFO:teuthology.misc:Compressing logs... 2022-05-18T18:26:52.239 INFO:teuthology.orchestra.run.smithi073.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-05-18T18:26:52.519 INFO:teuthology.misc:Compressing logs... 2022-05-18T18:26:53.492 INFO:teuthology.orchestra.run.smithi073.stderr:gzip: /var/log/ceph/ceph-client.admin.105753.log: file size changed while zipping 2022-05-18T18:26:56.266 INFO:teuthology.orchestra.run.smithi116.stderr:gzip: /var/log/ceph/ceph-osd.5.log: file size changed while zipping 2022-05-18T18:27:03.150 INFO:teuthology.orchestra.run.smithi073.stderr:gzip: /var/log/ceph/ceph-client.admin.105896.log: file size changed while zipping 2022-05-18T18:27:03.242 INFO:teuthology.orchestra.run.smithi073.stderr:gzip: /var/log/ceph/ceph-client.admin.105980.log: file size changed while zipping 2022-05-18T18:27:03.789 INFO:teuthology.orchestra.run.smithi073.stderr:gzip: /var/log/ceph/ceph-client.admin.105646.log: file size changed while zipping 2022-05-18T18:27:11.434 INFO:teuthology.kill:No teuthology processes running 2022-05-18T18:27:13.182 INFO:teuthology.kill:Nuking machines: ['smithi073', 'smithi116'] 2022-05-18T18:27:14.691 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-05-18T18:27:14.692 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-05-18T18:27:14.693 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:236: CryptographyDeprecationWarning: Blowfish has been deprecated 2022-05-18T18:27:14.693 INFO:teuthology.kill: "class": algorithms.Blowfish, 2022-05-18T18:27:14.693 INFO:teuthology.kill:2022-05-18 18:27:14,691.691 INFO:teuthology.nuke:targets: 2022-05-18T18:27:14.694 INFO:teuthology.kill: smithi073.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDY7KnfF3MOcF3z+JJZqcriHvrIs4ByPB0VPgjY0lvsffn+PVi3aI/RTaS8EpcvkTUwHLh4fvkW+9zBZaLWcchLK5CCaN84aINH4muPXso/TyKcvSBhHJblKHhELUbqLmCSMhbbcf7DBpGx4WRBYN+MlAmqRYjJJL3PPNekR11osxlRHVBlF/4k1zHLrAu9PEOYkLf2NsjfRBZndkAEADRo/x+Cxwtwdxg0Tceyabqx3MavCEfHa3hRvZJ03PJRXUHmE2siflJDh0E8jwrrYtyDKNS/SX4Fe7jyTAL1KbqteO3oV2m/cosUvx64s/SM5TYGb8Ty9r1EQQ67q9ft2p374C97pqzTy4NHg8cuMnBOcklfKxP1Mgq2S6J+lOsIGYnLWzkEzevFYHhCuAETfDfm8ORExhahJDaXiWpQ+Zk7IR46dOt7/8OqVrWLDap70zmevm3098NrMUCR4eB6xFcTvoViinm8O09Q3cTzvHSQWSkrt5I7TDcaPigkur/QAOs= 2022-05-18T18:27:14.694 INFO:teuthology.kill: smithi116.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCjjI3kfrA54qj3oqSTQTA5ZvBAVS/3fc1K0PTmqRbteQasGG6Z7T1f3grtcHYd54L1XqeZa7jpoLSp24GApQrcYXAaWmWXI2rXIEvDWWx9K2/Btnpb+QofWzA84D+TgpaBDwVndct4lJhozqPebUEKt07M/sDFN3uo4gi3sDk+9qEIYZXYsLBldFGUEly5VdT/t7tNlkzVFJ0juu6AoodEDlropOtYvXThaVn9oPIQpVWkV1wHeOOhsqy8TzidTmp7+74oiMciDrISjASRHP7d+zMbPwFRmKXBROvEDfO8DRDyqpztZ1AEVjrjqGJHEkot7W4DxNWVRVTeDDQReh7G1qKEo8pkAJBeqaYb8cZQq/nJjxi1edyV8du8Il0FbqleWnC6d1mw/6Ega8KvG3+zD8eOhUu+0U+nr66TCSUEB88FdHglihL+YdToeFYvYQPU5zsFulcpb3gMx6J5lGpaB6BdtfOQQ4xBA07hw5fx1VdXa6aTjlViybjsn6AYj4s= 2022-05-18T18:27:14.728 INFO:teuthology.kill:2022-05-18 18:27:14,727.727 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-18T18:27:14.732 INFO:teuthology.kill:2022-05-18 18:27:14,732.732 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-18T18:27:14.815 INFO:teuthology.kill:2022-05-18 18:27:14,815.815 INFO:teuthology.orchestra.console:Power off smithi073 2022-05-18T18:27:14.837 INFO:teuthology.kill:2022-05-18 18:27:14,836.836 INFO:teuthology.orchestra.console:Power off smithi116 2022-05-18T18:27:23.211 INFO:teuthology.kill:2022-05-18 18:27:23,205.205 INFO:teuthology.orchestra.console:Power off for smithi073 completed 2022-05-18T18:27:23.217 INFO:teuthology.kill:2022-05-18 18:27:23,216.216 INFO:teuthology.orchestra.console:Power off for smithi116 completed 2022-05-18T18:27:23.377 INFO:teuthology.kill:2022-05-18 18:27:23,376.376 INFO:teuthology.lock.ops:unlocked: smithi073.front.sepia.ceph.com 2022-05-18T18:27:23.381 INFO:teuthology.kill:2022-05-18 18:27:23,381.381 INFO:teuthology.lock.ops:unlocked: smithi116.front.sepia.ceph.com 2022-05-18T18:29:23.825 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-05-18T18:29:23.942 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi073 but it was locked by another job: /home/teuthworker/archive/cbodley-2022-05-18_17:53:50-rgw-wip-cbodley-testing-distro-default-smithi/6840360 2022-05-18T18:29:23.942 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi116 but it was locked by another job: /home/teuthworker/archive/cbodley-2022-05-18_17:53:50-rgw-wip-cbodley-testing-distro-default-smithi/6840360