2022-05-10T18:32:15.708 INFO:root:teuthology version: 1.1.1.dev333+gb018fa01 2022-05-10T18:32:15.840 INFO:teuthology.lock.ops:Start node 'smithi067.front.sepia.ceph.com' reimaging 2022-05-10T18:32:15.841 INFO:teuthology.lock.ops:Updating [smithi067.front.sepia.ceph.com]: reset os type and version on server 2022-05-10T18:32:15.841 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server 2022-05-10T18:32:15.863 INFO:teuthology.lock.ops:Node 'smithi067.front.sepia.ceph.com' reimaging is complete 2022-05-10T18:32:15.864 INFO:teuthology.lock.ops:Start node 'smithi183.front.sepia.ceph.com' reimaging 2022-05-10T18:32:15.864 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: reset os type and version on server 2022-05-10T18:32:15.865 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2022-05-10T18:32:15.887 INFO:teuthology.lock.ops:Node 'smithi183.front.sepia.ceph.com' reimaging is complete 2022-05-10T18:32:16.089 INFO:teuthology.provision.fog.smithi067:Scheduling deploy of centos 8.stream 2022-05-10T18:32:16.096 INFO:teuthology.provision.fog.smithi183:Scheduling deploy of centos 8.stream 2022-05-10T18:32:16.425 INFO:teuthology.orchestra.console:Power off smithi067 2022-05-10T18:32:16.472 INFO:teuthology.orchestra.console:Power off smithi183 2022-05-10T18:32:28.933 INFO:teuthology.orchestra.console:Power off for smithi067 completed 2022-05-10T18:32:28.954 INFO:teuthology.orchestra.console:Power off for smithi183 completed 2022-05-10T18:32:29.035 INFO:teuthology.orchestra.console:Power on smithi067 2022-05-10T18:32:29.058 INFO:teuthology.orchestra.console:Power on smithi183 2022-05-10T18:32:33.335 INFO:teuthology.orchestra.console:Power on for smithi067 completed 2022-05-10T18:32:33.339 INFO:teuthology.orchestra.console:Power on for smithi183 completed 2022-05-10T18:32:33.437 INFO:teuthology.provision.fog.smithi067:Waiting for deploy to finish 2022-05-10T18:32:33.441 INFO:teuthology.provision.fog.smithi183:Waiting for deploy to finish 2022-05-10T18:35:04.564 ERROR:teuthology.orchestra.connection:Error authenticating with smithi183.front.sepia.ceph.com: Authentication failed. 2022-05-10T18:36:45.385 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-10T18:36:47.685 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-10T18:37:10.940 INFO:teuthology.provision.fog.smithi183:Node is ready 2022-05-10T18:37:10.962 INFO:teuthology.orchestra.run.smithi183.stdout:smithi183.front.sepia.ceph.com 2022-05-10T18:37:11.022 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.15.183 smithi183.front.sepia.ceph.com smithi183 2022-05-10T18:37:11.413 INFO:teuthology.provision.fog.smithi183:Deploy complete! 2022-05-10T18:37:13.217 INFO:teuthology.provision.fog.smithi067:Node is ready 2022-05-10T18:37:13.240 INFO:teuthology.orchestra.run.smithi067.stdout:smithi067.front.sepia.ceph.com 2022-05-10T18:37:13.300 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67 smithi067.front.sepia.ceph.com smithi067 2022-05-10T18:37:13.683 INFO:teuthology.provision.fog.smithi067:Deploy complete! 2022-05-10T18:37:13.894 INFO:teuthology.lock.ops:Checking smithi067.front.sepia.ceph.com 2022-05-10T18:37:13.895 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-10T18:37:13.914 INFO:teuthology.lock.ops:Checking smithi183.front.sepia.ceph.com 2022-05-10T18:37:13.915 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-10T18:37:13.934 INFO:teuthology.lock.ops:Updating [smithi067.front.sepia.ceph.com]: set os type and version on server 2022-05-10T18:37:13.935 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2022-05-10T18:37:14.134 INFO:teuthology.orchestra.run.smithi067.stdout:x86_64 2022-05-10T18:37:14.191 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="CentOS Stream" 2022-05-10T18:37:14.191 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="8" 2022-05-10T18:37:14.191 INFO:teuthology.orchestra.run.smithi067.stdout:ID="centos" 2022-05-10T18:37:14.192 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="rhel fedora" 2022-05-10T18:37:14.192 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="8" 2022-05-10T18:37:14.192 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el8" 2022-05-10T18:37:14.192 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-10T18:37:14.192 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31" 2022-05-10T18:37:14.193 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-10T18:37:14.193 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://centos.org/" 2022-05-10T18:37:14.193 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-10T18:37:14.193 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-10T18:37:14.194 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-10T18:37:14.195 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server 2022-05-10T18:37:14.213 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: set os type and version on server 2022-05-10T18:37:14.213 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2022-05-10T18:37:14.417 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64 2022-05-10T18:37:14.476 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="CentOS Stream" 2022-05-10T18:37:14.476 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="8" 2022-05-10T18:37:14.477 INFO:teuthology.orchestra.run.smithi183.stdout:ID="centos" 2022-05-10T18:37:14.477 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="rhel fedora" 2022-05-10T18:37:14.477 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="8" 2022-05-10T18:37:14.477 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el8" 2022-05-10T18:37:14.477 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-10T18:37:14.478 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31" 2022-05-10T18:37:14.478 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-10T18:37:14.478 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://centos.org/" 2022-05-10T18:37:14.478 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-10T18:37:14.478 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-10T18:37:14.479 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-10T18:37:14.479 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2022-05-10T18:37:14.572 INFO:teuthology.dispatcher.supervisor:Running job 6830232 2022-05-10T18:37:14.573 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/bin/teuthology -v --owner scheduled_soumyakoduri@teuthology --archive /home/teuthworker/archive/soumyakoduri-2022-05-10_18:23:47-rgw-wip-skoduri-dbstore-vstart-distro-basic-smithi/6830232 --name soumyakoduri-2022-05-10_18:23:47-rgw-wip-skoduri-dbstore-vstart-distro-basic-smithi --description rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} -- /home/teuthworker/archive/soumyakoduri-2022-05-10_18:23:47-rgw-wip-skoduri-dbstore-vstart-distro-basic-smithi/6830232/orig.config.yaml 2022-05-10T18:37:14.576 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/soumyakoduri-2022-05-10_18:23:47-rgw-wip-skoduri-dbstore-vstart-distro-basic-smithi/6830232 2022-05-10T18:37:14.577 INFO:teuthology.dispatcher.supervisor:Job PID: 32713 2022-05-10T18:37:14.577 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-05-11T01:07:25.174 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-11T01:47:25.831 INFO:teuthology.kill:Killing Pids: {32713} 2022-05-11T04:48:49.802 INFO:teuthology.task.internal:roles: ubuntu@smithi067.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-05-11T04:48:49.803 INFO:teuthology.task.internal:roles: ubuntu@smithi183.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-05-11T04:48:49.804 INFO:teuthology.misc:Compressing logs... 2022-05-11T04:48:49.804 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2022-05-11T04:48:50.026 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2022-05-11T04:48:50.440 INFO:teuthology.misc:Compressing logs... 2022-05-11T04:48:50.593 INFO:teuthology.misc:Compressing logs... 2022-05-11T04:49:37.913 INFO:teuthology.orchestra.run.smithi067.stderr:gzip: /var/log/ceph/ceph-osd.2.log: file size changed while zipping 2022-05-11T06:03:49.779 INFO:teuthology.orchestra.run.smithi067.stderr:gzip: /var/log/ceph/ceph-mon.c.log: file size changed while zipping 2022-05-11T06:03:49.780 INFO:teuthology.orchestra.run.smithi067.stderr:gzip: /var/log/ceph/ceph-osd.3.log: file size changed while zipping 2022-05-11T06:03:49.781 INFO:teuthology.orchestra.run.smithi067.stderr:gzip: /var/log/ceph/ceph-osd.0.log: file size changed while zipping 2022-05-11T06:03:49.781 INFO:teuthology.orchestra.run.smithi067.stderr:gzip: /var/log/ceph/ceph-osd.1.log: file size changed while zipping 2022-05-11T06:03:49.782 INFO:teuthology.orchestra.run.smithi067.stderr:gzip: /var/log/ceph/ceph-mon.a.log: file size changed while zipping 2022-05-11T06:03:49.782 INFO:teuthology.orchestra.run.smithi183.stderr:gzip: /var/log/ceph/ceph-osd.4.log: file size changed while zipping 2022-05-11T06:03:49.783 INFO:teuthology.orchestra.run.smithi183.stderr:gzip: /var/log/ceph/ceph-mgr.x.log: file size changed while zipping 2022-05-11T06:03:49.783 INFO:teuthology.orchestra.run.smithi183.stderr:gzip: /var/log/ceph/ceph-mon.b.log: file size changed while zipping 2022-05-11T06:03:49.784 INFO:teuthology.orchestra.run.smithi183.stderr:gzip: /var/log/ceph/ceph-osd.6.log: file size changed while zipping 2022-05-11T06:03:49.784 INFO:teuthology.orchestra.run.smithi183.stderr:gzip: /var/log/ceph/ceph-osd.7.log: file size changed while zipping 2022-05-11T06:03:49.785 INFO:teuthology.orchestra.run.smithi183.stderr:gzip: /var/log/ceph/ceph-osd.5.log: file size changed while zipping 2022-05-11T13:58:19.092 INFO:teuthology.kill:No teuthology processes running 2022-05-11T13:58:20.351 INFO:teuthology.kill:Nuking machines: ['smithi067', 'smithi183'] 2022-05-11T13:58:21.423 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-05-11T13:58:21.424 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-05-11T13:58:21.424 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:236: CryptographyDeprecationWarning: Blowfish has been deprecated 2022-05-11T13:58:21.424 INFO:teuthology.kill: "class": algorithms.Blowfish, 2022-05-11T13:58:21.424 INFO:teuthology.kill:2022-05-11 13:58:21,422.422 INFO:teuthology.nuke:targets: 2022-05-11T13:58:21.425 INFO:teuthology.kill: smithi067.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCksIBCXBG7H2dZl69GS1T9o2HVNCbl1nOsu7oEp/vuwl9OBdb1tfIqgnjWbOfZUY1WM7J/EtjwLFMntOJDbAhjlqeXy8HhkOmaCxGPteXRrhee7K+4IrbbBqiran1GoJ0nbR4oDjPbzEgJSEsqOf6Fjw02ktdnM4FQSZ9MvMtczTgy8ZTvCCLrlmAtYC7SbU+eseG78gqoIYBY+zCRYgWF2yllMjhj6G8DI5W+iHgxf2E/8dKdwORuwH55v2hvDF28coR6fJn3OqSSlfp4XMSiX4ro1VbhptAFrQFp9B5DNPZ4PbUXdKY60SJwZ0tjxMyU2IWt584zMjKBwz7OyDbz/LA3BNdfPqfd/rlVOhlHANVmBZDLzzgoxKOKqACae3qtBI6a4QkNwhj3wmnB5dN06RCqZXqUAUsHPk9amlz4TNSsnmmnocHv31XBXUP6PKOfgB+6eA97Qg3ssaDsr/8tLfD/DJDpNaR1oQqaAOdvBz+BSQAQXTOjI5HAdJ0Af7M= 2022-05-11T13:58:21.425 INFO:teuthology.kill: smithi183.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDiQ8y4vDXO+9qWm5qaDu119yTdrFpNaiytU4XpX29CQt1vpvNSydmbU/ZdKxgtqWMUh6a20Tnf7mGiAIk+ivUfZyRkabRuW3baRz1g/rQDNLgpE1jFD1i+jrh8ZUUE/2ws+Gj0kMFl6oPGYD7PDYWdTBxSmxoZdwvnULYw2Y+SLs0+fgdM6iHQ9ZfmHlNWIy1P4OoKYxxEQJwu6hik+wvqkcctRQ66PqsQZOQo0cvADhi8bmp08FnifFWYieFI4VwCZsH/tDtHs8n1zdGa5Dm9MdnQ2NdxMrP9p/QxtrgyzvH4RjXT0xwH6BW96hgK9+M8GYhJRaW/+tjpkh5BKDSYPauOqFyOLvoPFzsUmwBcY+YoaHM8/nGpYziipWfuiLbr1imMkAXun9bZRla/7f89AWPHzSJVvGAJVNIuamkEAgmDTu3Dz1kn4oahXEbdYIlYYFoGeAXCX0TMQeNenXbtBUwiD64XNCC/sPgwe1NIcseEKVG4uan7cLv4WO2aiVU= 2022-05-11T13:58:21.451 INFO:teuthology.kill:2022-05-11 13:58:21,451.451 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-11T13:58:21.455 INFO:teuthology.kill:2022-05-11 13:58:21,455.455 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-11T13:58:21.530 INFO:teuthology.kill:2022-05-11 13:58:21,530.530 INFO:teuthology.orchestra.console:Power off smithi183 2022-05-11T13:58:21.542 INFO:teuthology.kill:2022-05-11 13:58:21,542.542 INFO:teuthology.orchestra.console:Power off smithi067 2022-05-11T13:58:29.898 INFO:teuthology.kill:2022-05-11 13:58:29,897.897 INFO:teuthology.orchestra.console:Power off for smithi183 completed 2022-05-11T13:58:30.047 INFO:teuthology.kill:2022-05-11 13:58:30,046.046 INFO:teuthology.lock.ops:unlocked: smithi183.front.sepia.ceph.com 2022-05-11T13:58:34.013 INFO:teuthology.kill:2022-05-11 13:58:34,013.013 INFO:teuthology.orchestra.console:Power off for smithi067 completed 2022-05-11T13:58:34.155 INFO:teuthology.kill:2022-05-11 13:58:34,155.155 INFO:teuthology.lock.ops:unlocked: smithi067.front.sepia.ceph.com 2022-05-11T14:00:34.336 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15