2022-05-10T18:26:41.020 INFO:root:teuthology version: 1.1.1.dev333+gb018fa01 2022-05-10T18:26:41.172 INFO:teuthology.lock.ops:Start node 'smithi125.front.sepia.ceph.com' reimaging 2022-05-10T18:26:41.173 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: reset os type and version on server 2022-05-10T18:26:41.174 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2022-05-10T18:26:41.195 INFO:teuthology.lock.ops:Node 'smithi125.front.sepia.ceph.com' reimaging is complete 2022-05-10T18:26:41.195 INFO:teuthology.lock.ops:Start node 'smithi154.front.sepia.ceph.com' reimaging 2022-05-10T18:26:41.196 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: reset os type and version on server 2022-05-10T18:26:41.196 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2022-05-10T18:26:41.219 INFO:teuthology.lock.ops:Node 'smithi154.front.sepia.ceph.com' reimaging is complete 2022-05-10T18:26:41.423 INFO:teuthology.provision.fog.smithi125:Scheduling deploy of centos 8.stream 2022-05-10T18:26:41.461 INFO:teuthology.provision.fog.smithi154:Scheduling deploy of centos 8.stream 2022-05-10T18:26:41.826 INFO:teuthology.orchestra.console:Power off smithi125 2022-05-10T18:26:41.840 INFO:teuthology.orchestra.console:Power off smithi154 2022-05-10T18:26:50.195 INFO:teuthology.orchestra.console:Power off for smithi125 completed 2022-05-10T18:26:50.297 INFO:teuthology.orchestra.console:Power on smithi125 2022-05-10T18:26:54.314 INFO:teuthology.orchestra.console:Power off for smithi154 completed 2022-05-10T18:26:54.415 INFO:teuthology.orchestra.console:Power on smithi154 2022-05-10T18:26:58.661 INFO:teuthology.orchestra.console:Power on for smithi125 completed 2022-05-10T18:26:58.666 INFO:teuthology.orchestra.console:Power on for smithi154 completed 2022-05-10T18:26:58.763 INFO:teuthology.provision.fog.smithi125:Waiting for deploy to finish 2022-05-10T18:26:58.770 INFO:teuthology.provision.fog.smithi154:Waiting for deploy to finish 2022-05-10T18:31:27.992 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-10T18:31:28.276 INFO:teuthology.provision.fog.smithi125:Node is ready 2022-05-10T18:31:28.301 INFO:teuthology.orchestra.run.smithi125.stdout:smithi125.front.sepia.ceph.com 2022-05-10T18:31:28.362 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125 smithi125.front.sepia.ceph.com smithi125 2022-05-10T18:31:28.737 INFO:teuthology.provision.fog.smithi125:Deploy complete! 2022-05-10T18:31:52.105 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-10T18:31:52.389 INFO:teuthology.provision.fog.smithi154:Node is ready 2022-05-10T18:31:52.409 INFO:teuthology.orchestra.run.smithi154.stdout:smithi154.front.sepia.ceph.com 2022-05-10T18:31:52.470 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154 smithi154.front.sepia.ceph.com smithi154 2022-05-10T18:31:52.816 INFO:teuthology.provision.fog.smithi154:Deploy complete! 2022-05-10T18:31:53.038 INFO:teuthology.lock.ops:Checking smithi125.front.sepia.ceph.com 2022-05-10T18:31:53.039 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-10T18:31:53.064 INFO:teuthology.lock.ops:Checking smithi154.front.sepia.ceph.com 2022-05-10T18:31:53.064 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-10T18:31:53.091 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: set os type and version on server 2022-05-10T18:31:53.092 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2022-05-10T18:31:53.400 INFO:teuthology.orchestra.run.smithi125.stdout:x86_64 2022-05-10T18:31:53.458 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="CentOS Stream" 2022-05-10T18:31:53.458 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="8" 2022-05-10T18:31:53.458 INFO:teuthology.orchestra.run.smithi125.stdout:ID="centos" 2022-05-10T18:31:53.459 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE="rhel fedora" 2022-05-10T18:31:53.459 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="8" 2022-05-10T18:31:53.459 INFO:teuthology.orchestra.run.smithi125.stdout:PLATFORM_ID="platform:el8" 2022-05-10T18:31:53.459 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-10T18:31:53.460 INFO:teuthology.orchestra.run.smithi125.stdout:ANSI_COLOR="0;31" 2022-05-10T18:31:53.460 INFO:teuthology.orchestra.run.smithi125.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-10T18:31:53.460 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://centos.org/" 2022-05-10T18:31:53.460 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-10T18:31:53.460 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-10T18:31:53.461 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-10T18:31:53.462 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2022-05-10T18:31:53.489 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: set os type and version on server 2022-05-10T18:31:53.490 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2022-05-10T18:31:53.718 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2022-05-10T18:31:53.780 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream" 2022-05-10T18:31:53.780 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="8" 2022-05-10T18:31:53.781 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos" 2022-05-10T18:31:53.781 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora" 2022-05-10T18:31:53.781 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="8" 2022-05-10T18:31:53.781 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el8" 2022-05-10T18:31:53.781 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-10T18:31:53.782 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2022-05-10T18:31:53.782 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-10T18:31:53.782 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/" 2022-05-10T18:31:53.782 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-10T18:31:53.783 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-10T18:31:53.783 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-10T18:31:53.783 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2022-05-10T18:31:53.915 INFO:teuthology.dispatcher.supervisor:Running job 6830226 2022-05-10T18:31:53.916 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/bin/teuthology -v --owner scheduled_soumyakoduri@teuthology --archive /home/teuthworker/archive/soumyakoduri-2022-05-10_18:23:47-rgw-wip-skoduri-dbstore-vstart-distro-basic-smithi/6830226 --name soumyakoduri-2022-05-10_18:23:47-rgw-wip-skoduri-dbstore-vstart-distro-basic-smithi --description rgw/notifications/{beast bluestore-bitmap fixed-2 overrides supported-all-distro$/{centos_8} tasks/{0-install test_amqp test_kafka test_others}} -- /home/teuthworker/archive/soumyakoduri-2022-05-10_18:23:47-rgw-wip-skoduri-dbstore-vstart-distro-basic-smithi/6830226/orig.config.yaml 2022-05-10T18:31:53.928 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/soumyakoduri-2022-05-10_18:23:47-rgw-wip-skoduri-dbstore-vstart-distro-basic-smithi/6830226 2022-05-10T18:31:53.929 INFO:teuthology.dispatcher.supervisor:Job PID: 17994 2022-05-10T18:31:53.929 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-05-11T01:02:18.055 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-11T02:52:40.405 INFO:teuthology.kill:Killing Pids: {17994} 2022-05-11T02:52:41.647 INFO:teuthology.task.internal:roles: ubuntu@smithi125.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-05-11T02:52:41.648 INFO:teuthology.task.internal:roles: ubuntu@smithi154.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-05-11T02:52:41.648 INFO:teuthology.misc:Compressing logs... 2022-05-11T02:52:41.649 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2022-05-11T02:52:41.936 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2022-05-11T02:52:42.578 INFO:teuthology.misc:Compressing logs... 2022-05-11T02:52:43.514 INFO:teuthology.misc:Compressing logs... 2022-05-11T02:53:42.160 INFO:teuthology.orchestra.run.smithi125.stderr:gzip: /var/log/ceph/ceph-osd.2.log: file size changed while zipping 2022-05-11T07:38:15.637 INFO:teuthology.orchestra.run.smithi154.stderr:gzip: /var/log/ceph/ceph-osd.4.log: file size changed while zipping 2022-05-11T08:26:57.089 INFO:teuthology.orchestra.run.smithi154.stderr:gzip: /var/log/ceph/ceph-mgr.x.log: file size changed while zipping 2022-05-11T08:26:57.091 INFO:teuthology.orchestra.run.smithi154.stderr:gzip: /var/log/ceph/ceph-mon.b.log: file size changed while zipping 2022-05-11T08:26:57.091 INFO:teuthology.orchestra.run.smithi154.stderr:gzip: /var/log/ceph/ceph-osd.6.log: file size changed while zipping 2022-05-11T08:26:57.091 INFO:teuthology.orchestra.run.smithi154.stderr:gzip: /var/log/ceph/ceph-osd.7.log: file size changed while zipping 2022-05-11T08:26:57.091 INFO:teuthology.orchestra.run.smithi154.stderr:gzip: /var/log/ceph/ceph-osd.5.log: file size changed while zipping 2022-05-11T08:26:57.092 INFO:teuthology.orchestra.run.smithi125.stderr:gzip: /var/log/ceph/ceph-mon.c.log: file size changed while zipping 2022-05-11T08:26:57.092 INFO:teuthology.orchestra.run.smithi125.stderr:gzip: /var/log/ceph/ceph-osd.3.log: file size changed while zipping 2022-05-11T08:26:57.093 INFO:teuthology.orchestra.run.smithi125.stderr:gzip: /var/log/ceph/ceph-mgr.y.log: file size changed while zipping 2022-05-11T08:26:57.093 INFO:teuthology.orchestra.run.smithi125.stderr:gzip: /var/log/ceph/ceph-osd.0.log: file size changed while zipping 2022-05-11T08:26:57.093 INFO:teuthology.orchestra.run.smithi125.stderr:gzip: /var/log/ceph/ceph-osd.1.log: file size changed while zipping 2022-05-11T08:26:57.093 INFO:teuthology.orchestra.run.smithi125.stderr:gzip: /var/log/ceph/ceph-mon.a.log: file size changed while zipping 2022-05-11T15:08:43.309 INFO:teuthology.kill:No teuthology processes running 2022-05-11T15:08:44.753 INFO:teuthology.kill:Nuking machines: ['smithi125', 'smithi154'] 2022-05-11T15:08:45.909 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-05-11T15:08:45.910 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-05-11T15:08:45.911 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:236: CryptographyDeprecationWarning: Blowfish has been deprecated 2022-05-11T15:08:45.911 INFO:teuthology.kill: "class": algorithms.Blowfish, 2022-05-11T15:08:45.912 INFO:teuthology.kill:2022-05-11 15:08:45,909.909 INFO:teuthology.nuke:targets: 2022-05-11T15:08:45.912 INFO:teuthology.kill: smithi125.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCmzlY+V26n84DrbkpTNj5vaUR822IeYq8V5EtK7s0jRKpU6UUM0fsiLgBIyN4HD6Z8T9wjcvjgBhRplg0sMe6Uvya8/csQNZhhLD+65GUFO6LdZ/IFWI2R8LzNhHRygyo/VwGR5dVigKf7SKO+xws4OHzseHMf5hQtFGuMZ42bTgj9wclOxcrCLyooI1SohSMTAZ80pzSLafWjkA/Iy9XgZ3U7+xZi3FYodUu+Ln3LCa/AUx7P39uvaOo5fWhALUBzio7Tfiobs0RtkcxYFkw/uOmcGy8XyoBEOIk2pvqhJfD4jsIdGOgDufFFJ5M+VsR+HNoo93411sfPduyVfFvpe3QIuAowMv4L87s33/hrZc0xF6gwIXXqnoxKozHGDKSz2nEi+l2s/DmFzTQGzH0VJxqtZ9a6F3rZyZLZ/DbzboppNwJHhf2ip7dsTSBqAjvLskMZJ1QcqG1SqzuNCjpUyUMxUnFPxLhLYOuGf9CcsKBCSa0v76GNTnTwlBeAeYM= 2022-05-11T15:08:45.913 INFO:teuthology.kill: smithi154.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8U20CwlL4T1dgEsNAbDL+dGv6rlygVRLXCyPzC4JpSoq6GQn9RADs7VR6mnFEbUQ+WOadGM5BssCqb81s1aspkEq4tdJqpr9Oi42nC11J31Ue5gR/HOOO10XbA7CGtyJECXv1g9/IKdTv4dCfA0tL1x2CAWcdgIticj8bv7GUD39mZFjODmMYYbliessVzAUXBk+e2cGvRTbmAp8DK9Bys2t6TFRwYSCEhKHMHbvfTr66viAsZvxC6gx9SeirSdK5FdBmkqsyODmRWXaK/z3n9bxgPdOo3sZAWDwb8TAf/wH0zTpP/8/9UjeNKwFv8XG3XJ9lRChCBfwk8JeIk20YMkTmERNMQ/RXMacxTdEsgDny0OFCogiRHfAF0lIKdtd5jFQz5nMH6lToZiFjPJNAboEixaaMOjKbmEbe8PKVpGyIkH9DRGB/kJJq+8sCeFwr6h2Moaqf6hCf9xivsMxNHagjDlZZ5OFDl2KwyJwazIOvBXkxs3EgWYmF5xyJj+8= 2022-05-11T15:08:45.942 INFO:teuthology.kill:2022-05-11 15:08:45,942.942 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-11T15:08:45.949 INFO:teuthology.kill:2022-05-11 15:08:45,949.949 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-11T15:08:46.012 INFO:teuthology.kill:2022-05-11 15:08:46,012.012 INFO:teuthology.orchestra.console:Power off smithi154 2022-05-11T15:08:46.026 INFO:teuthology.kill:2022-05-11 15:08:46,025.025 INFO:teuthology.orchestra.console:Power off smithi125 2022-05-11T15:08:54.385 INFO:teuthology.kill:2022-05-11 15:08:54,384.384 INFO:teuthology.orchestra.console:Power off for smithi125 completed 2022-05-11T15:08:54.527 INFO:teuthology.kill:2022-05-11 15:08:54,526.526 INFO:teuthology.lock.ops:unlocked: smithi125.front.sepia.ceph.com 2022-05-11T15:08:58.491 INFO:teuthology.kill:2022-05-11 15:08:58,490.490 INFO:teuthology.orchestra.console:Power off for smithi154 completed 2022-05-11T15:08:58.634 INFO:teuthology.kill:2022-05-11 15:08:58,633.633 INFO:teuthology.lock.ops:unlocked: smithi154.front.sepia.ceph.com 2022-05-11T15:10:58.914 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-05-11T15:21:51.669 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi125 but it was locked by another job: /home/teuthworker/archive/rfriedma-2022-05-11_13:51:36-smoke-wip-rf-cln-typesh-distro-basic-smithi/6830587 2022-05-11T15:21:51.670 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi154 but it was locked by another job: /home/teuthworker/archive/rfriedma-2022-05-11_13:51:36-smoke-wip-rf-cln-typesh-distro-basic-smithi/6830587