2022-12-05T12:33:18.196 INFO:root:teuthology version: 0.0.1.dev3+g4da97cf 2022-12-05T12:33:18.335 INFO:teuthology.lock.ops:Start node 'smithi140.front.sepia.ceph.com' reimaging 2022-12-05T12:33:18.336 INFO:teuthology.lock.ops:Updating [smithi140.front.sepia.ceph.com]: reset os type and version on server 2022-12-05T12:33:18.336 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server 2022-12-05T12:33:18.373 INFO:teuthology.lock.ops:Node 'smithi140.front.sepia.ceph.com' reimaging is complete 2022-12-05T12:33:18.373 INFO:teuthology.lock.ops:Start node 'smithi182.front.sepia.ceph.com' reimaging 2022-12-05T12:33:18.374 INFO:teuthology.lock.ops:Updating [smithi182.front.sepia.ceph.com]: reset os type and version on server 2022-12-05T12:33:18.374 INFO:teuthology.lock.ops:Updating smithi182.front.sepia.ceph.com on lock server 2022-12-05T12:33:18.429 INFO:teuthology.lock.ops:Node 'smithi182.front.sepia.ceph.com' reimaging is complete 2022-12-05T12:33:18.621 INFO:teuthology.provision.fog.smithi140:Scheduling deploy of centos 8.stream 2022-12-05T12:33:18.688 INFO:teuthology.provision.fog.smithi182:Scheduling deploy of centos 8.stream 2022-12-05T12:33:18.999 INFO:teuthology.orchestra.console:Power off smithi140 2022-12-05T12:33:19.082 INFO:teuthology.orchestra.console:Power off smithi182 2022-12-05T12:33:27.373 INFO:teuthology.orchestra.console:Power off for smithi140 completed 2022-12-05T12:33:27.475 INFO:teuthology.orchestra.console:Power on smithi140 2022-12-05T12:33:31.556 INFO:teuthology.orchestra.console:Power off for smithi182 completed 2022-12-05T12:33:31.658 INFO:teuthology.orchestra.console:Power on smithi182 2022-12-05T12:33:31.727 INFO:teuthology.orchestra.console:Power on for smithi140 completed 2022-12-05T12:33:31.828 INFO:teuthology.provision.fog.smithi140:Waiting for deploy to finish 2022-12-05T12:33:35.910 INFO:teuthology.orchestra.console:Power on for smithi182 completed 2022-12-05T12:33:36.011 INFO:teuthology.provision.fog.smithi182:Waiting for deploy to finish 2022-12-05T12:36:07.289 ERROR:teuthology.orchestra.connection:Error authenticating with smithi182.front.sepia.ceph.com: Authentication failed. 2022-12-05T12:37:48.358 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-12-05T12:38:08.700 INFO:teuthology.provision.fog.smithi182:Node is ready 2022-12-05T12:38:08.719 INFO:teuthology.orchestra.run.smithi182.stdout:smithi145 2022-12-05T12:38:08.776 INFO:teuthology.orchestra.run.smithi182.stdout:172.21.15.145 smithi145.front.sepia.ceph.com smithi145 2022-12-05T12:38:09.159 INFO:teuthology.provision.fog.smithi182:Deploy complete! 2022-12-05T12:38:25.078 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-12-05T12:38:25.332 INFO:teuthology.provision.fog.smithi140:Node is ready 2022-12-05T12:38:25.390 INFO:teuthology.orchestra.run.smithi140.stdout:smithi140.front.sepia.ceph.com 2022-12-05T12:38:25.448 INFO:teuthology.orchestra.run.smithi140.stdout:172.21.15.140 smithi140.front.sepia.ceph.com smithi140 2022-12-05T12:38:25.802 INFO:teuthology.provision.fog.smithi140:Deploy complete! 2022-12-05T12:38:25.980 INFO:teuthology.lock.ops:Checking smithi140.front.sepia.ceph.com 2022-12-05T12:38:25.981 INFO:teuthology.lock.ops:New key found. Updating... 2022-12-05T12:38:26.002 INFO:teuthology.lock.ops:Checking smithi182.front.sepia.ceph.com 2022-12-05T12:38:26.002 INFO:teuthology.lock.ops:New key found. Updating... 2022-12-05T12:38:26.022 INFO:teuthology.lock.ops:Updating [smithi140.front.sepia.ceph.com]: set os type and version on server 2022-12-05T12:38:26.022 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi140.front.sepia.ceph.com' 2022-12-05T12:38:26.216 INFO:teuthology.orchestra.run.smithi140.stdout:x86_64 2022-12-05T12:38:26.273 INFO:teuthology.orchestra.run.smithi140.stdout:NAME="CentOS Stream" 2022-12-05T12:38:26.273 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION="8" 2022-12-05T12:38:26.274 INFO:teuthology.orchestra.run.smithi140.stdout:ID="centos" 2022-12-05T12:38:26.274 INFO:teuthology.orchestra.run.smithi140.stdout:ID_LIKE="rhel fedora" 2022-12-05T12:38:26.274 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION_ID="8" 2022-12-05T12:38:26.274 INFO:teuthology.orchestra.run.smithi140.stdout:PLATFORM_ID="platform:el8" 2022-12-05T12:38:26.274 INFO:teuthology.orchestra.run.smithi140.stdout:PRETTY_NAME="CentOS Stream 8" 2022-12-05T12:38:26.275 INFO:teuthology.orchestra.run.smithi140.stdout:ANSI_COLOR="0;31" 2022-12-05T12:38:26.275 INFO:teuthology.orchestra.run.smithi140.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-12-05T12:38:26.275 INFO:teuthology.orchestra.run.smithi140.stdout:HOME_URL="https://centos.org/" 2022-12-05T12:38:26.275 INFO:teuthology.orchestra.run.smithi140.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-12-05T12:38:26.276 INFO:teuthology.orchestra.run.smithi140.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-12-05T12:38:26.276 INFO:teuthology.orchestra.run.smithi140.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-12-05T12:38:26.278 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server 2022-12-05T12:38:26.298 INFO:teuthology.lock.ops:Updating [smithi182.front.sepia.ceph.com]: set os type and version on server 2022-12-05T12:38:26.298 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi182.front.sepia.ceph.com' 2022-12-05T12:38:26.505 INFO:teuthology.orchestra.run.smithi182.stdout:x86_64 2022-12-05T12:38:26.564 INFO:teuthology.orchestra.run.smithi182.stdout:NAME="CentOS Stream" 2022-12-05T12:38:26.564 INFO:teuthology.orchestra.run.smithi182.stdout:VERSION="8" 2022-12-05T12:38:26.564 INFO:teuthology.orchestra.run.smithi182.stdout:ID="centos" 2022-12-05T12:38:26.564 INFO:teuthology.orchestra.run.smithi182.stdout:ID_LIKE="rhel fedora" 2022-12-05T12:38:26.565 INFO:teuthology.orchestra.run.smithi182.stdout:VERSION_ID="8" 2022-12-05T12:38:26.565 INFO:teuthology.orchestra.run.smithi182.stdout:PLATFORM_ID="platform:el8" 2022-12-05T12:38:26.565 INFO:teuthology.orchestra.run.smithi182.stdout:PRETTY_NAME="CentOS Stream 8" 2022-12-05T12:38:26.565 INFO:teuthology.orchestra.run.smithi182.stdout:ANSI_COLOR="0;31" 2022-12-05T12:38:26.565 INFO:teuthology.orchestra.run.smithi182.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-12-05T12:38:26.566 INFO:teuthology.orchestra.run.smithi182.stdout:HOME_URL="https://centos.org/" 2022-12-05T12:38:26.566 INFO:teuthology.orchestra.run.smithi182.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-12-05T12:38:26.566 INFO:teuthology.orchestra.run.smithi182.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-12-05T12:38:26.566 INFO:teuthology.orchestra.run.smithi182.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-12-05T12:38:26.567 INFO:teuthology.lock.ops:Updating smithi182.front.sepia.ceph.com on lock server 2022-12-05T12:38:26.671 INFO:teuthology.dispatcher.supervisor:Running job 7103355 2022-12-05T12:38:26.671 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_4da97cf64e542f347ec47b7bdbe5eca99759f9b7/virtualenv/bin/teuthology -v --owner scheduled_dis@teuthology --archive /home/teuthworker/archive/dis-2022-12-05_12:33:05-rbd-wip-dis-testing-distro-default-smithi/7103355 --name dis-2022-12-05_12:33:05-rbd-wip-dis-testing-distro-default-smithi --description rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} -- /home/teuthworker/archive/dis-2022-12-05_12:33:05-rbd-wip-dis-testing-distro-default-smithi/7103355/orig.config.yaml 2022-12-05T12:38:26.676 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/dis-2022-12-05_12:33:05-rbd-wip-dis-testing-distro-default-smithi/7103355 2022-12-05T12:38:26.678 INFO:teuthology.dispatcher.supervisor:Job PID: 16345 2022-12-05T12:38:26.678 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-12-06T00:38:51.905 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-12-06T00:38:52.063 INFO:teuthology.kill:Killing Pids: {16345} 2022-12-06T00:38:54.243 INFO:teuthology.task.internal:roles: ubuntu@smithi140.front.sepia.ceph.com - ['cluster1.mon.a', 'cluster1.mgr.x', 'cluster2.mgr.x', 'cluster1.osd.0', 'cluster1.osd.1', 'cluster1.osd.2', 'cluster1.client.0', 'cluster2.client.0'] 2022-12-06T00:38:54.244 INFO:teuthology.task.internal:roles: ubuntu@smithi182.front.sepia.ceph.com - ['cluster2.mon.a', 'cluster2.osd.0', 'cluster2.osd.1', 'cluster2.osd.2', 'cluster1.client.mirror', 'cluster1.client.mirror.0', 'cluster1.client.mirror.1', 'cluster1.client.mirror.2', 'cluster1.client.mirror.3', 'cluster1.client.mirror.4', 'cluster1.client.mirror.5', 'cluster1.client.mirror.6', 'cluster2.client.mirror', 'cluster2.client.mirror.0', 'cluster2.client.mirror.1', 'cluster2.client.mirror.2', 'cluster2.client.mirror.3', 'cluster2.client.mirror.4', 'cluster2.client.mirror.5', 'cluster2.client.mirror.6'] 2022-12-06T00:38:54.244 INFO:teuthology.misc:Compressing logs... 2022-12-06T00:38:54.245 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi140.front.sepia.ceph.com' 2022-12-06T00:38:54.437 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi182.front.sepia.ceph.com' 2022-12-06T00:38:54.876 INFO:teuthology.misc:Compressing logs... 2022-12-06T00:39:24.448 INFO:teuthology.misc:Compressing logs... 2022-12-06T00:42:45.697 INFO:teuthology.kill:No teuthology processes running 2022-12-06T00:42:46.965 INFO:teuthology.kill:Nuking machines: ['smithi140', 'smithi182'] 2022-12-06T00:42:48.073 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_teuthology_4da97cf64e542f347ec47b7bdbe5eca99759f9b7/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-12-06T00:42:48.074 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-12-06T00:42:48.074 INFO:teuthology.kill:2022-12-06 00:42:48,072.072 INFO:teuthology.nuke:targets: 2022-12-06T00:42:48.074 INFO:teuthology.kill: smithi140.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTKqJVRuW3Il1I4O7zZgD/kkqSMt3u2dz/Q+ZXwFTk3u0KbdDuviMM+0S58v/5qS57pOtzAop838QuudCHQOXfLd1s4XGNiUCjxE+RlB2oabKcmUJ1OJDlNp9ZWTcbyiViOkUlfnpc5LFK9XPpU6swlsGeI8iT2+WuoLy9cS/LBt8w5rWDzy1UmuXqPu1CAGgp93972Jz8wzBLPwz82Wg7Y/ABUrVNKIPeNuPtAxanE1hjQDO0J6Xfijt274PGVk/vvQ7DwJpbOABSl1cpN0WX9+odH13TB5LYRNwOrT+kvsWLky+8NrCU0C76sL+bfwRm6+i4wmtzk85RsZ/k10/BLmbhSW/khHZ+xgqSzO5gUrRDk5YgMtkIZn8u0NizmHdwZu+ql0mL3GhD8JqVrnpiHz+5L+xjRfNgLAQf3+YZC6hTqtKmFZAFfriq+eA4aZZGHsatDb+EIZNFuV7VUSCk8Xl+1ezu+mBuPerHs86ImHonR2KgpJQdrF0qHInIotE= 2022-12-06T00:42:48.074 INFO:teuthology.kill: smithi182.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4GrGL581yL6xZRCxtFNrhJs9V36OD6bov0FnACTQb8AntQSOKvTt05kln63ZuVnX/SpGKS07z+c43RCPl55DqXsoCjYTDSwFbCEqXi3Tbtp8/aDBzW9zsC0x8V0i6romV/mXnqyxCGPZbdJRdtFfuE2YkeWqYt3sFAy+yKfz+dLcK1HYXvkPf14oacwkWxS1R5EiaTqAoPJ1kcOLw0Rk7/4fG+sZ8lDsHMLGD64NTN9XoS3spBpoxtzmiK5BhlDuyW0A2YkDTYMaaJXpvcmvInG7nvicWdRmDwZxytsMJncpW+ktFBuar6rBHuPDvlkOXPY7W6wfLN4k8Hpu6PIk0JG/1qk7HsmgnG+WYjTBsXbP/7v0CFBX160DhMSui+FaAmUvz8YzDLTk41MA5zyeyowUZALsM7UCHm5SCBpB5kBT/77mEgT3CBQvDQSLlvnk2/D/037jngitaNPxc4SltfFO+vtqLhgtMcu2P3b7G5sVcfTM4gdS1LdHveGoG4u8= 2022-12-06T00:42:48.075 INFO:teuthology.kill:2022-12-06 00:42:48,072.072 INFO:teuthology.nuke:Checking targets against current locks 2022-12-06T00:42:48.137 INFO:teuthology.kill:2022-12-06 00:42:48,137.137 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-12-06T00:42:48.165 INFO:teuthology.kill:2022-12-06 00:42:48,165.165 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-12-06T00:42:48.223 INFO:teuthology.kill:2022-12-06 00:42:48,223.223 INFO:teuthology.orchestra.console:Power off smithi140 2022-12-06T00:42:48.261 INFO:teuthology.kill:2022-12-06 00:42:48,261.261 INFO:teuthology.orchestra.console:Power off smithi182 2022-12-06T00:42:56.596 INFO:teuthology.kill:2022-12-06 00:42:56,596.596 INFO:teuthology.orchestra.console:Power off for smithi140 completed 2022-12-06T00:42:56.757 INFO:teuthology.kill:2022-12-06 00:42:56,756.756 INFO:teuthology.lock.ops:unlocked: smithi140.front.sepia.ceph.com 2022-12-06T00:43:00.729 INFO:teuthology.kill:2022-12-06 00:43:00,729.729 INFO:teuthology.orchestra.console:Power off for smithi182 completed 2022-12-06T00:43:00.882 INFO:teuthology.kill:2022-12-06 00:43:00,882.882 INFO:teuthology.lock.ops:unlocked: smithi182.front.sepia.ceph.com 2022-12-06T00:45:01.086 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15