2022-09-01T06:37:51.509 INFO:root:teuthology version: 1.1.1.dev418+gb58f2c18
2022-09-01T06:37:51.797 INFO:teuthology.lock.ops:Start node 'smithi096.front.sepia.ceph.com' reimaging
2022-09-01T06:37:51.798 INFO:teuthology.lock.ops:Updating [smithi096.front.sepia.ceph.com]: reset os type and version on server
2022-09-01T06:37:51.798 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server
2022-09-01T06:37:51.835 INFO:teuthology.lock.ops:Node 'smithi096.front.sepia.ceph.com' reimaging is complete
2022-09-01T06:37:51.836 INFO:teuthology.lock.ops:Start node 'smithi120.front.sepia.ceph.com' reimaging
2022-09-01T06:37:51.836 INFO:teuthology.lock.ops:Updating [smithi120.front.sepia.ceph.com]: reset os type and version on server
2022-09-01T06:37:51.837 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server
2022-09-01T06:37:51.863 INFO:teuthology.lock.ops:Node 'smithi120.front.sepia.ceph.com' reimaging is complete
2022-09-01T06:37:52.087 INFO:teuthology.provision.fog.smithi096:Scheduling deploy of centos 8.stream
2022-09-01T06:37:52.094 INFO:teuthology.provision.fog.smithi120:Scheduling deploy of centos 8.stream
2022-09-01T06:37:52.439 INFO:teuthology.orchestra.console:Power off smithi120
2022-09-01T06:37:52.467 INFO:teuthology.orchestra.console:Power off smithi096
2022-09-01T06:37:52.620 INFO:teuthology.orchestra.console:Power off for smithi120 completed
2022-09-01T06:37:52.721 INFO:teuthology.orchestra.console:Power on smithi120
2022-09-01T06:38:00.931 INFO:teuthology.orchestra.console:Power off for smithi096 completed
2022-09-01T06:38:01.035 INFO:teuthology.orchestra.console:Power on smithi096
2022-09-01T06:38:01.272 INFO:teuthology.orchestra.console:Power on for smithi120 completed
2022-09-01T06:38:01.373 INFO:teuthology.provision.fog.smithi120:Waiting for deploy to finish
2022-09-01T06:38:05.422 INFO:teuthology.orchestra.console:Power on for smithi096 completed
2022-09-01T06:38:05.527 INFO:teuthology.provision.fog.smithi096:Waiting for deploy to finish
2022-09-01T06:40:32.603 ERROR:teuthology.orchestra.connection:Error authenticating with smithi120.front.sepia.ceph.com: Authentication failed.
2022-09-01T06:42:45.957 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-09-01T06:42:46.245 INFO:teuthology.provision.fog.smithi120:Node is ready
2022-09-01T06:42:46.313 INFO:teuthology.orchestra.run.smithi120.stdout:smithi120.front.sepia.ceph.com
2022-09-01T06:42:46.363 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-09-01T06:42:46.391 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120 smithi120.front.sepia.ceph.com smithi120
2022-09-01T06:42:46.662 INFO:teuthology.provision.fog.smithi096:Node is ready
2022-09-01T06:42:46.726 INFO:teuthology.orchestra.run.smithi096.stdout:smithi096.front.sepia.ceph.com
2022-09-01T06:42:46.778 INFO:teuthology.provision.fog.smithi120:Deploy complete!
2022-09-01T06:42:46.787 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96 smithi096.front.sepia.ceph.com smithi096
2022-09-01T06:42:47.179 INFO:teuthology.provision.fog.smithi096:Deploy complete!
2022-09-01T06:42:47.625 INFO:teuthology.lock.ops:Checking smithi096.front.sepia.ceph.com
2022-09-01T06:42:47.631 INFO:teuthology.lock.ops:New key found. Updating...
2022-09-01T06:42:47.668 INFO:teuthology.lock.ops:Checking smithi120.front.sepia.ceph.com
2022-09-01T06:42:47.669 INFO:teuthology.lock.ops:New key found. Updating...
2022-09-01T06:42:47.706 INFO:teuthology.lock.ops:Updating [smithi096.front.sepia.ceph.com]: set os type and version on server
2022-09-01T06:42:47.707 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com'
2022-09-01T06:42:47.981 INFO:teuthology.orchestra.run.smithi096.stdout:x86_64
2022-09-01T06:42:48.059 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="CentOS Stream"
2022-09-01T06:42:48.059 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="8"
2022-09-01T06:42:48.059 INFO:teuthology.orchestra.run.smithi096.stdout:ID="centos"
2022-09-01T06:42:48.060 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE="rhel fedora"
2022-09-01T06:42:48.060 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="8"
2022-09-01T06:42:48.062 INFO:teuthology.orchestra.run.smithi096.stdout:PLATFORM_ID="platform:el8"
2022-09-01T06:42:48.062 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="CentOS Stream 8"
2022-09-01T06:42:48.063 INFO:teuthology.orchestra.run.smithi096.stdout:ANSI_COLOR="0;31"
2022-09-01T06:42:48.063 INFO:teuthology.orchestra.run.smithi096.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-09-01T06:42:48.064 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://centos.org/"
2022-09-01T06:42:48.064 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-09-01T06:42:48.064 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-09-01T06:42:48.065 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-09-01T06:42:48.066 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server
2022-09-01T06:42:48.115 INFO:teuthology.lock.ops:Updating [smithi120.front.sepia.ceph.com]: set os type and version on server
2022-09-01T06:42:48.116 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com'
2022-09-01T06:42:48.384 INFO:teuthology.orchestra.run.smithi120.stdout:x86_64
2022-09-01T06:42:48.443 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="CentOS Stream"
2022-09-01T06:42:48.443 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="8"
2022-09-01T06:42:48.444 INFO:teuthology.orchestra.run.smithi120.stdout:ID="centos"
2022-09-01T06:42:48.444 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="rhel fedora"
2022-09-01T06:42:48.444 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="8"
2022-09-01T06:42:48.445 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el8"
2022-09-01T06:42:48.445 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="CentOS Stream 8"
2022-09-01T06:42:48.445 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31"
2022-09-01T06:42:48.446 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-09-01T06:42:48.446 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://centos.org/"
2022-09-01T06:42:48.446 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-09-01T06:42:48.447 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-09-01T06:42:48.447 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-09-01T06:42:48.450 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server
2022-09-01T06:42:48.571 INFO:teuthology.dispatcher.supervisor:Running job 7003581
2022-09-01T06:42:48.572 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/bin/teuthology -v --owner scheduled_matan@teuthology --archive /home/teuthworker/archive/matan-2022-09-01_06:29:18-crimson-rados-main-distro-crimson-smithi/7003581 --name matan-2022-09-01_06:29:18-crimson-rados-main-distro-crimson-smithi --description crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} centos_latest clusters/{fixed-2} deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/small-objects} -- /home/teuthworker/archive/matan-2022-09-01_06:29:18-crimson-rados-main-distro-crimson-smithi/7003581/orig.config.yaml
2022-09-01T06:42:48.586 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/matan-2022-09-01_06:29:18-crimson-rados-main-distro-crimson-smithi/7003581
2022-09-01T06:42:48.587 INFO:teuthology.dispatcher.supervisor:Job PID: 23361
2022-09-01T06:42:48.587 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-09-01T18:43:14.166 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-09-01T18:43:14.306 INFO:teuthology.kill:Killing Pids: {23361}
2022-09-01T18:43:15.816 INFO:teuthology.task.internal:roles: ubuntu@smithi096.front.sepia.ceph.com - ['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a']
2022-09-01T18:43:15.817 INFO:teuthology.task.internal:roles: ubuntu@smithi120.front.sepia.ceph.com - ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b']
2022-09-01T18:43:15.817 INFO:teuthology.misc:Compressing logs...
2022-09-01T18:43:15.818 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com'
2022-09-01T18:43:16.044 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com'
2022-09-01T18:43:16.456 INFO:teuthology.misc:Compressing logs...
2022-09-01T18:43:34.325 INFO:teuthology.misc:Compressing logs...
2022-09-01T18:44:09.408 INFO:teuthology.kill:No teuthology processes running
2022-09-01T18:44:10.833 INFO:teuthology.kill:Nuking machines: ['smithi096', 'smithi120']
2022-09-01T18:44:12.275 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2022-09-01T18:44:12.276 INFO:teuthology.kill:  from cryptography.hazmat.backends import default_backend
2022-09-01T18:44:12.276 INFO:teuthology.kill:2022-09-01 18:44:12,275.275 INFO:teuthology.nuke:targets:
2022-09-01T18:44:12.276 INFO:teuthology.kill:  smithi096.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLgmIMrNxQnw2uwE4UuwOD9Xz/Gfa1u1jk9eTVWVBCwk6myLJnXViCuEy9ZYS02FBMqEhBZ/wpLfFSywczd47b//PzS+7MuRMb2Q8NjeNXM8//a4NOQplJV+358yXhSwXMMJg7CAp6NirVorZG2/noz7ZFjnFX7XSkAM8m3F7HGEOGV84JbsjTCJOgEtusVRbD5qhI3zRBYhHBIAtIwE50QFGOBKdlx/jjsgaSvChDMCor9ZrOKZH2jlmDNCpplv4kTXEC3kzejuYjjIF3UeECQZljUq8kRywi7h2z2f3p2vn5RkFyBBK67H6lihhtreEGf3voLRZoTtX/C5UYFCOkegBXEX+GBh6mkJjVmc5fdD73TfRF5zRQc/6/DGr6wmVEbCnWgf/8wJftk2j9TY3cfGGOX61JILoNSvC2X+0GhhOTfE1opcs5mem5ubr6Y9FVI16EsPzg84vNiFoasXtOinz8FGKaf7d/FdEdcG9lh9/PtChKSB/xrbsbl99V7Kk=
2022-09-01T18:44:12.277 INFO:teuthology.kill:  smithi120.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8MHC9YNrP59S1OXNHy0B0OW+OTpvIFBZ6WyqkGHaqLMP6pJRIC51L0q/BNxxQlorwaxurC4bfi6uRcHmKiX96m7B1jRwER4sd5kXpiiRZPTQbzEbQVzcrBG86xZ1vcJyJIKQxxRfiAxi4GrxFk8lmm8CKa5zeZfdmDP7Nz6jBDqfquNT2jcAmsKyFndqYkA0NED1U2r6d6oMrzZDZ1RUnVO1FWWY2XlhRvOnSJCQQfdgDiWNaQWhbW+FObYo5ppSscbyLNBnCNckxML2+7A+jYJKUyRR2/xYsE2yp7BOucykiinVP/y3STxRIG83LbdXUq/PLf3yzponshWYJVKhaaMISYFBzjOva7B5R+M3y67/2IHl9QR8BvpCO6QwWdokrRzMcWlbC26QEVv1DKqMhqEfz5g27oVYl3l5QGkTVRcaUv7pYq0e4+g1nTQ9k+I0ejkp2KlAfTxGsLwB9emx/bAhxbB+utjVtnxhw3/pAxw3vjCmrQn++oPOmSZ2lE2U=
2022-09-01T18:44:12.277 INFO:teuthology.kill:2022-09-01 18:44:12,275.275 INFO:teuthology.nuke:Checking targets against current locks
2022-09-01T18:44:12.336 INFO:teuthology.kill:2022-09-01 18:44:12,336.336 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-09-01T18:44:12.369 INFO:teuthology.kill:2022-09-01 18:44:12,368.368 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-09-01T18:44:12.445 INFO:teuthology.kill:2022-09-01 18:44:12,444.444 INFO:teuthology.orchestra.console:Power off smithi096
2022-09-01T18:44:12.494 INFO:teuthology.kill:2022-09-01 18:44:12,494.494 INFO:teuthology.orchestra.console:Power off smithi120
2022-09-01T18:44:20.840 INFO:teuthology.kill:2022-09-01 18:44:20,839.839 INFO:teuthology.orchestra.console:Power off for smithi096 completed
2022-09-01T18:44:21.001 INFO:teuthology.kill:2022-09-01 18:44:21,000.000 INFO:teuthology.lock.ops:unlocked: smithi096.front.sepia.ceph.com
2022-09-01T18:44:24.999 INFO:teuthology.kill:2022-09-01 18:44:24,998.998 INFO:teuthology.orchestra.console:Power off for smithi120 completed
2022-09-01T18:44:25.182 INFO:teuthology.kill:2022-09-01 18:44:25,182.182 INFO:teuthology.lock.ops:unlocked: smithi120.front.sepia.ceph.com
2022-09-01T18:46:25.469 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-09-01T18:46:25.584 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi096 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-09-01_16:26:28-rados-wip-lflores-testing-2-2022-08-26-2240-quincy-distro-default-smithi/7005512
2022-09-01T18:46:25.584 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi120 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-09-01_16:26:28-rados-wip-lflores-testing-2-2022-08-26-2240-quincy-distro-default-smithi/7005513