2022-09-14T15:26:17.805 INFO:root:teuthology version: 1.1.1.dev418+gb58f2c18
2022-09-14T15:26:17.941 INFO:teuthology.lock.ops:Start node 'smithi097.front.sepia.ceph.com' reimaging
2022-09-14T15:26:17.942 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: reset os type and version on server
2022-09-14T15:26:17.943 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server
2022-09-14T15:26:17.962 INFO:teuthology.lock.ops:Node 'smithi097.front.sepia.ceph.com' reimaging is complete
2022-09-14T15:26:17.962 INFO:teuthology.lock.ops:Start node 'smithi099.front.sepia.ceph.com' reimaging
2022-09-14T15:26:17.963 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: reset os type and version on server
2022-09-14T15:26:17.963 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server
2022-09-14T15:26:17.988 INFO:teuthology.lock.ops:Node 'smithi099.front.sepia.ceph.com' reimaging is complete
2022-09-14T15:26:18.182 INFO:teuthology.provision.fog.smithi097:Scheduling deploy of rhel 8.4
2022-09-14T15:26:18.212 INFO:teuthology.provision.fog.smithi099:Scheduling deploy of rhel 8.4
2022-09-14T15:26:18.532 INFO:teuthology.orchestra.console:Power off smithi097
2022-09-14T15:26:18.602 INFO:teuthology.orchestra.console:Power off smithi099
2022-09-14T15:26:26.909 INFO:teuthology.orchestra.console:Power off for smithi097 completed
2022-09-14T15:26:26.970 INFO:teuthology.orchestra.console:Power off for smithi099 completed
2022-09-14T15:26:27.010 INFO:teuthology.orchestra.console:Power on smithi097
2022-09-14T15:26:27.072 INFO:teuthology.orchestra.console:Power on smithi099
2022-09-14T15:26:31.333 INFO:teuthology.orchestra.console:Power on for smithi099 completed
2022-09-14T15:26:31.434 INFO:teuthology.provision.fog.smithi099:Waiting for deploy to finish
2022-09-14T15:26:35.390 INFO:teuthology.orchestra.console:Power on for smithi097 completed
2022-09-14T15:26:35.491 INFO:teuthology.provision.fog.smithi097:Waiting for deploy to finish
2022-09-14T15:29:02.656 ERROR:teuthology.orchestra.connection:Error authenticating with smithi099.front.sepia.ceph.com: Authentication failed.
2022-09-14T15:30:43.612 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-09-14T15:31:03.558 INFO:teuthology.provision.fog.smithi099:Node is ready
2022-09-14T15:31:03.579 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099.front.sepia.ceph.com
2022-09-14T15:31:03.637 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99 smithi099.front.sepia.ceph.com smithi099
2022-09-14T15:31:03.982 INFO:teuthology.provision.fog.smithi099:Deploy complete!
2022-09-14T15:31:04.642 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-09-14T15:31:04.871 INFO:teuthology.provision.fog.smithi097:Node is ready
2022-09-14T15:31:04.887 INFO:teuthology.orchestra.run.smithi097.stdout:smithi097.front.sepia.ceph.com
2022-09-14T15:31:04.942 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.15.97 smithi097.front.sepia.ceph.com smithi097
2022-09-14T15:31:05.262 INFO:teuthology.provision.fog.smithi097:Deploy complete!
2022-09-14T15:31:05.451 INFO:teuthology.lock.ops:Checking smithi097.front.sepia.ceph.com
2022-09-14T15:31:05.452 INFO:teuthology.lock.ops:New key found. Updating...
2022-09-14T15:31:05.477 INFO:teuthology.lock.ops:Checking smithi099.front.sepia.ceph.com
2022-09-14T15:31:05.477 INFO:teuthology.lock.ops:New key found. Updating...
2022-09-14T15:31:05.499 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: set os type and version on server
2022-09-14T15:31:05.500 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com'
2022-09-14T15:31:05.770 INFO:teuthology.orchestra.run.smithi097.stdout:x86_64
2022-09-14T15:31:05.825 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="Red Hat Enterprise Linux"
2022-09-14T15:31:05.825 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="8.4 (Ootpa)"
2022-09-14T15:31:05.825 INFO:teuthology.orchestra.run.smithi097.stdout:ID="rhel"
2022-09-14T15:31:05.825 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE="fedora"
2022-09-14T15:31:05.826 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="8.4"
2022-09-14T15:31:05.826 INFO:teuthology.orchestra.run.smithi097.stdout:PLATFORM_ID="platform:el8"
2022-09-14T15:31:05.826 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-09-14T15:31:05.826 INFO:teuthology.orchestra.run.smithi097.stdout:ANSI_COLOR="0;31"
2022-09-14T15:31:05.827 INFO:teuthology.orchestra.run.smithi097.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-09-14T15:31:05.827 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://www.redhat.com/"
2022-09-14T15:31:05.827 INFO:teuthology.orchestra.run.smithi097.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-09-14T15:31:05.828 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-09-14T15:31:05.828 INFO:teuthology.orchestra.run.smithi097.stdout:
2022-09-14T15:31:05.828 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-09-14T15:31:05.828 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-09-14T15:31:05.829 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-09-14T15:31:05.829 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-09-14T15:31:05.830 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server
2022-09-14T15:31:05.854 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: set os type and version on server
2022-09-14T15:31:05.855 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com'
2022-09-14T15:31:06.067 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64
2022-09-14T15:31:06.131 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="Red Hat Enterprise Linux"
2022-09-14T15:31:06.131 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8.4 (Ootpa)"
2022-09-14T15:31:06.131 INFO:teuthology.orchestra.run.smithi099.stdout:ID="rhel"
2022-09-14T15:31:06.132 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="fedora"
2022-09-14T15:31:06.132 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8.4"
2022-09-14T15:31:06.132 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8"
2022-09-14T15:31:06.132 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-09-14T15:31:06.133 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31"
2022-09-14T15:31:06.133 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-09-14T15:31:06.133 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://www.redhat.com/"
2022-09-14T15:31:06.134 INFO:teuthology.orchestra.run.smithi099.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-09-14T15:31:06.134 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-09-14T15:31:06.134 INFO:teuthology.orchestra.run.smithi099.stdout:
2022-09-14T15:31:06.134 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-09-14T15:31:06.135 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-09-14T15:31:06.135 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-09-14T15:31:06.135 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-09-14T15:31:06.136 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server
2022-09-14T15:31:06.246 INFO:teuthology.dispatcher.supervisor:Running job 7032587
2022-09-14T15:31:06.247 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/bin/teuthology -v --owner scheduled_lflores@teuthology --archive /home/teuthworker/archive/lflores-2022-09-14_15:11:39-rados-quincy-release-distro-default-smithi/7032587 --name lflores-2022-09-14_15:11:39-rados-quincy-release-distro-default-smithi --description rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} -- /home/teuthworker/archive/lflores-2022-09-14_15:11:39-rados-quincy-release-distro-default-smithi/7032587/orig.config.yaml
2022-09-14T15:31:06.254 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/lflores-2022-09-14_15:11:39-rados-quincy-release-distro-default-smithi/7032587
2022-09-14T15:31:06.256 INFO:teuthology.dispatcher.supervisor:Job PID: 12751
2022-09-14T15:31:06.257 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-09-15T03:31:30.238 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-09-15T03:31:30.439 INFO:teuthology.kill:Killing Pids: {12751}
2022-09-15T03:31:31.863 INFO:teuthology.task.internal:roles: ubuntu@smithi097.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2022-09-15T03:31:31.864 INFO:teuthology.task.internal:roles: ubuntu@smithi099.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2022-09-15T03:31:31.864 INFO:teuthology.misc:Compressing logs...
2022-09-15T03:31:31.865 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com'
2022-09-15T03:31:32.070 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com'
2022-09-15T03:31:32.423 INFO:teuthology.misc:Compressing logs...
2022-09-15T03:31:33.543 INFO:teuthology.orchestra.run.smithi097.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-09-15T03:31:33.547 INFO:teuthology.orchestra.run.smithi099.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-09-15T03:31:34.193 INFO:teuthology.misc:Compressing logs...
2022-09-15T03:36:30.793 INFO:teuthology.kill:No teuthology processes running
2022-09-15T03:36:32.213 INFO:teuthology.kill:Nuking machines: ['smithi097', 'smithi099']
2022-09-15T03:36:33.390 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2022-09-15T03:36:33.391 INFO:teuthology.kill:  from cryptography.hazmat.backends import default_backend
2022-09-15T03:36:33.392 INFO:teuthology.kill:2022-09-15 03:36:33,390.390 INFO:teuthology.nuke:targets:
2022-09-15T03:36:33.392 INFO:teuthology.kill:  smithi097.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOcWgs1Fyixd+5I/7AdYhQraet/1OTMW+5AL+XDUL56940LQGsU9PpBMUNyNmTle1F8x2cB9MexbP3tXNZVpr4w=
2022-09-15T03:36:33.392 INFO:teuthology.kill:  smithi099.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9YlvNtDkClvFbulfRkI6kDCoRULK4Q5L3n3irb8i6dr1j7TETkKcjDKxMjzoAK1vTAVepm2Thqs0HD2WRAkj9g1lzK0C2QWBUd+YIQtGnYG3LL19OMGv10yC/ZHsEe77qOHVz0At0tnN+2/mXnMGf4dN6eidv2NAvgz1zvRVBAAvRFRQYm1j/7b/SBksJgdDPFV16mqltXdc8RpohSSAdFez9yYT2PtlSvgIM33c0rCQYo/bzsEEY3r1Wk6Itccrlg0ySS2nhb8frTKIPQ+L10JZArxDU1gQ0mmEQivyhjXqq6LCUpjgXosE0SeXcq1iZIpzax/remt88wAlA/hHgYvZbO8oPqbIOptIP8bqjqNSVBld44LZzj4KqU3KOp0bpT9YfZh/QI7jX65imqAsKkoYZQwVBvErWBwPKUxbbcYmWLfW45/unUj5abmgp83HWcQjwpv7RgLrKey76f6YHVjyl9rAJNY9uu7i5kITz0l4TimISxpXl5SRfsUmzpj8=
2022-09-15T03:36:33.392 INFO:teuthology.kill:2022-09-15 03:36:33,390.390 INFO:teuthology.nuke:Checking targets against current locks
2022-09-15T03:36:33.456 INFO:teuthology.kill:2022-09-15 03:36:33,456.456 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-09-15T03:36:33.492 INFO:teuthology.kill:2022-09-15 03:36:33,491.491 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-09-15T03:36:33.540 INFO:teuthology.kill:2022-09-15 03:36:33,540.540 INFO:teuthology.orchestra.console:Power off smithi097
2022-09-15T03:36:33.583 INFO:teuthology.kill:2022-09-15 03:36:33,582.582 INFO:teuthology.orchestra.console:Power off smithi099
2022-09-15T03:36:46.028 INFO:teuthology.kill:2022-09-15 03:36:46,027.027 INFO:teuthology.orchestra.console:Power off for smithi097 completed
2022-09-15T03:36:46.059 INFO:teuthology.kill:2022-09-15 03:36:46,059.059 INFO:teuthology.orchestra.console:Power off for smithi099 completed
2022-09-15T03:36:46.191 INFO:teuthology.kill:2022-09-15 03:36:46,190.190 INFO:teuthology.lock.ops:unlocked: smithi097.front.sepia.ceph.com
2022-09-15T03:36:46.224 INFO:teuthology.kill:2022-09-15 03:36:46,223.223 INFO:teuthology.lock.ops:unlocked: smithi099.front.sepia.ceph.com
2022-09-15T03:38:46.513 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-09-15T03:38:46.622 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi097 but it was locked by another job: /home/teuthworker/archive/rishabh-2022-09-14_12:48:43-fs-wip-rishabh-testing-2022Sep9-1708-testing-default-smithi/7032034
2022-09-15T03:38:46.623 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi099 but it was locked by another job: /home/teuthworker/archive/rishabh-2022-09-14_12:48:43-fs-wip-rishabh-testing-2022Sep9-1708-testing-default-smithi/7032034