2022-07-09T05:59:06.979 INFO:root:teuthology version: 1.1.1.dev381+g10062088
2022-07-09T05:59:07.364 INFO:teuthology.lock.ops:Start node 'smithi192.front.sepia.ceph.com' reimaging
2022-07-09T05:59:07.366 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: reset os type and version on server
2022-07-09T05:59:07.366 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server
2022-07-09T05:59:07.414 INFO:teuthology.lock.ops:Node 'smithi192.front.sepia.ceph.com' reimaging is complete
2022-07-09T05:59:07.414 INFO:teuthology.lock.ops:Start node 'smithi202.front.sepia.ceph.com' reimaging
2022-07-09T05:59:07.415 INFO:teuthology.lock.ops:Updating [smithi202.front.sepia.ceph.com]: reset os type and version on server
2022-07-09T05:59:07.415 INFO:teuthology.lock.ops:Updating smithi202.front.sepia.ceph.com on lock server
2022-07-09T05:59:07.439 INFO:teuthology.lock.ops:Node 'smithi202.front.sepia.ceph.com' reimaging is complete
2022-07-09T05:59:07.743 INFO:teuthology.provision.fog.smithi192:Scheduling deploy of rhel 8.6
2022-07-09T05:59:07.759 INFO:teuthology.provision.fog.smithi202:Scheduling deploy of rhel 8.6
2022-07-09T05:59:08.223 INFO:teuthology.orchestra.console:Power off smithi202
2022-07-09T05:59:08.264 INFO:teuthology.orchestra.console:Power off smithi192
2022-07-09T05:59:16.823 INFO:teuthology.orchestra.console:Power off for smithi192 completed
2022-07-09T05:59:16.925 INFO:teuthology.orchestra.console:Power on smithi192
2022-07-09T05:59:20.972 INFO:teuthology.orchestra.console:Power off for smithi202 completed
2022-07-09T05:59:21.095 INFO:teuthology.orchestra.console:Power on smithi202
2022-07-09T05:59:25.452 INFO:teuthology.orchestra.console:Power on for smithi202 completed
2022-07-09T05:59:25.471 INFO:teuthology.orchestra.console:Power on for smithi192 completed
2022-07-09T05:59:25.557 INFO:teuthology.provision.fog.smithi202:Waiting for deploy to finish
2022-07-09T05:59:25.573 INFO:teuthology.provision.fog.smithi192:Waiting for deploy to finish
2022-07-09T06:03:32.880 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-07-09T06:03:57.986 INFO:teuthology.provision.fog.smithi192:Node is ready
2022-07-09T06:03:58.008 INFO:teuthology.orchestra.run.smithi192.stdout:smithi192.front.sepia.ceph.com
2022-07-09T06:03:58.068 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.15.192 smithi192.front.sepia.ceph.com smithi192
2022-07-09T06:03:58.251 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-07-09T06:03:58.438 INFO:teuthology.provision.fog.smithi192:Deploy complete!
2022-07-09T06:03:58.525 INFO:teuthology.provision.fog.smithi202:Node is ready
2022-07-09T06:03:58.547 INFO:teuthology.orchestra.run.smithi202.stdout:smithi202.front.sepia.ceph.com
2022-07-09T06:03:58.607 INFO:teuthology.orchestra.run.smithi202.stdout:172.21.15.202 smithi202.front.sepia.ceph.com smithi202
2022-07-09T06:03:58.954 INFO:teuthology.provision.fog.smithi202:Deploy complete!
2022-07-09T06:03:59.186 INFO:teuthology.lock.ops:Checking smithi192.front.sepia.ceph.com
2022-07-09T06:03:59.187 INFO:teuthology.lock.ops:New key found. Updating...
2022-07-09T06:03:59.233 INFO:teuthology.lock.ops:Checking smithi202.front.sepia.ceph.com
2022-07-09T06:03:59.233 INFO:teuthology.lock.ops:New key found. Updating...
2022-07-09T06:03:59.279 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: set os type and version on server
2022-07-09T06:03:59.279 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com'
2022-07-09T06:03:59.547 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64
2022-07-09T06:03:59.604 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="Red Hat Enterprise Linux"
2022-07-09T06:03:59.605 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="8.6 (Ootpa)"
2022-07-09T06:03:59.605 INFO:teuthology.orchestra.run.smithi192.stdout:ID="rhel"
2022-07-09T06:03:59.605 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="fedora"
2022-07-09T06:03:59.606 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="8.6"
2022-07-09T06:03:59.606 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el8"
2022-07-09T06:03:59.606 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2022-07-09T06:03:59.606 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31"
2022-07-09T06:03:59.606 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2022-07-09T06:03:59.607 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://www.redhat.com/"
2022-07-09T06:03:59.607 INFO:teuthology.orchestra.run.smithi192.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-07-09T06:03:59.607 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-07-09T06:03:59.607 INFO:teuthology.orchestra.run.smithi192.stdout:
2022-07-09T06:03:59.608 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-07-09T06:03:59.608 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2022-07-09T06:03:59.608 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-07-09T06:03:59.608 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2022-07-09T06:03:59.609 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server
2022-07-09T06:03:59.640 INFO:teuthology.lock.ops:Updating [smithi202.front.sepia.ceph.com]: set os type and version on server
2022-07-09T06:03:59.641 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi202.front.sepia.ceph.com'
2022-07-09T06:03:59.840 INFO:teuthology.orchestra.run.smithi202.stdout:x86_64
2022-07-09T06:03:59.899 INFO:teuthology.orchestra.run.smithi202.stdout:NAME="Red Hat Enterprise Linux"
2022-07-09T06:03:59.900 INFO:teuthology.orchestra.run.smithi202.stdout:VERSION="8.6 (Ootpa)"
2022-07-09T06:03:59.900 INFO:teuthology.orchestra.run.smithi202.stdout:ID="rhel"
2022-07-09T06:03:59.901 INFO:teuthology.orchestra.run.smithi202.stdout:ID_LIKE="fedora"
2022-07-09T06:03:59.902 INFO:teuthology.orchestra.run.smithi202.stdout:VERSION_ID="8.6"
2022-07-09T06:03:59.903 INFO:teuthology.orchestra.run.smithi202.stdout:PLATFORM_ID="platform:el8"
2022-07-09T06:03:59.903 INFO:teuthology.orchestra.run.smithi202.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2022-07-09T06:03:59.904 INFO:teuthology.orchestra.run.smithi202.stdout:ANSI_COLOR="0;31"
2022-07-09T06:03:59.904 INFO:teuthology.orchestra.run.smithi202.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2022-07-09T06:03:59.905 INFO:teuthology.orchestra.run.smithi202.stdout:HOME_URL="https://www.redhat.com/"
2022-07-09T06:03:59.905 INFO:teuthology.orchestra.run.smithi202.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-07-09T06:03:59.906 INFO:teuthology.orchestra.run.smithi202.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-07-09T06:03:59.906 INFO:teuthology.orchestra.run.smithi202.stdout:
2022-07-09T06:03:59.906 INFO:teuthology.orchestra.run.smithi202.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-07-09T06:03:59.907 INFO:teuthology.orchestra.run.smithi202.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2022-07-09T06:03:59.907 INFO:teuthology.orchestra.run.smithi202.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-07-09T06:03:59.908 INFO:teuthology.orchestra.run.smithi202.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2022-07-09T06:03:59.909 INFO:teuthology.lock.ops:Updating smithi202.front.sepia.ceph.com on lock server
2022-07-09T06:04:00.085 INFO:teuthology.dispatcher.supervisor:Running job 6921372
2022-07-09T06:04:00.085 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_10062088f503b43eff3624326bda825b23438f9b/virtualenv/bin/teuthology -v --owner scheduled_ksirivad@teuthology --archive /home/teuthworker/archive/ksirivad-2022-07-09_05:39:52-rados:thrash-erasure-code-main-distro-default-smithi/6921372 --name ksirivad-2022-07-09_05:39:52-rados:thrash-erasure-code-main-distro-default-smithi --description rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced} -- /home/teuthworker/archive/ksirivad-2022-07-09_05:39:52-rados:thrash-erasure-code-main-distro-default-smithi/6921372/orig.config.yaml
2022-07-09T06:04:00.092 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/ksirivad-2022-07-09_05:39:52-rados:thrash-erasure-code-main-distro-default-smithi/6921372
2022-07-09T06:04:00.093 INFO:teuthology.dispatcher.supervisor:Job PID: 8569
2022-07-09T06:04:00.094 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-07-09T18:05:03.943 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-07-09T18:05:04.150 INFO:teuthology.kill:Killing Pids: {8569}
2022-07-09T18:05:05.556 INFO:teuthology.task.internal:roles: ubuntu@smithi192.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2022-07-09T18:05:05.557 INFO:teuthology.task.internal:roles: ubuntu@smithi202.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2022-07-09T18:05:05.558 INFO:teuthology.misc:Compressing logs...
2022-07-09T18:05:05.559 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com'
2022-07-09T18:05:05.769 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi202.front.sepia.ceph.com'
2022-07-09T18:05:06.090 INFO:teuthology.misc:Compressing logs...
2022-07-09T18:05:07.138 INFO:teuthology.orchestra.run.smithi192.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-07-09T18:05:07.165 INFO:teuthology.orchestra.run.smithi202.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-07-09T18:05:07.791 INFO:teuthology.misc:Compressing logs...
2022-07-09T18:05:14.998 INFO:teuthology.kill:No teuthology processes running
2022-07-09T18:05:16.446 INFO:teuthology.kill:Nuking machines: ['smithi192', 'smithi202']
2022-07-09T18:05:17.686 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_10062088f503b43eff3624326bda825b23438f9b/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2022-07-09T18:05:17.687 INFO:teuthology.kill:  from cryptography.hazmat.backends import default_backend
2022-07-09T18:05:17.687 INFO:teuthology.kill:2022-07-09 18:05:17,686.686 INFO:teuthology.nuke:targets:
2022-07-09T18:05:17.688 INFO:teuthology.kill:  smithi192.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEzaGSEp6mMj2NGXz7U7VEFG7r10Yi470LH5QTqVdNV1EoB9kwyEimYj0fgZu59S4dMG702UP1pCSC06Mz2NIScHWxqP+R1eCl0F5hYW35k3gRA5LwbdmyZkHMzHjmoeNtp2nuMBRj1uTfjk8VL2qtUN+3who5H3gOhva41Rk+JkXNf9ewkuKRN8dmPRx4pejZdz+IohMUPbaEcdAfljwsDUHKb7SMFihdpqPH9Ys9vWlgtoVyH7Wnyy0ctcL/ya9A3aqqJQbG8bRgihjDbccMhdfwlLsF88g51/dJ5HCQBNy38JjuWsDxd/llZAJY7PhbbnyzhYdxwaZQQCWL5DU44yKrmgYoLB3YK3fJKwtMJDgawfU7nEglTk55KcfmUha+FfFwgK0qqXJ44I8IicECFOQG48kHBH0+I9NRgzAeN8jVcLG9Jmh+hXUAtFpYcib3rj+8h92XfJgHeJQvqlRmxMRYwNezeFxUsHcQC3XYONo2isg7OToUkW8RYg2K6nM=
2022-07-09T18:05:17.688 INFO:teuthology.kill:  smithi202.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPAVkKQJYwoW3dy10WV32kHXMG7pwHMRPzpvxoRBG2M9eYUbnkVT5wHPNHHD+pMtAy5/QpfSVlHbhuluIaTvqoBmJonX9Ha4vMo6APv5lqSbh9BBXfFTfLf2vGNPyqD7ufV8xlUL9iI/g0cJd+QzqMw+C8nEBystwpRt/Ey/r5QUyrqLctFivdg28Jz5hlkl2d70tEy644FhXsmI7q0H9iw3lBst/29gd7hHlk+51YDGc1JBiM1/Q83DtvZ2jI5bk/nyxeqqyE1cdfvjz/sK/zDO+H+ETqn83O9mgeFCFDryMNDhHQYiHcq1JGgrfm0AbIEsH+uAHVeSNIxMw1Nj9kImFuJmrgReKqOEXxEVt6yYjD7v76BdT6yL/AIOGo5Bod4sIYeIpFC3SnP36afiYEa8lELvW+f2L5BesxON2lisu35IJ6ElbPZw9O7pdfbnwn8ZeKebU5LiSlmzh6a9v6m0dZmDmbf2Sd2uf1tvfWUfN0d6C8+/6X9ZACjPVwJrk=
2022-07-09T18:05:17.688 INFO:teuthology.kill:2022-07-09 18:05:17,686.686 INFO:teuthology.nuke:Checking targets against current locks
2022-07-09T18:05:17.750 INFO:teuthology.kill:2022-07-09 18:05:17,750.750 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-07-09T18:05:17.772 INFO:teuthology.kill:2022-07-09 18:05:17,771.771 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-07-09T18:05:17.839 INFO:teuthology.kill:2022-07-09 18:05:17,839.839 INFO:teuthology.orchestra.console:Power off smithi192
2022-07-09T18:05:17.880 INFO:teuthology.kill:2022-07-09 18:05:17,879.879 INFO:teuthology.orchestra.console:Power off smithi202
2022-07-09T18:05:30.327 INFO:teuthology.kill:2022-07-09 18:05:30,327.327 INFO:teuthology.orchestra.console:Power off for smithi192 completed
2022-07-09T18:05:30.358 INFO:teuthology.kill:2022-07-09 18:05:30,357.357 INFO:teuthology.orchestra.console:Power off for smithi202 completed
2022-07-09T18:05:30.491 INFO:teuthology.kill:2022-07-09 18:05:30,490.490 INFO:teuthology.lock.ops:unlocked: smithi192.front.sepia.ceph.com
2022-07-09T18:05:30.508 INFO:teuthology.kill:2022-07-09 18:05:30,508.508 INFO:teuthology.lock.ops:unlocked: smithi202.front.sepia.ceph.com
2022-07-09T18:07:30.867 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-07-09T18:07:30.982 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi202 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-07-09_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6921567