2022-07-09T05:56:41.511 INFO:root:teuthology version: 1.1.1.dev381+g10062088
2022-07-09T05:56:41.862 INFO:teuthology.lock.ops:Start node 'smithi116.front.sepia.ceph.com' reimaging
2022-07-09T05:56:41.866 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: reset os type and version on server
2022-07-09T05:56:41.866 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server
2022-07-09T05:56:41.909 INFO:teuthology.lock.ops:Node 'smithi116.front.sepia.ceph.com' reimaging is complete
2022-07-09T05:56:41.909 INFO:teuthology.lock.ops:Start node 'smithi135.front.sepia.ceph.com' reimaging
2022-07-09T05:56:41.910 INFO:teuthology.lock.ops:Updating [smithi135.front.sepia.ceph.com]: reset os type and version on server
2022-07-09T05:56:41.910 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server
2022-07-09T05:56:41.978 INFO:teuthology.lock.ops:Node 'smithi135.front.sepia.ceph.com' reimaging is complete
2022-07-09T05:56:42.234 INFO:teuthology.provision.fog.smithi116:Scheduling deploy of rhel 8.6
2022-07-09T05:56:42.290 INFO:teuthology.provision.fog.smithi135:Scheduling deploy of rhel 8.6
2022-07-09T05:56:42.853 INFO:teuthology.orchestra.console:Power off smithi116
2022-07-09T05:56:42.937 INFO:teuthology.orchestra.console:Power off smithi135
2022-07-09T05:56:51.426 INFO:teuthology.orchestra.console:Power off for smithi116 completed
2022-07-09T05:56:51.453 INFO:teuthology.orchestra.console:Power off for smithi135 completed
2022-07-09T05:56:51.536 INFO:teuthology.orchestra.console:Power on smithi116
2022-07-09T05:56:51.592 INFO:teuthology.orchestra.console:Power on smithi135
2022-07-09T05:57:00.258 INFO:teuthology.orchestra.console:Power on for smithi135 completed
2022-07-09T05:57:00.298 INFO:teuthology.orchestra.console:Power on for smithi116 completed
2022-07-09T05:57:00.375 INFO:teuthology.provision.fog.smithi135:Waiting for deploy to finish
2022-07-09T05:57:00.419 INFO:teuthology.provision.fog.smithi116:Waiting for deploy to finish
2022-07-09T06:01:13.417 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-07-09T06:01:32.801 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-07-09T06:01:33.031 INFO:teuthology.provision.fog.smithi116:Node is ready
2022-07-09T06:01:33.109 INFO:teuthology.orchestra.run.smithi116.stdout:smithi116.front.sepia.ceph.com
2022-07-09T06:01:33.178 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.15.116 smithi116.front.sepia.ceph.com smithi116
2022-07-09T06:01:33.672 INFO:teuthology.provision.fog.smithi116:Deploy complete!
2022-07-09T06:01:36.045 INFO:teuthology.provision.fog.smithi135:Node is ready
2022-07-09T06:01:36.074 INFO:teuthology.orchestra.run.smithi135.stdout:smithi086
2022-07-09T06:01:36.345 INFO:teuthology.provision.fog.smithi135:Deploy complete!
2022-07-09T06:01:36.620 INFO:teuthology.lock.ops:Checking smithi116.front.sepia.ceph.com
2022-07-09T06:01:36.621 INFO:teuthology.lock.ops:New key found. Updating...
2022-07-09T06:01:36.660 INFO:teuthology.lock.ops:Checking smithi135.front.sepia.ceph.com
2022-07-09T06:01:36.663 INFO:teuthology.lock.ops:New key found. Updating...
2022-07-09T06:01:36.702 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: set os type and version on server
2022-07-09T06:01:36.702 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com'
2022-07-09T06:01:37.023 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64
2022-07-09T06:01:37.084 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="Red Hat Enterprise Linux"
2022-07-09T06:01:37.084 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="8.6 (Ootpa)"
2022-07-09T06:01:37.084 INFO:teuthology.orchestra.run.smithi116.stdout:ID="rhel"
2022-07-09T06:01:37.085 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="fedora"
2022-07-09T06:01:37.085 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="8.6"
2022-07-09T06:01:37.085 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el8"
2022-07-09T06:01:37.086 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2022-07-09T06:01:37.086 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31"
2022-07-09T06:01:37.087 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2022-07-09T06:01:37.087 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://www.redhat.com/"
2022-07-09T06:01:37.088 INFO:teuthology.orchestra.run.smithi116.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-07-09T06:01:37.088 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-07-09T06:01:37.089 INFO:teuthology.orchestra.run.smithi116.stdout:
2022-07-09T06:01:37.089 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-07-09T06:01:37.090 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2022-07-09T06:01:37.091 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-07-09T06:01:37.091 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2022-07-09T06:01:37.099 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server
2022-07-09T06:01:37.176 INFO:teuthology.lock.ops:Updating [smithi135.front.sepia.ceph.com]: set os type and version on server
2022-07-09T06:01:37.177 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com'
2022-07-09T06:01:37.568 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64
2022-07-09T06:01:37.632 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="Red Hat Enterprise Linux"
2022-07-09T06:01:37.632 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="8.6 (Ootpa)"
2022-07-09T06:01:37.633 INFO:teuthology.orchestra.run.smithi135.stdout:ID="rhel"
2022-07-09T06:01:37.633 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="fedora"
2022-07-09T06:01:37.634 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="8.6"
2022-07-09T06:01:37.646 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el8"
2022-07-09T06:01:37.646 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2022-07-09T06:01:37.647 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31"
2022-07-09T06:01:37.647 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2022-07-09T06:01:37.647 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://www.redhat.com/"
2022-07-09T06:01:37.648 INFO:teuthology.orchestra.run.smithi135.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-07-09T06:01:37.648 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-07-09T06:01:37.649 INFO:teuthology.orchestra.run.smithi135.stdout:
2022-07-09T06:01:37.649 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-07-09T06:01:37.650 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2022-07-09T06:01:37.653 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-07-09T06:01:37.653 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2022-07-09T06:01:37.654 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server
2022-07-09T06:01:37.871 INFO:teuthology.dispatcher.supervisor:Running job 6921368
2022-07-09T06:01:37.871 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_10062088f503b43eff3624326bda825b23438f9b/virtualenv/bin/teuthology -v --owner scheduled_ksirivad@teuthology --archive /home/teuthworker/archive/ksirivad-2022-07-09_05:39:52-rados:thrash-erasure-code-main-distro-default-smithi/6921368 --name ksirivad-2022-07-09_05:39:52-rados:thrash-erasure-code-main-distro-default-smithi --description rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced} -- /home/teuthworker/archive/ksirivad-2022-07-09_05:39:52-rados:thrash-erasure-code-main-distro-default-smithi/6921368/orig.config.yaml
2022-07-09T06:01:37.882 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/ksirivad-2022-07-09_05:39:52-rados:thrash-erasure-code-main-distro-default-smithi/6921368
2022-07-09T06:01:37.883 INFO:teuthology.dispatcher.supervisor:Job PID: 12423
2022-07-09T06:01:37.884 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-07-09T18:02:41.391 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-07-09T18:02:41.568 INFO:teuthology.kill:Killing Pids: {12423}
2022-07-09T18:02:43.060 INFO:teuthology.task.internal:roles: ubuntu@smithi116.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2022-07-09T18:02:43.061 INFO:teuthology.task.internal:roles: ubuntu@smithi135.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2022-07-09T18:02:43.061 INFO:teuthology.misc:Compressing logs...
2022-07-09T18:02:43.062 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com'
2022-07-09T18:02:43.265 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com'
2022-07-09T18:02:43.616 INFO:teuthology.misc:Compressing logs...
2022-07-09T18:02:44.571 INFO:teuthology.orchestra.run.smithi135.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-07-09T18:02:44.812 INFO:teuthology.orchestra.run.smithi116.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-07-09T18:02:45.446 INFO:teuthology.misc:Compressing logs...
2022-07-09T18:03:02.082 INFO:teuthology.kill:No teuthology processes running
2022-07-09T18:03:03.504 INFO:teuthology.kill:Nuking machines: ['smithi116', 'smithi135']
2022-07-09T18:03:04.612 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_10062088f503b43eff3624326bda825b23438f9b/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2022-07-09T18:03:04.613 INFO:teuthology.kill:  from cryptography.hazmat.backends import default_backend
2022-07-09T18:03:04.613 INFO:teuthology.kill:2022-07-09 18:03:04,611.611 INFO:teuthology.nuke:targets:
2022-07-09T18:03:04.613 INFO:teuthology.kill:  smithi116.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDK230A3xyrO9KTXpUsnZ+VibDwnEIbBoJoDuJmiGESxLx9sLla/kxC+XpNhljNYpxwAWD+zvxUAmWGe9p4Iadh4f6BYCxGRoPU9DTSrmHfclWUwijJWeCVtlSv5TEwgbybhBUpwTCvTapyR2AiI284YlxnAcRpwbAwxUW/aTThSTGRH2s4ETVLy4bMHbY6cLgXfClSnAGR6BYKgnLRFjyKUo5rrJGPGhCdkoLFt2VOK1EpD3Bacp1FFzaH3BZP2iqo5NzJicMYN5AsQt0QWwcXlnHomCf4AIClmodEC11Wu42Fpho0A6YjaHOOGulfTDpm+aLDF/UpS0WcmpcBrEjOWBQZYW8955hAHiKukEMSsr0zISBHgZOBa8cpWnmUij4t+6Jq86utHazfitOREGNeRc4dJ50zPlIorQ4WvekeIDPDOJGa4Xx7CnuwQbYM1KP+c61dsU6zlSO0SnZAR6Mggx9LcoomycwEnWdVmgdRsfS6eGZ6jx3TWPKrdHYrJBE=
2022-07-09T18:03:04.614 INFO:teuthology.kill:  smithi135.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6ZFAC6zY1lD6kbxW/QO8FEFuspQhh/YEeb1tK1/kf5w/4fhvVY/i6hwTkXQe2TeVP3w0epx/uRiv/SvKPpUWKpscdA9cx7mhRDel0Oo+09PbHOBIvnMmVsu6gE+m1xOuoCmpY4K7Vl0rjvG+LUdSjRqBIgrONV75LsFvkZVGJ3wS3AWFozZQStICp4t/FpwtZVKQWAL30T5dfraBWqQLactXNX2QZGhk6ghtH4pvUPh1Pv6cwaLnJ870E6rgVTB9PLY3IX1O+ndai5rwSMkskQtGgPvjWsvejQv3+gNHGQzn9ygjZYDpciaplzloF4g/9H4JupihO5gZF8VlNGCgJMXKWNpNzIPkpCEdHruh+0EMjTlvV5YgrIm4A7c8VMk7e6iY3tSsWEczEdKy/dBrkpwP2QpcxdEJRzb3njoX+ROYQ9DqYuQ3+60lXTkrYrbkTqNdMjFl6eqzhmpA0pVObocd+smtm7p8/WlZyOYquKMo30RjxFaBI8K0W8pAfZxk=
2022-07-09T18:03:04.614 INFO:teuthology.kill:2022-07-09 18:03:04,611.611 INFO:teuthology.nuke:Checking targets against current locks
2022-07-09T18:03:04.676 INFO:teuthology.kill:2022-07-09 18:03:04,676.676 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-07-09T18:03:04.703 INFO:teuthology.kill:2022-07-09 18:03:04,702.702 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-07-09T18:03:04.773 INFO:teuthology.kill:2022-07-09 18:03:04,772.772 INFO:teuthology.orchestra.console:Power off smithi116
2022-07-09T18:03:04.796 INFO:teuthology.kill:2022-07-09 18:03:04,795.795 INFO:teuthology.orchestra.console:Power off smithi135
2022-07-09T18:03:17.264 INFO:teuthology.kill:2022-07-09 18:03:17,264.264 INFO:teuthology.orchestra.console:Power off for smithi116 completed
2022-07-09T18:03:17.269 INFO:teuthology.kill:2022-07-09 18:03:17,269.269 INFO:teuthology.orchestra.console:Power off for smithi135 completed
2022-07-09T18:03:17.435 INFO:teuthology.kill:2022-07-09 18:03:17,434.434 INFO:teuthology.lock.ops:unlocked: smithi116.front.sepia.ceph.com
2022-07-09T18:03:17.437 INFO:teuthology.kill:2022-07-09 18:03:17,437.437 INFO:teuthology.lock.ops:unlocked: smithi135.front.sepia.ceph.com
2022-07-09T18:05:17.799 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-07-09T18:05:17.926 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi116 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-07-09_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6921566
2022-07-09T18:05:17.927 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi135 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-07-09_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6921566