2022-09-15T17:19:33.807 INFO:root:teuthology version: 1.1.1.dev418+gb58f2c18
2022-09-15T17:19:33.955 INFO:teuthology.lock.ops:Start node 'smithi078.front.sepia.ceph.com' reimaging
2022-09-15T17:19:33.957 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: reset os type and version on server
2022-09-15T17:19:33.958 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server
2022-09-15T17:19:33.980 INFO:teuthology.lock.ops:Node 'smithi078.front.sepia.ceph.com' reimaging is complete
2022-09-15T17:19:33.980 INFO:teuthology.lock.ops:Start node 'smithi093.front.sepia.ceph.com' reimaging
2022-09-15T17:19:33.981 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: reset os type and version on server
2022-09-15T17:19:33.981 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server
2022-09-15T17:19:34.006 INFO:teuthology.lock.ops:Node 'smithi093.front.sepia.ceph.com' reimaging is complete
2022-09-15T17:19:34.201 INFO:teuthology.provision.fog.smithi078:Scheduling deploy of rhel 8.6
2022-09-15T17:19:34.227 INFO:teuthology.provision.fog.smithi093:Scheduling deploy of rhel 8.6
2022-09-15T17:19:34.515 INFO:teuthology.orchestra.console:Power off smithi078
2022-09-15T17:19:34.561 INFO:teuthology.orchestra.console:Power off smithi093
2022-09-15T17:19:42.933 INFO:teuthology.orchestra.console:Power off for smithi093 completed
2022-09-15T17:19:43.035 INFO:teuthology.orchestra.console:Power on smithi093
2022-09-15T17:19:47.032 INFO:teuthology.orchestra.console:Power off for smithi078 completed
2022-09-15T17:19:47.134 INFO:teuthology.orchestra.console:Power on smithi078
2022-09-15T17:19:51.452 INFO:teuthology.orchestra.console:Power on for smithi078 completed
2022-09-15T17:19:51.473 INFO:teuthology.orchestra.console:Power on for smithi093 completed
2022-09-15T17:19:51.554 INFO:teuthology.provision.fog.smithi078:Waiting for deploy to finish
2022-09-15T17:19:51.574 INFO:teuthology.provision.fog.smithi093:Waiting for deploy to finish
2022-09-15T17:23:48.662 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-09-15T17:24:13.942 INFO:teuthology.provision.fog.smithi093:Node is ready
2022-09-15T17:24:13.961 INFO:teuthology.orchestra.run.smithi093.stdout:smithi093.front.sepia.ceph.com
2022-09-15T17:24:14.018 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93 smithi093.front.sepia.ceph.com smithi093
2022-09-15T17:24:14.399 INFO:teuthology.provision.fog.smithi093:Deploy complete!
2022-09-15T17:24:29.569 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-09-15T17:24:29.809 INFO:teuthology.provision.fog.smithi078:Node is ready
2022-09-15T17:24:29.870 INFO:teuthology.orchestra.run.smithi078.stdout:smithi078.front.sepia.ceph.com
2022-09-15T17:24:29.931 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78 smithi078.front.sepia.ceph.com smithi078
2022-09-15T17:24:30.310 INFO:teuthology.provision.fog.smithi078:Deploy complete!
2022-09-15T17:24:30.511 INFO:teuthology.lock.ops:Checking smithi078.front.sepia.ceph.com
2022-09-15T17:24:30.513 INFO:teuthology.lock.ops:New key found. Updating...
2022-09-15T17:24:30.535 INFO:teuthology.lock.ops:Checking smithi093.front.sepia.ceph.com
2022-09-15T17:24:30.536 INFO:teuthology.lock.ops:New key found. Updating...
2022-09-15T17:24:30.555 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: set os type and version on server
2022-09-15T17:24:30.556 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com'
2022-09-15T17:24:30.795 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64
2022-09-15T17:24:30.854 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="Red Hat Enterprise Linux"
2022-09-15T17:24:30.855 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="8.6 (Ootpa)"
2022-09-15T17:24:30.855 INFO:teuthology.orchestra.run.smithi078.stdout:ID="rhel"
2022-09-15T17:24:30.855 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="fedora"
2022-09-15T17:24:30.855 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="8.6"
2022-09-15T17:24:30.856 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el8"
2022-09-15T17:24:30.856 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2022-09-15T17:24:30.856 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31"
2022-09-15T17:24:30.856 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2022-09-15T17:24:30.857 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://www.redhat.com/"
2022-09-15T17:24:30.857 INFO:teuthology.orchestra.run.smithi078.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-09-15T17:24:30.857 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-09-15T17:24:30.857 INFO:teuthology.orchestra.run.smithi078.stdout:
2022-09-15T17:24:30.858 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-09-15T17:24:30.858 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2022-09-15T17:24:30.858 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-09-15T17:24:30.858 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2022-09-15T17:24:30.860 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server
2022-09-15T17:24:30.884 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: set os type and version on server
2022-09-15T17:24:30.884 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com'
2022-09-15T17:24:31.160 INFO:teuthology.orchestra.run.smithi093.stdout:x86_64
2022-09-15T17:24:31.219 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="Red Hat Enterprise Linux"
2022-09-15T17:24:31.220 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="8.6 (Ootpa)"
2022-09-15T17:24:31.220 INFO:teuthology.orchestra.run.smithi093.stdout:ID="rhel"
2022-09-15T17:24:31.221 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="fedora"
2022-09-15T17:24:31.221 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="8.6"
2022-09-15T17:24:31.222 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el8"
2022-09-15T17:24:31.223 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2022-09-15T17:24:31.223 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31"
2022-09-15T17:24:31.224 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2022-09-15T17:24:31.225 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://www.redhat.com/"
2022-09-15T17:24:31.225 INFO:teuthology.orchestra.run.smithi093.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-09-15T17:24:31.226 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-09-15T17:24:31.227 INFO:teuthology.orchestra.run.smithi093.stdout:
2022-09-15T17:24:31.228 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-09-15T17:24:31.228 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2022-09-15T17:24:31.228 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-09-15T17:24:31.228 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2022-09-15T17:24:31.229 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server
2022-09-15T17:24:31.347 INFO:teuthology.dispatcher.supervisor:Running job 7034015
2022-09-15T17:24:31.347 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/bin/teuthology -v --owner scheduled_lflores@teuthology --archive /home/teuthworker/archive/lflores-2022-09-15_14:32:14-rados:thrash-erasure-code-main-distro-default-smithi/7034015 --name lflores-2022-09-15_14:32:14-rados:thrash-erasure-code-main-distro-default-smithi --description rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} -- /home/teuthworker/archive/lflores-2022-09-15_14:32:14-rados:thrash-erasure-code-main-distro-default-smithi/7034015/orig.config.yaml
2022-09-15T17:24:31.354 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/lflores-2022-09-15_14:32:14-rados:thrash-erasure-code-main-distro-default-smithi/7034015
2022-09-15T17:24:31.355 INFO:teuthology.dispatcher.supervisor:Job PID: 4368
2022-09-15T17:24:31.355 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-09-16T05:25:30.624 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-09-16T05:25:30.850 INFO:teuthology.kill:Killing Pids: {4368}
2022-09-16T05:25:32.944 INFO:teuthology.task.internal:roles: ubuntu@smithi078.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2022-09-16T05:25:32.945 INFO:teuthology.task.internal:roles: ubuntu@smithi093.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2022-09-16T05:25:32.946 INFO:teuthology.misc:Compressing logs...
2022-09-16T05:25:32.947 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com'
2022-09-16T05:25:33.190 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com'
2022-09-16T05:25:33.617 INFO:teuthology.misc:Compressing logs...
2022-09-16T05:25:34.669 INFO:teuthology.orchestra.run.smithi093.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-09-16T05:25:34.689 INFO:teuthology.orchestra.run.smithi078.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-09-16T05:25:35.347 INFO:teuthology.misc:Compressing logs...
2022-09-16T05:28:20.347 INFO:teuthology.kill:No teuthology processes running
2022-09-16T05:28:21.746 INFO:teuthology.kill:Nuking machines: ['smithi078', 'smithi093']
2022-09-16T05:28:22.908 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2022-09-16T05:28:22.909 INFO:teuthology.kill:  from cryptography.hazmat.backends import default_backend
2022-09-16T05:28:22.909 INFO:teuthology.kill:2022-09-16 05:28:22,908.908 INFO:teuthology.nuke:targets:
2022-09-16T05:28:22.909 INFO:teuthology.kill:  smithi078.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCtqqRXhFmTwToFyDPNSkaK6HD8vOtpeqZlq/QF9VNJnWPZcinJpPsVq4+L3vANY+8kwpvny8zrRVshFITQ0VYL0Ikcp0gztHoGO8wZRmeE6XfJMdFMbSHA8Id6Zu7loyesQ9VAgvhA3j7I4gJs9MiGzGrui1oeDyh5XCp7hbAmbt15hG8VrXHLFIjEIiYUkYXUzrCKakctP91Ow9KJ+AgVzh8l3gv2XXo/NkhpIQEVXP9KbTCX6VooFNru01tMx7ACJ3DAsrObO9PB8BweqV9SQhrpiCIlR4dDn75JVB43qo/OvZQrYRW3FKnLMWXDiV3prxpp3ZymAP+7X4zyPyeg1YvCdS3qkfXno2V6fRlhMzyMYlCGiGUylUOeryXAgUEMMtjTmJMCI6ZIxt14mRc+5JJpt32cwJbY6Q1zQXP5Mq0x+L7NLj/iRBI5/l2tjqaEhzyAoCkHiBWHTrR6LWr9bNz88xGxh+n0haoy4YXU6Hii4NOt4Cjq6FBWfLu6Xs8=
2022-09-16T05:28:22.910 INFO:teuthology.kill:  smithi093.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAvv4ZfXRcObx7CKAA9nGU/P5zaSbBtzFTAdmGlmg1jxrxqv1Qc1z10IDzbYfKo6dlj2kfCzaNgVEJbfbqbMlJcBr2/0An+xKDs5hRyaQTQwfuqEmtTHmtvICHBlhcJ2Erd/2AGxMLt6m8/pbrUbx7glaQFEH+ulpmZgLUBsZ166FffbIUY5Nm+GMcN8TtoAfQF9QBsorZnGWkXEBtAu2GgOe8fdhQupdooSLfEJrZ1T4vg8c0AibZ90/NTFL76FziBxpWWUqooC3RI9si0bAeGZPPlW4xnNV2u28OcI+XhbwKlJj0RSJUMMV9mMrAZZIyJ0ZVUysXIj1cE35fDvrCuONRc4IJ23O1tCo5r4bfCVLG1aXbx2NDtbKXD6CuTL1y9zYd2FDVG08XQzXkU9JMgGZdBabiMl0cO/en75seYJnn+EWAeSXUyR7xOgTbDjEEOkYsESTYnCg9JskV2DoAJFigt4a5shArziUMlHWBlCPqdVH6Xy1S2qW4NixfaVM=
2022-09-16T05:28:22.910 INFO:teuthology.kill:2022-09-16 05:28:22,908.908 INFO:teuthology.nuke:Checking targets against current locks
2022-09-16T05:28:22.964 INFO:teuthology.kill:2022-09-16 05:28:22,964.964 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-09-16T05:28:22.992 INFO:teuthology.kill:2022-09-16 05:28:22,992.992 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-09-16T05:28:23.056 INFO:teuthology.kill:2022-09-16 05:28:23,055.055 INFO:teuthology.orchestra.console:Power off smithi078
2022-09-16T05:28:23.108 INFO:teuthology.kill:2022-09-16 05:28:23,108.108 INFO:teuthology.orchestra.console:Power off smithi093
2022-09-16T05:28:31.478 INFO:teuthology.kill:2022-09-16 05:28:31,477.477 INFO:teuthology.orchestra.console:Power off for smithi093 completed
2022-09-16T05:28:31.629 INFO:teuthology.kill:2022-09-16 05:28:31,628.628 INFO:teuthology.lock.ops:unlocked: smithi093.front.sepia.ceph.com
2022-09-16T05:28:35.557 INFO:teuthology.kill:2022-09-16 05:28:35,556.556 INFO:teuthology.orchestra.console:Power off for smithi078 completed
2022-09-16T05:28:35.707 INFO:teuthology.kill:2022-09-16 05:28:35,707.707 INFO:teuthology.lock.ops:unlocked: smithi078.front.sepia.ceph.com
2022-09-16T05:30:36.079 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-09-16T05:30:36.212 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi078 but it was locked by another job: /home/teuthworker/archive/adking-2022-09-14_12:49:36-fs-wip-adk-testing-2022-09-13-1304-distro-default-smithi/7031863
2022-09-16T05:30:36.213 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi093 but it was locked by another job: /home/teuthworker/archive/adking-2022-09-14_12:49:36-fs-wip-adk-testing-2022-09-13-1304-distro-default-smithi/7031858