2022-09-01T12:09:21.956 INFO:root:teuthology version: 1.1.1.dev418+gb58f2c18
2022-09-01T12:09:22.112 INFO:teuthology.lock.ops:Start node 'smithi109.front.sepia.ceph.com' reimaging
2022-09-01T12:09:22.113 INFO:teuthology.lock.ops:Updating [smithi109.front.sepia.ceph.com]: reset os type and version on server
2022-09-01T12:09:22.113 INFO:teuthology.lock.ops:Updating smithi109.front.sepia.ceph.com on lock server
2022-09-01T12:09:22.143 INFO:teuthology.lock.ops:Node 'smithi109.front.sepia.ceph.com' reimaging is complete
2022-09-01T12:09:22.143 INFO:teuthology.lock.ops:Start node 'smithi124.front.sepia.ceph.com' reimaging
2022-09-01T12:09:22.144 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: reset os type and version on server
2022-09-01T12:09:22.145 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server
2022-09-01T12:09:22.172 INFO:teuthology.lock.ops:Node 'smithi124.front.sepia.ceph.com' reimaging is complete
2022-09-01T12:09:22.364 INFO:teuthology.provision.fog.smithi109:Scheduling deploy of rhel 8.6
2022-09-01T12:09:22.380 INFO:teuthology.provision.fog.smithi124:Scheduling deploy of rhel 8.6
2022-09-01T12:09:22.678 INFO:teuthology.orchestra.console:Power off smithi109
2022-09-01T12:09:22.695 INFO:teuthology.orchestra.console:Power off smithi124
2022-09-01T12:09:22.830 INFO:teuthology.orchestra.console:Power off for smithi109 completed
2022-09-01T12:09:22.841 INFO:teuthology.orchestra.console:Power off for smithi124 completed
2022-09-01T12:09:22.932 INFO:teuthology.orchestra.console:Power on smithi109
2022-09-01T12:09:22.943 INFO:teuthology.orchestra.console:Power on smithi124
2022-09-01T12:09:27.205 INFO:teuthology.orchestra.console:Power on for smithi109 completed
2022-09-01T12:09:27.306 INFO:teuthology.provision.fog.smithi109:Waiting for deploy to finish
2022-09-01T12:09:31.328 INFO:teuthology.orchestra.console:Power on for smithi124 completed
2022-09-01T12:09:31.433 INFO:teuthology.provision.fog.smithi124:Waiting for deploy to finish
2022-09-01T12:11:58.373 ERROR:teuthology.orchestra.connection:Error authenticating with smithi109.front.sepia.ceph.com: Authentication failed.
2022-09-01T12:13:32.792 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-09-01T12:13:43.532 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-09-01T12:13:58.298 INFO:teuthology.provision.fog.smithi109:Node is ready
2022-09-01T12:13:58.318 INFO:teuthology.orchestra.run.smithi109.stdout:smithi109.front.sepia.ceph.com
2022-09-01T12:13:58.375 INFO:teuthology.orchestra.run.smithi109.stdout:172.21.15.109 smithi109.front.sepia.ceph.com smithi109
2022-09-01T12:13:58.740 INFO:teuthology.provision.fog.smithi109:Deploy complete!
2022-09-01T12:14:08.797 INFO:teuthology.provision.fog.smithi124:Node is ready
2022-09-01T12:14:08.817 INFO:teuthology.orchestra.run.smithi124.stdout:smithi124.front.sepia.ceph.com
2022-09-01T12:14:08.874 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.15.124 smithi124.front.sepia.ceph.com smithi124
2022-09-01T12:14:09.239 INFO:teuthology.provision.fog.smithi124:Deploy complete!
2022-09-01T12:14:09.429 INFO:teuthology.lock.ops:Checking smithi109.front.sepia.ceph.com
2022-09-01T12:14:09.430 INFO:teuthology.lock.ops:New key found. Updating...
2022-09-01T12:14:09.451 INFO:teuthology.lock.ops:Checking smithi124.front.sepia.ceph.com
2022-09-01T12:14:09.452 INFO:teuthology.lock.ops:New key found. Updating...
2022-09-01T12:14:09.473 INFO:teuthology.lock.ops:Updating [smithi109.front.sepia.ceph.com]: set os type and version on server
2022-09-01T12:14:09.474 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi109.front.sepia.ceph.com'
2022-09-01T12:14:09.754 INFO:teuthology.orchestra.run.smithi109.stdout:x86_64
2022-09-01T12:14:09.813 INFO:teuthology.orchestra.run.smithi109.stdout:NAME="Red Hat Enterprise Linux"
2022-09-01T12:14:09.813 INFO:teuthology.orchestra.run.smithi109.stdout:VERSION="8.6 (Ootpa)"
2022-09-01T12:14:09.813 INFO:teuthology.orchestra.run.smithi109.stdout:ID="rhel"
2022-09-01T12:14:09.814 INFO:teuthology.orchestra.run.smithi109.stdout:ID_LIKE="fedora"
2022-09-01T12:14:09.814 INFO:teuthology.orchestra.run.smithi109.stdout:VERSION_ID="8.6"
2022-09-01T12:14:09.814 INFO:teuthology.orchestra.run.smithi109.stdout:PLATFORM_ID="platform:el8"
2022-09-01T12:14:09.814 INFO:teuthology.orchestra.run.smithi109.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2022-09-01T12:14:09.814 INFO:teuthology.orchestra.run.smithi109.stdout:ANSI_COLOR="0;31"
2022-09-01T12:14:09.815 INFO:teuthology.orchestra.run.smithi109.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2022-09-01T12:14:09.815 INFO:teuthology.orchestra.run.smithi109.stdout:HOME_URL="https://www.redhat.com/"
2022-09-01T12:14:09.815 INFO:teuthology.orchestra.run.smithi109.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-09-01T12:14:09.815 INFO:teuthology.orchestra.run.smithi109.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-09-01T12:14:09.816 INFO:teuthology.orchestra.run.smithi109.stdout:
2022-09-01T12:14:09.816 INFO:teuthology.orchestra.run.smithi109.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-09-01T12:14:09.816 INFO:teuthology.orchestra.run.smithi109.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2022-09-01T12:14:09.816 INFO:teuthology.orchestra.run.smithi109.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-09-01T12:14:09.817 INFO:teuthology.orchestra.run.smithi109.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2022-09-01T12:14:09.818 INFO:teuthology.lock.ops:Updating smithi109.front.sepia.ceph.com on lock server
2022-09-01T12:14:09.837 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: set os type and version on server
2022-09-01T12:14:09.838 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com'
2022-09-01T12:14:10.046 INFO:teuthology.orchestra.run.smithi124.stdout:x86_64
2022-09-01T12:14:10.102 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="Red Hat Enterprise Linux"
2022-09-01T12:14:10.103 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="8.6 (Ootpa)"
2022-09-01T12:14:10.103 INFO:teuthology.orchestra.run.smithi124.stdout:ID="rhel"
2022-09-01T12:14:10.103 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="fedora"
2022-09-01T12:14:10.103 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="8.6"
2022-09-01T12:14:10.104 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el8"
2022-09-01T12:14:10.104 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2022-09-01T12:14:10.104 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31"
2022-09-01T12:14:10.104 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2022-09-01T12:14:10.104 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://www.redhat.com/"
2022-09-01T12:14:10.105 INFO:teuthology.orchestra.run.smithi124.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-09-01T12:14:10.105 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-09-01T12:14:10.106 INFO:teuthology.orchestra.run.smithi124.stdout:
2022-09-01T12:14:10.106 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-09-01T12:14:10.107 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2022-09-01T12:14:10.107 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-09-01T12:14:10.108 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2022-09-01T12:14:10.109 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server
2022-09-01T12:14:10.228 INFO:teuthology.dispatcher.supervisor:Running job 7004144
2022-09-01T12:14:10.229 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2022-09-01_10:32:47-rados-WIP_GBH_snap_mapper_one_way-distro-default-smithi/7004144 --name benhanokh-2022-09-01_10:32:47-rados-WIP_GBH_snap_mapper_one_way-distro-default-smithi --description rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} -- /home/teuthworker/archive/benhanokh-2022-09-01_10:32:47-rados-WIP_GBH_snap_mapper_one_way-distro-default-smithi/7004144/orig.config.yaml
2022-09-01T12:14:10.234 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2022-09-01_10:32:47-rados-WIP_GBH_snap_mapper_one_way-distro-default-smithi/7004144
2022-09-01T12:14:10.235 INFO:teuthology.dispatcher.supervisor:Job PID: 12442
2022-09-01T12:14:10.236 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-09-02T00:14:34.905 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-09-02T00:14:35.298 INFO:teuthology.kill:Killing Pids: {12442}
2022-09-02T00:14:39.442 INFO:teuthology.task.internal:roles: ubuntu@smithi109.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2022-09-02T00:14:39.443 INFO:teuthology.task.internal:roles: ubuntu@smithi124.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2022-09-02T00:14:39.444 INFO:teuthology.misc:Compressing logs...
2022-09-02T00:14:39.444 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi109.front.sepia.ceph.com'
2022-09-02T00:14:39.849 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com'
2022-09-02T00:14:40.317 INFO:teuthology.misc:Compressing logs...
2022-09-02T00:14:41.257 INFO:teuthology.orchestra.run.smithi109.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-09-02T00:14:41.585 INFO:teuthology.orchestra.run.smithi124.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-09-02T00:15:19.525 INFO:teuthology.misc:Compressing logs...
2022-09-02T00:15:22.105 INFO:teuthology.kill:No teuthology processes running
2022-09-02T00:15:24.570 INFO:teuthology.kill:Nuking machines: ['smithi109', 'smithi124']
2022-09-02T00:15:26.643 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2022-09-02T00:15:26.644 INFO:teuthology.kill:  from cryptography.hazmat.backends import default_backend
2022-09-02T00:15:26.644 INFO:teuthology.kill:2022-09-02 00:15:26,643.643 INFO:teuthology.nuke:targets:
2022-09-02T00:15:26.645 INFO:teuthology.kill:  smithi109.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCddOWcyCF8Vipxe3FInh0f8/xZzrBtQnW/zB/xotgj9W5Gsga1KfmRMzDaczX5mZYvAS712izLFRGExNlgCQFQahdxGW3P+H1ySJy3oWF+h5s1Xe0qdsQxROesJkxIz/DzOrYrDvAdil4Y8BsgMsPH3C24nVHXI5gispGiFPiHKeQ26gpV6b6KN+prpTOg6yRRzzdSjsHOjA2G6sZX1X9iUfflDo/jym8rQaP0uezLyBEjIw8h/uyTjoWMED1n3jtKY5aO1mxLPr6e5799TRp5rRifr5RH9BHvLj+c4kGBapOvBK9MXliXsGAPEBEHqiY3wa4haEvnTm5TxYnOPNzf/CFqPCwhd177YM8PIMopnuc57H67/fSPrp+Klfvm6mKGRmTrZbUxC4CaXPcRqBZ8ZlW4h0SV4XMMpv56NjCheo4cBdR7kzEIetHK3PX4CbXotaWaZ9A5U+3Ps8vumE+izN53dt66EApBOk2WNANwq/sL+AC3TYR7ACNolV8DH3k=
2022-09-02T00:15:26.645 INFO:teuthology.kill:  smithi124.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCngbdX/NW5Ttk9IPBITKFlxpA/HOyM80JuYcEK7D8W6WwAZ2rn4t7TtijLkjhW2ssrqIiiY3R6SA72uvUo2tjyPq/HpGErAN7p+g6dIVhM1YE3x5vb3ZbA5UaTyjHXdAGNqQjsKZ5kINJHXFZBcwjwN6xu7SwhQJumHQIRjNjXj3oPGJ+nIg7rkbAqpL4qyBgsKtd8qnbgVjreWkT67JiZgJCkYxv4oyfNoGuPC00eFYVpIrQKTjjA2hTJfhEPdssDWxzJ/R6WouG/vBRg+JYh7//JotdAKUOWMVNCj6ROehXnKMbkA7wbnDemRHuoTEvSoJmHxehe2y9qIRe4gLHfHRhl3gvDj3+UR14eXLNrh4HEDBINuOtjjPQNObyYczw9j028OYG1zkjeKMTgRmBawybAByGtUno+G59EPFS/TPMtTnFnLnNANqtAQMnTkShPxh2v9xd6pN5IqqMIcttx4c40+7sxyBUE23vXZvotCMz+nW5mvnTNYkpKoGFweu8=
2022-09-02T00:15:26.646 INFO:teuthology.kill:2022-09-02 00:15:26,645.645 INFO:teuthology.nuke:Checking targets against current locks
2022-09-02T00:15:26.721 INFO:teuthology.kill:2022-09-02 00:15:26,720.720 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-09-02T00:15:26.770 INFO:teuthology.kill:2022-09-02 00:15:26,770.770 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-09-02T00:15:26.889 INFO:teuthology.kill:2022-09-02 00:15:26,888.888 INFO:teuthology.orchestra.console:Power off smithi109
2022-09-02T00:15:26.970 INFO:teuthology.kill:2022-09-02 00:15:26,969.969 INFO:teuthology.orchestra.console:Power off smithi124
2022-09-02T00:15:35.340 INFO:teuthology.kill:2022-09-02 00:15:35,338.338 INFO:teuthology.orchestra.console:Power off for smithi109 completed
2022-09-02T00:15:35.516 INFO:teuthology.kill:2022-09-02 00:15:35,514.514 INFO:teuthology.lock.ops:unlocked: smithi109.front.sepia.ceph.com
2022-09-02T00:15:39.504 INFO:teuthology.kill:2022-09-02 00:15:39,504.504 INFO:teuthology.orchestra.console:Power off for smithi124 completed
2022-09-02T00:15:39.678 INFO:teuthology.kill:2022-09-02 00:15:39,675.675 INFO:teuthology.lock.ops:unlocked: smithi124.front.sepia.ceph.com
2022-09-02T00:17:40.102 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-09-02T00:17:40.229 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi109 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-09-01_20:33:38-rados-wip-yuri6-testing-2022-09-01-1034-quincy-distro-default-smithi/7005952
2022-09-02T00:17:40.230 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi124 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-09-01_20:33:38-rados-wip-yuri6-testing-2022-09-01-1034-quincy-distro-default-smithi/7005954