2022-09-12T23:50:31.433 INFO:root:teuthology version: 1.1.1.dev418+gb58f2c18 2022-09-12T23:50:31.614 INFO:teuthology.lock.ops:Start node 'smithi018.front.sepia.ceph.com' reimaging 2022-09-12T23:50:31.615 INFO:teuthology.lock.ops:Updating [smithi018.front.sepia.ceph.com]: reset os type and version on server 2022-09-12T23:50:31.616 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server 2022-09-12T23:50:31.641 INFO:teuthology.lock.ops:Node 'smithi018.front.sepia.ceph.com' reimaging is complete 2022-09-12T23:50:31.642 INFO:teuthology.lock.ops:Start node 'smithi071.front.sepia.ceph.com' reimaging 2022-09-12T23:50:31.643 INFO:teuthology.lock.ops:Updating [smithi071.front.sepia.ceph.com]: reset os type and version on server 2022-09-12T23:50:31.644 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2022-09-12T23:50:31.669 INFO:teuthology.lock.ops:Node 'smithi071.front.sepia.ceph.com' reimaging is complete 2022-09-12T23:50:31.875 INFO:teuthology.provision.fog.smithi018:Scheduling deploy of rhel 8.6 2022-09-12T23:50:31.905 INFO:teuthology.provision.fog.smithi071:Scheduling deploy of rhel 8.6 2022-09-12T23:50:32.279 INFO:teuthology.orchestra.console:Power off smithi018 2022-09-12T23:50:32.308 INFO:teuthology.orchestra.console:Power off smithi071 2022-09-12T23:50:40.702 INFO:teuthology.orchestra.console:Power off for smithi018 completed 2022-09-12T23:50:40.804 INFO:teuthology.orchestra.console:Power on smithi018 2022-09-12T23:50:44.835 INFO:teuthology.orchestra.console:Power off for smithi071 completed 2022-09-12T23:50:44.937 INFO:teuthology.orchestra.console:Power on smithi071 2022-09-12T23:50:49.210 INFO:teuthology.orchestra.console:Power on for smithi071 completed 2022-09-12T23:50:49.233 INFO:teuthology.orchestra.console:Power on for smithi018 completed 2022-09-12T23:50:49.311 INFO:teuthology.provision.fog.smithi071:Waiting for deploy to finish 2022-09-12T23:50:49.342 INFO:teuthology.provision.fog.smithi018:Waiting for deploy to finish 2022-09-12T23:55:03.338 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-09-12T23:55:03.620 INFO:teuthology.provision.fog.smithi018:Node is ready 2022-09-12T23:55:03.688 INFO:teuthology.orchestra.run.smithi018.stdout:smithi018.front.sepia.ceph.com 2022-09-12T23:55:03.750 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18 smithi018.front.sepia.ceph.com smithi018 2022-09-12T23:55:04.161 INFO:teuthology.provision.fog.smithi018:Deploy complete! 2022-09-12T23:55:21.526 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-09-12T23:55:21.769 INFO:teuthology.provision.fog.smithi071:Node is ready 2022-09-12T23:55:21.832 INFO:teuthology.orchestra.run.smithi071.stdout:smithi071.front.sepia.ceph.com 2022-09-12T23:55:21.896 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71 smithi071.front.sepia.ceph.com smithi071 2022-09-12T23:55:22.267 INFO:teuthology.provision.fog.smithi071:Deploy complete! 2022-09-12T23:55:22.587 INFO:teuthology.lock.ops:Checking smithi018.front.sepia.ceph.com 2022-09-12T23:55:22.588 INFO:teuthology.lock.ops:New key found. Updating... 2022-09-12T23:55:22.633 INFO:teuthology.lock.ops:Checking smithi071.front.sepia.ceph.com 2022-09-12T23:55:22.633 INFO:teuthology.lock.ops:New key found. Updating... 2022-09-12T23:55:22.662 INFO:teuthology.lock.ops:Updating [smithi018.front.sepia.ceph.com]: set os type and version on server 2022-09-12T23:55:22.663 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2022-09-12T23:55:22.992 INFO:teuthology.orchestra.run.smithi018.stdout:x86_64 2022-09-12T23:55:23.064 INFO:teuthology.orchestra.run.smithi018.stdout:NAME="Red Hat Enterprise Linux" 2022-09-12T23:55:23.064 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION="8.6 (Ootpa)" 2022-09-12T23:55:23.064 INFO:teuthology.orchestra.run.smithi018.stdout:ID="rhel" 2022-09-12T23:55:23.065 INFO:teuthology.orchestra.run.smithi018.stdout:ID_LIKE="fedora" 2022-09-12T23:55:23.065 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_ID="8.6" 2022-09-12T23:55:23.065 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM_ID="platform:el8" 2022-09-12T23:55:23.066 INFO:teuthology.orchestra.run.smithi018.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2022-09-12T23:55:23.066 INFO:teuthology.orchestra.run.smithi018.stdout:ANSI_COLOR="0;31" 2022-09-12T23:55:23.067 INFO:teuthology.orchestra.run.smithi018.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2022-09-12T23:55:23.067 INFO:teuthology.orchestra.run.smithi018.stdout:HOME_URL="https://www.redhat.com/" 2022-09-12T23:55:23.067 INFO:teuthology.orchestra.run.smithi018.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-09-12T23:55:23.068 INFO:teuthology.orchestra.run.smithi018.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-09-12T23:55:23.068 INFO:teuthology.orchestra.run.smithi018.stdout: 2022-09-12T23:55:23.069 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-09-12T23:55:23.069 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2022-09-12T23:55:23.070 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-09-12T23:55:23.071 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2022-09-12T23:55:23.073 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server 2022-09-12T23:55:23.194 INFO:teuthology.lock.ops:Updating [smithi071.front.sepia.ceph.com]: set os type and version on server 2022-09-12T23:55:23.195 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2022-09-12T23:55:23.616 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64 2022-09-12T23:55:23.677 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="Red Hat Enterprise Linux" 2022-09-12T23:55:23.678 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="8.6 (Ootpa)" 2022-09-12T23:55:23.678 INFO:teuthology.orchestra.run.smithi071.stdout:ID="rhel" 2022-09-12T23:55:23.679 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="fedora" 2022-09-12T23:55:23.679 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="8.6" 2022-09-12T23:55:23.680 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el8" 2022-09-12T23:55:23.681 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2022-09-12T23:55:23.681 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2022-09-12T23:55:23.682 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2022-09-12T23:55:23.682 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://www.redhat.com/" 2022-09-12T23:55:23.682 INFO:teuthology.orchestra.run.smithi071.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-09-12T23:55:23.683 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-09-12T23:55:23.683 INFO:teuthology.orchestra.run.smithi071.stdout: 2022-09-12T23:55:23.684 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-09-12T23:55:23.684 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2022-09-12T23:55:23.685 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-09-12T23:55:23.685 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2022-09-12T23:55:23.688 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2022-09-12T23:55:23.903 INFO:teuthology.dispatcher.supervisor:Running job 7029661 2022-09-12T23:55:23.904 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-09-12_21:02:31-rados-wip-yuri4-testing-2022-09-09-1105-distro-default-smithi/7029661 --name yuriw-2022-09-12_21:02:31-rados-wip-yuri4-testing-2022-09-09-1105-distro-default-smithi --description rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} -- /home/teuthworker/archive/yuriw-2022-09-12_21:02:31-rados-wip-yuri4-testing-2022-09-09-1105-distro-default-smithi/7029661/orig.config.yaml 2022-09-12T23:55:23.944 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-09-12_21:02:31-rados-wip-yuri4-testing-2022-09-09-1105-distro-default-smithi/7029661 2022-09-12T23:55:23.945 INFO:teuthology.dispatcher.supervisor:Job PID: 3258 2022-09-12T23:55:23.945 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-09-13T11:56:23.271 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-09-13T11:56:23.452 INFO:teuthology.kill:Killing Pids: {3258} 2022-09-13T11:56:24.875 INFO:teuthology.task.internal:roles: ubuntu@smithi018.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-09-13T11:56:24.876 INFO:teuthology.task.internal:roles: ubuntu@smithi071.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-09-13T11:56:24.876 INFO:teuthology.misc:Compressing logs... 2022-09-13T11:56:24.877 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2022-09-13T11:56:25.134 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2022-09-13T11:56:25.454 INFO:teuthology.misc:Compressing logs... 2022-09-13T11:56:26.475 INFO:teuthology.orchestra.run.smithi071.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-09-13T11:56:26.583 INFO:teuthology.orchestra.run.smithi018.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-09-13T11:56:27.206 INFO:teuthology.misc:Compressing logs... 2022-09-13T12:04:41.145 INFO:teuthology.kill:No teuthology processes running 2022-09-13T12:04:42.496 INFO:teuthology.kill:Nuking machines: ['smithi018', 'smithi071'] 2022-09-13T12:04:43.679 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-09-13T12:04:43.680 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-09-13T12:04:43.681 INFO:teuthology.kill:2022-09-13 12:04:43,679.679 INFO:teuthology.nuke:targets: 2022-09-13T12:04:43.681 INFO:teuthology.kill: smithi018.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCp6Th7fQeYnA4wx3FDX3KK2YEMP9y/pN4fCaKHVH4fN0hgTSdK1cJnpyt9e0k84uwjXELSPEyAPrDI84M+3Ynk9jITrvixEAvl0/iCd2yhoJ/1KrcZKgpOvm0RDG3yZiJRiPGiTgfnLCF+A2gs5CVKuFaHazoSdE50JImNdF+V0m463b0qWStbm45NMg8fK/mXys+hiYG1VFhG+UY0cA0m9bVvhb63J++bkJ3MZUNfd5/RA/qRdv8EcrFS8cd4wD22d5HIwGbtOZMJHknOablhdHQKJZEQ0pg4HVJFaOaRh2EsGfyv1B3aslj/3sCBy0hXZwVjGyglbEB7EkKU3ghP5lHytXAu17QBtGx6eDgXhNwWhqF3HNJrIWJc/EmkSWda0RS+SKCESwlxhZpZQlAhnhaRzXzuLj+pMc+FTSCrgj46MtyeF/k70r6qG1ERc9rkdxyNJFZgW4f9ILM/T0zuORbDCVmL//s+F7TrwDSHB13kYeK7Ymf268NryW1ENmk= 2022-09-13T12:04:43.682 INFO:teuthology.kill: smithi071.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3DXEZSwe/6YfhU+SWj6U1aNIeZPlfw1MKZ6Bom/LNVvmURnja/lqdVy5fcuiuUkTnpwn/ZpSIhRdTdJu0sDjmRoUxFPIh7k6ycUzDk5oNlK0qWPSaKMTVfrrf9eNJmWoRlsCVa+C2jk0SY2nnb0+tmOakmUGxmWGw/5m0TGVYYB7gCmT2KTYfd3LMSP9yto9R2Bvd4VdHZVI6vdx7Ip+A07wIWZSaaL7sZSELFd9WroW7qVCQvHxEzO544VZqrGQoseSf+rb+ij2ZYX60h0nIkLECF2MHfFE0eUsSuTN7kpNJwiSIpQetWauOuYbfVePJOP5pU/d9es2rhv86FMl83B9B2yyoLL1v0De3RuNFMfI78kVW++X0Fu1+pp6wQcotBTxOASM6JeNTIWC2ggJ0A5Ta+2LNF6Tvd3fbyjcnam0NgBt8JyyadfyXzXG4bNGJjByhzdb90u9wfRjUUGZwXBWGZfYOJ/J4QLa7KvIWh4eqKjO5TBEVI9tHMhi7L8U= 2022-09-13T12:04:43.682 INFO:teuthology.kill:2022-09-13 12:04:43,679.679 INFO:teuthology.nuke:Checking targets against current locks 2022-09-13T12:04:43.739 INFO:teuthology.kill:2022-09-13 12:04:43,739.739 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-09-13T12:04:43.756 INFO:teuthology.kill:2022-09-13 12:04:43,756.756 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-09-13T12:04:43.817 INFO:teuthology.kill:2022-09-13 12:04:43,817.817 INFO:teuthology.orchestra.console:Power off smithi018 2022-09-13T12:04:43.854 INFO:teuthology.kill:2022-09-13 12:04:43,854.854 INFO:teuthology.orchestra.console:Power off smithi071 2022-09-13T12:04:52.190 INFO:teuthology.kill:2022-09-13 12:04:52,190.190 INFO:teuthology.orchestra.console:Power off for smithi018 completed 2022-09-13T12:04:52.229 INFO:teuthology.kill:2022-09-13 12:04:52,229.229 INFO:teuthology.orchestra.console:Power off for smithi071 completed 2022-09-13T12:04:52.346 INFO:teuthology.kill:2022-09-13 12:04:52,346.346 INFO:teuthology.lock.ops:unlocked: smithi018.front.sepia.ceph.com 2022-09-13T12:04:52.381 INFO:teuthology.kill:2022-09-13 12:04:52,381.381 INFO:teuthology.lock.ops:unlocked: smithi071.front.sepia.ceph.com 2022-09-13T12:06:52.708 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-09-13T12:06:52.818 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi071 but it was locked by another job: /home/teuthworker/archive/adking-2022-09-13_11:46:25-fs:workload-wip-adk-removal-debugging2-distro-default-smithi/7030531