2022-07-06T01:25:54.362 INFO:root:teuthology version: 1.1.1.dev379+gf58709e3 2022-07-06T01:25:54.730 INFO:teuthology.lock.ops:Start node 'smithi061.front.sepia.ceph.com' reimaging 2022-07-06T01:25:54.732 INFO:teuthology.lock.ops:Updating [smithi061.front.sepia.ceph.com]: reset os type and version on server 2022-07-06T01:25:54.733 INFO:teuthology.lock.ops:Updating smithi061.front.sepia.ceph.com on lock server 2022-07-06T01:25:54.786 INFO:teuthology.lock.ops:Node 'smithi061.front.sepia.ceph.com' reimaging is complete 2022-07-06T01:25:54.787 INFO:teuthology.lock.ops:Start node 'smithi132.front.sepia.ceph.com' reimaging 2022-07-06T01:25:54.788 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: reset os type and version on server 2022-07-06T01:25:54.788 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2022-07-06T01:25:54.848 INFO:teuthology.lock.ops:Node 'smithi132.front.sepia.ceph.com' reimaging is complete 2022-07-06T01:25:55.113 INFO:teuthology.provision.fog.smithi061:Scheduling deploy of centos 8.stream 2022-07-06T01:25:55.129 INFO:teuthology.provision.fog.smithi132:Scheduling deploy of centos 8.stream 2022-07-06T01:25:55.929 INFO:teuthology.orchestra.console:Power off smithi132 2022-07-06T01:25:55.965 INFO:teuthology.orchestra.console:Power off smithi061 2022-07-06T01:26:04.470 INFO:teuthology.orchestra.console:Power off for smithi132 completed 2022-07-06T01:26:04.575 INFO:teuthology.orchestra.console:Power on smithi132 2022-07-06T01:26:08.584 INFO:teuthology.orchestra.console:Power off for smithi061 completed 2022-07-06T01:26:08.737 INFO:teuthology.orchestra.console:Power on smithi061 2022-07-06T01:26:08.976 INFO:teuthology.orchestra.console:Power on for smithi132 completed 2022-07-06T01:26:09.078 INFO:teuthology.provision.fog.smithi132:Waiting for deploy to finish 2022-07-06T01:26:17.290 INFO:teuthology.orchestra.console:Power on for smithi061 completed 2022-07-06T01:26:17.407 INFO:teuthology.provision.fog.smithi061:Waiting for deploy to finish 2022-07-06T01:28:49.017 ERROR:teuthology.orchestra.connection:Error authenticating with smithi061.front.sepia.ceph.com: Authentication failed. 2022-07-06T01:30:07.019 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-07-06T01:30:27.751 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-07-06T01:30:32.402 INFO:teuthology.provision.fog.smithi132:Node is ready 2022-07-06T01:30:32.422 INFO:teuthology.orchestra.run.smithi132.stdout:smithi132.front.sepia.ceph.com 2022-07-06T01:30:32.482 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.15.132 smithi132.front.sepia.ceph.com smithi132 2022-07-06T01:30:32.874 INFO:teuthology.provision.fog.smithi132:Deploy complete! 2022-07-06T01:30:58.167 INFO:teuthology.provision.fog.smithi061:Node is ready 2022-07-06T01:30:58.207 INFO:teuthology.orchestra.run.smithi061.stdout:smithi061.front.sepia.ceph.com 2022-07-06T01:30:58.279 INFO:teuthology.orchestra.run.smithi061.stdout:172.21.15.61 smithi061.front.sepia.ceph.com smithi061 2022-07-06T01:30:58.655 INFO:teuthology.provision.fog.smithi061:Deploy complete! 2022-07-06T01:30:58.868 INFO:teuthology.lock.ops:Checking smithi061.front.sepia.ceph.com 2022-07-06T01:30:58.870 INFO:teuthology.lock.ops:New key found. Updating... 2022-07-06T01:30:58.897 INFO:teuthology.lock.ops:Checking smithi132.front.sepia.ceph.com 2022-07-06T01:30:58.898 INFO:teuthology.lock.ops:New key found. Updating... 2022-07-06T01:30:58.927 INFO:teuthology.lock.ops:Updating [smithi061.front.sepia.ceph.com]: set os type and version on server 2022-07-06T01:30:58.927 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi061.front.sepia.ceph.com' 2022-07-06T01:30:59.148 INFO:teuthology.orchestra.run.smithi061.stdout:x86_64 2022-07-06T01:30:59.207 INFO:teuthology.orchestra.run.smithi061.stdout:NAME="CentOS Stream" 2022-07-06T01:30:59.207 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION="8" 2022-07-06T01:30:59.208 INFO:teuthology.orchestra.run.smithi061.stdout:ID="centos" 2022-07-06T01:30:59.208 INFO:teuthology.orchestra.run.smithi061.stdout:ID_LIKE="rhel fedora" 2022-07-06T01:30:59.209 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_ID="8" 2022-07-06T01:30:59.209 INFO:teuthology.orchestra.run.smithi061.stdout:PLATFORM_ID="platform:el8" 2022-07-06T01:30:59.209 INFO:teuthology.orchestra.run.smithi061.stdout:PRETTY_NAME="CentOS Stream 8" 2022-07-06T01:30:59.209 INFO:teuthology.orchestra.run.smithi061.stdout:ANSI_COLOR="0;31" 2022-07-06T01:30:59.210 INFO:teuthology.orchestra.run.smithi061.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-07-06T01:30:59.210 INFO:teuthology.orchestra.run.smithi061.stdout:HOME_URL="https://centos.org/" 2022-07-06T01:30:59.210 INFO:teuthology.orchestra.run.smithi061.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-07-06T01:30:59.211 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-07-06T01:30:59.211 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-07-06T01:30:59.213 INFO:teuthology.lock.ops:Updating smithi061.front.sepia.ceph.com on lock server 2022-07-06T01:30:59.241 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: set os type and version on server 2022-07-06T01:30:59.242 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2022-07-06T01:30:59.534 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64 2022-07-06T01:30:59.601 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="CentOS Stream" 2022-07-06T01:30:59.601 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8" 2022-07-06T01:30:59.602 INFO:teuthology.orchestra.run.smithi132.stdout:ID="centos" 2022-07-06T01:30:59.602 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="rhel fedora" 2022-07-06T01:30:59.603 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8" 2022-07-06T01:30:59.603 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8" 2022-07-06T01:30:59.604 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="CentOS Stream 8" 2022-07-06T01:30:59.605 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2022-07-06T01:30:59.606 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-07-06T01:30:59.606 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://centos.org/" 2022-07-06T01:30:59.607 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-07-06T01:30:59.607 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-07-06T01:30:59.607 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-07-06T01:30:59.608 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2022-07-06T01:30:59.771 INFO:teuthology.dispatcher.supervisor:Running job 6916237 2022-07-06T01:30:59.771 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/bin/teuthology -v --owner scheduled_myoungwon@teuthology --archive /home/teuthworker/archive/myoungwon-2022-07-06_01:18:59-rados:thrash-wip-dedup-tool-update-distro-default-smithi/6916237 --name myoungwon-2022-07-06_01:18:59-rados:thrash-wip-dedup-tool-update-distro-default-smithi --description rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/dedup-io-snaps} -- /home/teuthworker/archive/myoungwon-2022-07-06_01:18:59-rados:thrash-wip-dedup-tool-update-distro-default-smithi/6916237/orig.config.yaml 2022-07-06T01:30:59.784 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/myoungwon-2022-07-06_01:18:59-rados:thrash-wip-dedup-tool-update-distro-default-smithi/6916237 2022-07-06T01:30:59.785 INFO:teuthology.dispatcher.supervisor:Job PID: 3354 2022-07-06T01:30:59.785 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-07-06T13:31:34.679 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-07-06T13:31:34.883 INFO:teuthology.kill:Killing Pids: {3354} 2022-07-06T13:31:37.757 INFO:teuthology.task.internal:roles: ubuntu@smithi061.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-07-06T13:31:37.758 INFO:teuthology.task.internal:roles: ubuntu@smithi132.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-07-06T13:31:37.758 INFO:teuthology.misc:Compressing logs... 2022-07-06T13:31:37.759 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi061.front.sepia.ceph.com' 2022-07-06T13:31:38.062 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2022-07-06T13:31:38.509 INFO:teuthology.misc:Compressing logs... 2022-07-06T13:31:39.607 INFO:teuthology.orchestra.run.smithi132.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-07-06T13:31:39.679 INFO:teuthology.orchestra.run.smithi061.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-07-06T13:31:40.693 INFO:teuthology.misc:Compressing logs... 2022-07-06T13:32:28.191 INFO:teuthology.kill:No teuthology processes running 2022-07-06T13:32:31.253 INFO:teuthology.kill:Nuking machines: ['smithi061', 'smithi132'] 2022-07-06T13:32:34.044 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-07-06T13:32:34.045 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-07-06T13:32:34.045 INFO:teuthology.kill:2022-07-06 13:32:34,043.043 INFO:teuthology.nuke:targets: 2022-07-06T13:32:34.045 INFO:teuthology.kill: smithi061.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4+n3jTcUmTMDhJs4p71WleowO40+aMRaH4p0raCtwSpQIvxeU2eLrQh85zUPpN/AfAlrXUJxiFzSnIujaFe3bGXNksag5rpYcr3lE/OCtALb3k9MNpgqKwW3Ha8NvOpVShxCLe995Byg0h5Iru9AI0T/abqXFXklfBZ6+ghTNVenK2bEPyjiprb8Vt5su7Wq8vwXM3jrljKPgm/h59L6QERlxYYWQmJfLpDKL9Z7MQy4XcW7ibgNy3hwH2YPBCMDlvxdytMbFO7u+uacBJP4wNWr7z7dYAuJ+uBetpFEyQsTzpJJswc3LCG2R5Sr3FwpUIbDUurZYIDN44iXjZM2IVXvUS7jcuVxT2GtMOzkDo1Cu6cmiLaCC/Emt+AV7br8GU+vWMrGVysIObk95cQElFdqlNP0B8G1V/tY0v+lxHmpuypvrahaZ9O2PM3x96F1KVh2YagAVlhVsyiCL1GfdlDTbGO+CB9WHdCr3Uhu22Tf88OVveEwTC1AdsQHydes= 2022-07-06T13:32:34.046 INFO:teuthology.kill: smithi132.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCtCDzJgUerspHz47zqzs4BtmsIG1k17+Re4tZzTS4vUKQPwV3ZLl85eaN+K/ZqG/gTWor+ABqb/UA4kvmTdhGI9X5VYcH0ZGTsLTXXpWHAMVdYdf1tvcpkj++NDPFFymS9309ztR+uqWjBz7Lt/AHtiJzKXc7h9KqdT3GoOR8b1w7zKMfr0+928UnGt9Tj1NrV+M242sN1DydlyqOvAIAooAi3GU1uE4sllDF7j++CoCKMumAVakZaOyf8AP2rURWzv81pS3vT043qcZdDI9Dl/rvrjDBv7I4Xz6+nWx/8rShwcFqdcD/fxdK4cYxkbUQHs1wQnatlmPEnyPiA27wXRlR9Zimcftp0BQWfwuYCKzfi6DoIrAQ26raOceSFrcgCfDOU7Ie6qW9V1COfzIL2fmiIaZVJXbEvEf8tZjGpy0TVS1aBXiSBuomAgtbSaGfOGPyYnKLqiylscG47F+qNDef6OX9y06V12BvKACoq7RsQ7kSTK7TTt2dQo+0whUM= 2022-07-06T13:32:34.046 INFO:teuthology.kill:2022-07-06 13:32:34,046.046 INFO:teuthology.nuke:Checking targets against current locks 2022-07-06T13:32:34.153 INFO:teuthology.kill:2022-07-06 13:32:34,152.152 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-07-06T13:32:34.199 INFO:teuthology.kill:2022-07-06 13:32:34,199.199 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-07-06T13:32:34.257 INFO:teuthology.kill:2022-07-06 13:32:34,256.256 INFO:teuthology.orchestra.console:Power off smithi061 2022-07-06T13:32:34.467 INFO:teuthology.kill:2022-07-06 13:32:34,466.466 INFO:teuthology.orchestra.console:Power off smithi132 2022-07-06T13:32:42.677 INFO:teuthology.kill:2022-07-06 13:32:42,672.672 INFO:teuthology.orchestra.console:Power off for smithi061 completed 2022-07-06T13:32:42.838 INFO:teuthology.kill:2022-07-06 13:32:42,836.836 INFO:teuthology.lock.ops:unlocked: smithi061.front.sepia.ceph.com 2022-07-06T13:32:42.876 INFO:teuthology.kill:2022-07-06 13:32:42,876.876 INFO:teuthology.orchestra.console:Power off for smithi132 completed 2022-07-06T13:32:43.043 INFO:teuthology.kill:2022-07-06 13:32:43,042.042 INFO:teuthology.lock.ops:unlocked: smithi132.front.sepia.ceph.com 2022-07-06T13:34:43.533 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-07-06T13:34:43.709 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi061 but it was locked by another job: /home/teuthworker/archive/rishabh-2022-07-06_05:24:29-fs-wip-rishabh-testing-20220705-2132-distro-default-smithi/6916802 2022-07-06T13:34:43.710 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi132 but it was locked by another job: /home/teuthworker/archive/rishabh-2022-07-06_05:24:29-fs-wip-rishabh-testing-20220705-2132-distro-default-smithi/6916802