2022-09-04T03:10:29.337 INFO:root:teuthology version: 1.1.1.dev418+gb58f2c18 2022-09-04T03:10:29.480 INFO:teuthology.lock.ops:Start node 'smithi055.front.sepia.ceph.com' reimaging 2022-09-04T03:10:29.481 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: reset os type and version on server 2022-09-04T03:10:29.481 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2022-09-04T03:10:29.507 INFO:teuthology.lock.ops:Node 'smithi055.front.sepia.ceph.com' reimaging is complete 2022-09-04T03:10:29.507 INFO:teuthology.lock.ops:Start node 'smithi201.front.sepia.ceph.com' reimaging 2022-09-04T03:10:29.507 INFO:teuthology.lock.ops:Updating [smithi201.front.sepia.ceph.com]: reset os type and version on server 2022-09-04T03:10:29.508 INFO:teuthology.lock.ops:Updating smithi201.front.sepia.ceph.com on lock server 2022-09-04T03:10:29.533 INFO:teuthology.lock.ops:Node 'smithi201.front.sepia.ceph.com' reimaging is complete 2022-09-04T03:10:29.728 INFO:teuthology.provision.fog.smithi055:Scheduling deploy of rhel 8.6 2022-09-04T03:10:29.751 INFO:teuthology.provision.fog.smithi201:Scheduling deploy of rhel 8.6 2022-09-04T03:10:30.020 INFO:teuthology.orchestra.console:Power off smithi055 2022-09-04T03:10:30.070 INFO:teuthology.orchestra.console:Power off smithi201 2022-09-04T03:10:42.523 INFO:teuthology.orchestra.console:Power off for smithi055 completed 2022-09-04T03:10:42.547 INFO:teuthology.orchestra.console:Power off for smithi201 completed 2022-09-04T03:10:42.625 INFO:teuthology.orchestra.console:Power on smithi055 2022-09-04T03:10:42.653 INFO:teuthology.orchestra.console:Power on smithi201 2022-09-04T03:10:46.881 INFO:teuthology.orchestra.console:Power on for smithi055 completed 2022-09-04T03:10:46.982 INFO:teuthology.provision.fog.smithi055:Waiting for deploy to finish 2022-09-04T03:10:51.019 INFO:teuthology.orchestra.console:Power on for smithi201 completed 2022-09-04T03:10:51.121 INFO:teuthology.provision.fog.smithi201:Waiting for deploy to finish 2022-09-04T03:15:09.468 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-09-04T03:15:09.741 INFO:teuthology.provision.fog.smithi055:Node is ready 2022-09-04T03:15:09.761 INFO:teuthology.orchestra.run.smithi055.stdout:smithi055.front.sepia.ceph.com 2022-09-04T03:15:09.821 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55 smithi055.front.sepia.ceph.com smithi055 2022-09-04T03:15:10.196 INFO:teuthology.provision.fog.smithi055:Deploy complete! 2022-09-04T03:15:22.553 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-09-04T03:15:22.822 INFO:teuthology.provision.fog.smithi201:Node is ready 2022-09-04T03:15:22.841 INFO:teuthology.orchestra.run.smithi201.stdout:smithi201.front.sepia.ceph.com 2022-09-04T03:15:22.900 INFO:teuthology.orchestra.run.smithi201.stdout:172.21.15.201 smithi201.front.sepia.ceph.com smithi201 2022-09-04T03:15:23.251 INFO:teuthology.provision.fog.smithi201:Deploy complete! 2022-09-04T03:15:23.440 INFO:teuthology.lock.ops:Checking smithi055.front.sepia.ceph.com 2022-09-04T03:15:23.441 INFO:teuthology.lock.ops:New key found. Updating... 2022-09-04T03:15:23.464 INFO:teuthology.lock.ops:Checking smithi201.front.sepia.ceph.com 2022-09-04T03:15:23.464 INFO:teuthology.lock.ops:New key found. Updating... 2022-09-04T03:15:23.486 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: set os type and version on server 2022-09-04T03:15:23.486 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2022-09-04T03:15:23.719 INFO:teuthology.orchestra.run.smithi055.stdout:x86_64 2022-09-04T03:15:23.778 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="Red Hat Enterprise Linux" 2022-09-04T03:15:23.778 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="8.6 (Ootpa)" 2022-09-04T03:15:23.779 INFO:teuthology.orchestra.run.smithi055.stdout:ID="rhel" 2022-09-04T03:15:23.779 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE="fedora" 2022-09-04T03:15:23.780 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="8.6" 2022-09-04T03:15:23.782 INFO:teuthology.orchestra.run.smithi055.stdout:PLATFORM_ID="platform:el8" 2022-09-04T03:15:23.782 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2022-09-04T03:15:23.782 INFO:teuthology.orchestra.run.smithi055.stdout:ANSI_COLOR="0;31" 2022-09-04T03:15:23.782 INFO:teuthology.orchestra.run.smithi055.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2022-09-04T03:15:23.783 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://www.redhat.com/" 2022-09-04T03:15:23.783 INFO:teuthology.orchestra.run.smithi055.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-09-04T03:15:23.783 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-09-04T03:15:23.783 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-09-04T03:15:23.784 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-09-04T03:15:23.784 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2022-09-04T03:15:23.784 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-09-04T03:15:23.784 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2022-09-04T03:15:23.786 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2022-09-04T03:15:23.807 INFO:teuthology.lock.ops:Updating [smithi201.front.sepia.ceph.com]: set os type and version on server 2022-09-04T03:15:23.807 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi201.front.sepia.ceph.com' 2022-09-04T03:15:24.006 INFO:teuthology.orchestra.run.smithi201.stdout:x86_64 2022-09-04T03:15:24.063 INFO:teuthology.orchestra.run.smithi201.stdout:NAME="Red Hat Enterprise Linux" 2022-09-04T03:15:24.064 INFO:teuthology.orchestra.run.smithi201.stdout:VERSION="8.6 (Ootpa)" 2022-09-04T03:15:24.064 INFO:teuthology.orchestra.run.smithi201.stdout:ID="rhel" 2022-09-04T03:15:24.064 INFO:teuthology.orchestra.run.smithi201.stdout:ID_LIKE="fedora" 2022-09-04T03:15:24.064 INFO:teuthology.orchestra.run.smithi201.stdout:VERSION_ID="8.6" 2022-09-04T03:15:24.065 INFO:teuthology.orchestra.run.smithi201.stdout:PLATFORM_ID="platform:el8" 2022-09-04T03:15:24.065 INFO:teuthology.orchestra.run.smithi201.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2022-09-04T03:15:24.065 INFO:teuthology.orchestra.run.smithi201.stdout:ANSI_COLOR="0;31" 2022-09-04T03:15:24.065 INFO:teuthology.orchestra.run.smithi201.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2022-09-04T03:15:24.066 INFO:teuthology.orchestra.run.smithi201.stdout:HOME_URL="https://www.redhat.com/" 2022-09-04T03:15:24.066 INFO:teuthology.orchestra.run.smithi201.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-09-04T03:15:24.066 INFO:teuthology.orchestra.run.smithi201.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-09-04T03:15:24.066 INFO:teuthology.orchestra.run.smithi201.stdout: 2022-09-04T03:15:24.066 INFO:teuthology.orchestra.run.smithi201.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-09-04T03:15:24.067 INFO:teuthology.orchestra.run.smithi201.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2022-09-04T03:15:24.067 INFO:teuthology.orchestra.run.smithi201.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-09-04T03:15:24.067 INFO:teuthology.orchestra.run.smithi201.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2022-09-04T03:15:24.068 INFO:teuthology.lock.ops:Updating smithi201.front.sepia.ceph.com on lock server 2022-09-04T03:15:24.171 INFO:teuthology.dispatcher.supervisor:Running job 7004553 2022-09-04T03:15:24.172 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2022-09-01_10:54:32-rados-WIP_GBH_snap_mapper_one_way-distro-default-smithi/7004553 --name benhanokh-2022-09-01_10:54:32-rados-WIP_GBH_snap_mapper_one_way-distro-default-smithi --description rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/redirect_promote_tests} -- /home/teuthworker/archive/benhanokh-2022-09-01_10:54:32-rados-WIP_GBH_snap_mapper_one_way-distro-default-smithi/7004553/orig.config.yaml 2022-09-04T03:15:24.177 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2022-09-01_10:54:32-rados-WIP_GBH_snap_mapper_one_way-distro-default-smithi/7004553 2022-09-04T03:15:24.178 INFO:teuthology.dispatcher.supervisor:Job PID: 28015 2022-09-04T03:15:24.178 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-09-04T15:16:22.910 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-09-04T15:16:23.094 INFO:teuthology.kill:Killing Pids: {28015} 2022-09-04T15:16:24.528 INFO:teuthology.task.internal:roles: ubuntu@smithi055.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-09-04T15:16:24.529 INFO:teuthology.task.internal:roles: ubuntu@smithi201.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-09-04T15:16:24.530 INFO:teuthology.misc:Compressing logs... 2022-09-04T15:16:24.531 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2022-09-04T15:16:24.738 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi201.front.sepia.ceph.com' 2022-09-04T15:16:25.072 INFO:teuthology.misc:Compressing logs... 2022-09-04T15:16:26.081 INFO:teuthology.orchestra.run.smithi055.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-09-04T15:16:26.308 INFO:teuthology.orchestra.run.smithi201.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-09-04T15:16:38.974 INFO:teuthology.misc:Compressing logs... 2022-09-04T15:17:00.208 INFO:teuthology.kill:No teuthology processes running 2022-09-04T15:17:01.673 INFO:teuthology.kill:Nuking machines: ['smithi055', 'smithi201'] 2022-09-04T15:17:02.811 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-09-04T15:17:02.812 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-09-04T15:17:02.812 INFO:teuthology.kill:2022-09-04 15:17:02,811.811 INFO:teuthology.nuke:targets: 2022-09-04T15:17:02.812 INFO:teuthology.kill: smithi055.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM7Yq0sgn/H9UCdmog9vJgQuG2DN0KqStw8obSF6DEVp2YJwmgF5TKMWL2OHLmaFriJFpaPyc8FDVWCCh+1Q0ww= 2022-09-04T15:17:02.813 INFO:teuthology.kill: smithi201.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpVzSIur5Au34p9k3S0punj1s2i00C/WLVC1t7w4r9ZwMyBAUgOPQcDZdLxLWncjXt5fxQotAW+kzBxZNNXmF402uc5bRPDdan7WHZF1/hk+CXCI8tso7HoGjNrR2W5glGKh2a6yQSXffECXK4+cATk6ZF6kvcJsmhXMWXp1qiyrnM4tOJchdZhzQ/HIVz54kn74CrEg0mPVgWFs4Bng1l62EmumgDheYQuDaaQla+nxlXAmUgyTKv0kBy0CQ8nrzDhBAn5+sCeKzHVXq9uzSY7DulxYgFhi3HqH0NNjdZOlNsJQAO0SLQR/yorxWBGVtQpg/Vfl8w3GdXbCJqYTnYZ++5oIKB7JLcmFMtsZWxTynyvhxLP1g2d8aNBUhhCR7CXrQovubGofZfl93AmJ+ROQhcVsM5bhuTSupVXvwD0/NRqrzgpPaxXIV5Mp4HApuxpGuSUdqo6RUxMAletdUM/L+rFxC5/WUBkic17cIJD2A/FeDjTOLZXXD4Ae1j4SU= 2022-09-04T15:17:02.813 INFO:teuthology.kill:2022-09-04 15:17:02,811.811 INFO:teuthology.nuke:Checking targets against current locks 2022-09-04T15:17:02.865 INFO:teuthology.kill:2022-09-04 15:17:02,865.865 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-09-04T15:17:02.892 INFO:teuthology.kill:2022-09-04 15:17:02,892.892 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-09-04T15:17:02.947 INFO:teuthology.kill:2022-09-04 15:17:02,946.946 INFO:teuthology.orchestra.console:Power off smithi055 2022-09-04T15:17:02.988 INFO:teuthology.kill:2022-09-04 15:17:02,988.988 INFO:teuthology.orchestra.console:Power off smithi201 2022-09-04T15:17:11.358 INFO:teuthology.kill:2022-09-04 15:17:11,357.357 INFO:teuthology.orchestra.console:Power off for smithi201 completed 2022-09-04T15:17:11.513 INFO:teuthology.kill:2022-09-04 15:17:11,512.512 INFO:teuthology.lock.ops:unlocked: smithi201.front.sepia.ceph.com 2022-09-04T15:17:15.435 INFO:teuthology.kill:2022-09-04 15:17:15,434.434 INFO:teuthology.orchestra.console:Power off for smithi055 completed 2022-09-04T15:17:15.582 INFO:teuthology.kill:2022-09-04 15:17:15,581.581 INFO:teuthology.lock.ops:unlocked: smithi055.front.sepia.ceph.com 2022-09-04T15:19:15.918 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-09-04T15:19:16.031 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi055 but it was locked by another job: /home/teuthworker/archive/khiremat-2022-09-02_09:35:13-fs-wip-khiremat-47893-test-mgr-finisher-thread-0-distro-default-smithi/7007171 2022-09-04T15:19:16.031 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi201 but it was locked by another job: /home/teuthworker/archive/khiremat-2022-09-02_09:35:13-fs-wip-khiremat-47893-test-mgr-finisher-thread-0-distro-default-smithi/7007171